2024-06-18T22:24:04.534603088Z 2024-06-18T22:24:04.546908521Z Cleaning logs every 900 seconds 2024-06-18T22:24:04.546947112Z Trimming airflow logs to 15 days. 2024-06-18T22:30:00.648510328Z Trimming airflow logs to 15 days. 2024-06-18T22:30:01.684861257Z Trimming airflow logs to 15 days. 2024-06-18T22:45:00.727268643Z Trimming airflow logs to 15 days. 2024-06-18T22:45:01.773407798Z Trimming airflow logs to 15 days. 2024-06-18T23:00:00.940777529Z Trimming airflow logs to 15 days. 2024-06-18T23:15:00.192306355Z Trimming airflow logs to 15 days. 2024-06-18T23:15:01.234421898Z Trimming airflow logs to 15 days. 2024-06-18T23:30:00.296661105Z Trimming airflow logs to 15 days. 2024-06-18T23:30:01.350534326Z Trimming airflow logs to 15 days. 2024-06-18T23:45:00.409003464Z Trimming airflow logs to 15 days. 2024-06-18T23:45:01.546247641Z Trimming airflow logs to 15 days. 2024-06-19T00:00:00.608359800Z Trimming airflow logs to 15 days. 2024-06-19T00:00:01.699165422Z Trimming airflow logs to 15 days. 2024-06-19T00:15:00.759786551Z Trimming airflow logs to 15 days. 2024-06-19T00:15:01.845615512Z Trimming airflow logs to 15 days. 2024-06-19T00:30:00.923261111Z Trimming airflow logs to 15 days. 2024-06-19T00:30:02.007506043Z Trimming airflow logs to 15 days. 2024-06-19T00:45:00.094897275Z Trimming airflow logs to 15 days. 2024-06-19T00:45:01.162048843Z Trimming airflow logs to 15 days. 2024-06-19T01:00:00.242239734Z Trimming airflow logs to 15 days. 2024-06-19T01:00:01.316366950Z Trimming airflow logs to 15 days. 2024-06-19T01:15:00.410925631Z Trimming airflow logs to 15 days. 2024-06-19T01:15:01.490382981Z Trimming airflow logs to 15 days. 2024-06-19T01:30:00.568371131Z Trimming airflow logs to 15 days. 2024-06-19T01:30:01.701509125Z Trimming airflow logs to 15 days. 2024-06-19T01:45:00.812042625Z Trimming airflow logs to 15 days. 2024-06-19T01:45:01.927963580Z Trimming airflow logs to 15 days. 2024-06-19T02:00:00.178112033Z Trimming airflow logs to 15 days. 2024-06-19T02:00:01.296157148Z Trimming airflow logs to 15 days. 2024-06-19T02:15:00.388512027Z Trimming airflow logs to 15 days. 2024-06-19T02:15:01.515209981Z Trimming airflow logs to 15 days. 2024-06-19T02:30:00.630217285Z Trimming airflow logs to 15 days. 2024-06-19T02:30:01.727990779Z Trimming airflow logs to 15 days. 2024-06-19T02:45:00.864497165Z Trimming airflow logs to 15 days. 2024-06-19T02:45:01.960684735Z Trimming airflow logs to 15 days. 2024-06-18T22:23:38.231870171Z .... 2024-06-18T22:23:38.717283638Z /home/airflow/.local/lib/python3.10/site-packages/airflow/configuration.py:384 FutureWarning: The auth_backends setting in [api] has had airflow.api.auth.backend.session added in the running config, which is needed by the UI. Please update your config before Apache Airflow 3.0. 2024-06-18T22:23:39.375799122Z /home/airflow/.local/lib/python3.10/site-packages/airflow/models/base.py:49 MovedIn20Warning: Deprecated API features detected! These feature(s) are not compatible with SQLAlchemy 2.0. To prevent incompatible upgrades prior to updating applications, ensure requirements files are pinned to "sqlalchemy<2.0". Set environment variable SQLALCHEMY_WARN_20=1 to show all deprecation warnings. Set environment variable SQLALCHEMY_SILENCE_UBER_WARNING=1 to silence this message. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9) 2024-06-18T22:23:44.245672918Z [2024-06-18T22:23:44.239+0000] {db.py:755} INFO - Waiting for migrations... 0 second(s) 2024-06-18T22:23:45.260434122Z [2024-06-18T22:23:45.252+0000] {db.py:755} INFO - Waiting for migrations... 1 second(s) 2024-06-18T22:23:46.264864370Z [2024-06-18T22:23:46.264+0000] {db.py:755} INFO - Waiting for migrations... 2 second(s) 2024-06-18T22:23:47.268131406Z [2024-06-18T22:23:47.267+0000] {db.py:755} INFO - Waiting for migrations... 3 second(s) 2024-06-18T22:23:48.276224977Z [2024-06-18T22:23:48.275+0000] {db.py:755} INFO - Waiting for migrations... 4 second(s) 2024-06-18T22:23:49.283938477Z [2024-06-18T22:23:49.283+0000] {db.py:755} INFO - Waiting for migrations... 5 second(s) 2024-06-18T22:23:50.294938794Z [2024-06-18T22:23:50.294+0000] {db.py:755} INFO - Waiting for migrations... 6 second(s) 2024-06-18T22:24:02.832369287Z 2024-06-18T22:24:04.561774810Z /home/airflow/.local/lib/python3.10/site-packages/airflow/configuration.py:384 FutureWarning: The auth_backends setting in [api] has had airflow.api.auth.backend.session added in the running config, which is needed by the UI. Please update your config before Apache Airflow 3.0. 2024-06-18T22:24:06.477470509Z /home/airflow/.local/lib/python3.10/site-packages/airflow/models/base.py:49 MovedIn20Warning: Deprecated API features detected! These feature(s) are not compatible with SQLAlchemy 2.0. To prevent incompatible upgrades prior to updating applications, ensure requirements files are pinned to "sqlalchemy<2.0". Set environment variable SQLALCHEMY_WARN_20=1 to show all deprecation warnings. Set environment variable SQLALCHEMY_SILENCE_UBER_WARNING=1 to silence this message. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9) 2024-06-18T22:24:12.743236532Z [2024-06-18 22:24:12 +0000] [16] [INFO] Starting gunicorn 20.1.0 2024-06-18T22:24:12.747823870Z [2024-06-18 22:24:12 +0000] [16] [INFO] Listening at: http://[::]:8793 (16) 2024-06-18T22:24:12.752618412Z [2024-06-18 22:24:12 +0000] [16] [INFO] Using worker: sync 2024-06-18T22:24:12.776632684Z [2024-06-18 22:24:12 +0000] [17] [INFO] Booting worker with pid: 17 2024-06-18T22:24:12.860846856Z [2024-06-18 22:24:12 +0000] [18] [INFO] Booting worker with pid: 18 2024-06-18T22:24:14.200288244Z 2024-06-18T22:24:14.200309943Z -------------- celery@airflow-worker-0 v5.2.7 (dawn-chorus) 2024-06-18T22:24:14.200316634Z --- ***** ----- 2024-06-18T22:24:14.200321887Z -- ******* ---- Linux-5.15.0-47-generic-x86_64-with-glibc2.31 2024-06-18 22:24:14 2024-06-18T22:24:14.200326079Z - *** --- * --- 2024-06-18T22:24:14.200329945Z - ** ---------- [config] 2024-06-18T22:24:14.200333400Z - ** ---------- .> app: airflow.executors.celery_executor:0x7f9757c5eb60 2024-06-18T22:24:14.200336646Z - ** ---------- .> transport: redis://:**@airflow-redis:6379/0 2024-06-18T22:24:14.200339813Z - ** ---------- .> results: postgresql://postgres:**@airflow-postgresql.osm:5432/postgres 2024-06-18T22:24:14.200344556Z - *** --- * --- .> concurrency: 16 (prefork) 2024-06-18T22:24:14.200347731Z -- ******* ---- .> task events: OFF (enable -E to monitor tasks in this worker) 2024-06-18T22:24:14.200350752Z --- ***** ----- 2024-06-18T22:24:14.200353739Z -------------- [queues] 2024-06-18T22:24:14.200356840Z .> default exchange=default(direct) key=default 2024-06-18T22:24:14.200359866Z 2024-06-18T22:24:14.200362692Z 2024-06-18T22:24:14.200365716Z [tasks] 2024-06-18T22:24:14.200369028Z . airflow.executors.celery_executor.execute_command 2024-06-18T22:24:14.200373051Z 2024-06-18T22:24:19.450610243Z [2024-06-18 22:24:19,447: INFO/MainProcess] Connected to redis://:**@airflow-redis:6379/0 2024-06-18T22:24:19.454880188Z [2024-06-18 22:24:19,454: INFO/MainProcess] mingle: searching for neighbors 2024-06-18T22:24:20.478254674Z [2024-06-18 22:24:20,478: INFO/MainProcess] mingle: all alone 2024-06-18T22:24:20.518013892Z [2024-06-18 22:24:20,517: INFO/MainProcess] celery@airflow-worker-0 ready. 2024-06-18T22:25:12.650477272Z [2024-06-18 22:25:12,646: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8c827bc2-39d1-4991-a700-820e714bc252] received 2024-06-18T22:25:12.770454056Z [2024-06-18 22:25:12,769: INFO/ForkPoolWorker-15] [8c827bc2-39d1-4991-a700-820e714bc252] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-18T22:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-18T22:25:13.319947604Z [2024-06-18 22:25:13,316: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-18T22:25:13.696339162Z [2024-06-18 22:25:13,696: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:25:44.347187392Z [2024-06-18 22:25:44,346: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8c827bc2-39d1-4991-a700-820e714bc252] succeeded in 31.696881285000018s: None 2024-06-18T22:25:54.263296045Z [2024-06-18 22:25:54,262: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[381cf5c0-df66-4c77-b90b-db6b06271cee] received 2024-06-18T22:25:54.270018976Z [2024-06-18 22:25:54,269: INFO/ForkPoolWorker-15] [381cf5c0-df66-4c77-b90b-db6b06271cee] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-18T22:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-18T22:25:54.538236862Z [2024-06-18 22:25:54,534: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-18T22:25:54.772255054Z [2024-06-18 22:25:54,771: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:26:25.352085734Z [2024-06-18 22:26:25,351: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[381cf5c0-df66-4c77-b90b-db6b06271cee] succeeded in 31.087357016000055s: None 2024-06-18T22:26:26.795995002Z [2024-06-18 22:26:26,795: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[66c90b9e-8678-467a-b261-89096dfb974a] received 2024-06-18T22:26:26.802315646Z [2024-06-18 22:26:26,802: INFO/ForkPoolWorker-15] [66c90b9e-8678-467a-b261-89096dfb974a] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-18T22:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-18T22:26:27.159651929Z [2024-06-18 22:26:27,155: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-18T22:26:27.394743007Z [2024-06-18 22:26:27,394: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:26:57.933766055Z [2024-06-18 22:26:57,932: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[66c90b9e-8678-467a-b261-89096dfb974a] succeeded in 31.135189458000013s: None 2024-06-18T22:27:07.913851558Z [2024-06-18 22:27:07,913: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6177bcfc-8715-473f-9db0-95248140c0f4] received 2024-06-18T22:27:07.924716586Z [2024-06-18 22:27:07,924: INFO/ForkPoolWorker-15] [6177bcfc-8715-473f-9db0-95248140c0f4] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-18T22:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-18T22:27:08.278394905Z [2024-06-18 22:27:08,274: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-18T22:27:08.565096401Z [2024-06-18 22:27:08,564: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:27:22.439653675Z [2024-06-18 22:27:22,439: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6177bcfc-8715-473f-9db0-95248140c0f4] succeeded in 14.524020326999903s: None 2024-06-18T22:28:00.642966896Z [2024-06-18 22:28:00,642: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7d9794e8-8b4c-4adb-95d6-542064511190] received 2024-06-18T22:28:00.664258542Z [2024-06-18 22:28:00,663: INFO/ForkPoolWorker-15] [7d9794e8-8b4c-4adb-95d6-542064511190] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-18T22:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-18T22:28:00.931219198Z [2024-06-18 22:28:00,927: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-18T22:28:01.249702852Z [2024-06-18 22:28:01,249: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:28:01.846544531Z [2024-06-18 22:28:01,845: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7d9794e8-8b4c-4adb-95d6-542064511190] succeeded in 1.195068630000037s: None 2024-06-18T22:30:01.046104381Z [2024-06-18 22:30:01,040: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[90e0b348-5725-44c2-9824-45d863628ef6] received 2024-06-18T22:30:01.069058352Z [2024-06-18 22:30:01,068: INFO/ForkPoolWorker-15] [90e0b348-5725-44c2-9824-45d863628ef6] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-18T22:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-18T22:30:01.508610483Z [2024-06-18 22:30:01,502: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-18T22:30:01.939229784Z [2024-06-18 22:30:01,939: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:30:02.693090572Z [2024-06-18 22:30:02,692: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[90e0b348-5725-44c2-9824-45d863628ef6] succeeded in 1.6438094290000436s: None 2024-06-18T22:32:00.728039370Z [2024-06-18 22:32:00,721: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1cb7b3e1-b59b-4beb-80c4-9943e1d32f29] received 2024-06-18T22:32:00.744132536Z [2024-06-18 22:32:00,741: INFO/ForkPoolWorker-15] [1cb7b3e1-b59b-4beb-80c4-9943e1d32f29] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-18T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-18T22:32:01.095756739Z [2024-06-18 22:32:01,089: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-18T22:32:01.405756922Z [2024-06-18 22:32:01,405: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:32:01.884588508Z [2024-06-18 22:32:01,884: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1cb7b3e1-b59b-4beb-80c4-9943e1d32f29] succeeded in 1.1527972179999324s: None 2024-06-18T22:33:05.679281069Z [2024-06-18 22:33:05,678: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fadec1ca-601d-4b5d-a7a2-2c582bac826b] received 2024-06-18T22:33:05.693713365Z [2024-06-18 22:33:05,693: INFO/ForkPoolWorker-15] [fadec1ca-601d-4b5d-a7a2-2c582bac826b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-18T22:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-18T22:33:05.975518163Z [2024-06-18 22:33:05,971: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T22:33:07.286913351Z [2024-06-18 22:33:07,286: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T22:33:07.290533856Z [2024-06-18 22:33:07,290: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:33:07.320285901Z [2024-06-18 22:33:07,320: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T22:33:07.321801862Z [2024-06-18 22:33:07,321: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:33:07.321820559Z [2024-06-18 22:33:07,321: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:33:07.321893670Z [2024-06-18 22:33:07,321: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:33:07.321916458Z [2024-06-18 22:33:07,321: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T22:33:07.322198672Z [2024-06-18 22:33:07,322: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T22:33:07.322225703Z [2024-06-18 22:33:07,322: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:33:07.420632378Z [2024-06-18 22:33:07,420: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:33:08.090863708Z [2024-06-18 22:33:08,090: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fadec1ca-601d-4b5d-a7a2-2c582bac826b] succeeded in 2.406323702999998s: None 2024-06-18T22:33:08.143769789Z [2024-06-18 22:33:08,143: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7c53013e-471f-4793-a4d1-17e06763cea7] received 2024-06-18T22:33:08.167458562Z [2024-06-18 22:33:08,167: INFO/ForkPoolWorker-15] [7c53013e-471f-4793-a4d1-17e06763cea7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'split_metrics', 'scheduled__2024-06-18T22:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-18T22:33:08.445107858Z [2024-06-18 22:33:08,442: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T22:33:09.565499296Z [2024-06-18 22:33:09,565: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T22:33:09.569163291Z [2024-06-18 22:33:09,568: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:33:09.589842753Z [2024-06-18 22:33:09,589: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T22:33:09.591124443Z [2024-06-18 22:33:09,590: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:33:09.591136209Z [2024-06-18 22:33:09,591: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:33:09.591374952Z [2024-06-18 22:33:09,591: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:33:09.591396068Z [2024-06-18 22:33:09,591: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T22:33:09.591754113Z [2024-06-18 22:33:09,591: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T22:33:09.591896222Z [2024-06-18 22:33:09,591: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:33:09.690013316Z [2024-06-18 22:33:09,689: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:33:10.356206565Z [2024-06-18 22:33:10,355: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7c53013e-471f-4793-a4d1-17e06763cea7] succeeded in 2.207933077000007s: None 2024-06-18T22:33:10.723810010Z [2024-06-18 22:33:10,723: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fde35b41-60fd-47f0-a2e3-e93c689b7b9e] received 2024-06-18T22:33:10.740608308Z [2024-06-18 22:33:10,739: INFO/ForkPoolWorker-15] [fde35b41-60fd-47f0-a2e3-e93c689b7b9e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'collect_metrics', 'scheduled__2024-06-18T22:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-18T22:33:11.070307935Z [2024-06-18 22:33:11,066: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T22:33:12.276062587Z [2024-06-18 22:33:12,272: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T22:33:12.276889978Z [2024-06-18 22:33:12,276: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:33:12.298900533Z [2024-06-18 22:33:12,298: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T22:33:12.300326669Z [2024-06-18 22:33:12,300: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:33:12.300395442Z [2024-06-18 22:33:12,300: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:33:12.300636095Z [2024-06-18 22:33:12,300: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:33:12.300644236Z [2024-06-18 22:33:12,300: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T22:33:12.300878592Z [2024-06-18 22:33:12,300: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T22:33:12.300943075Z [2024-06-18 22:33:12,300: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:33:12.394879542Z [2024-06-18 22:33:12,394: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:33:12.983893427Z [2024-06-18 22:33:12,983: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fde35b41-60fd-47f0-a2e3-e93c689b7b9e] succeeded in 2.257664929000157s: None 2024-06-18T22:33:13.727745558Z [2024-06-18 22:33:13,726: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[078b788d-068b-4e23-853e-31c05b8ae45a] received 2024-06-18T22:33:13.738099693Z [2024-06-18 22:33:13,737: INFO/ForkPoolWorker-15] [078b788d-068b-4e23-853e-31c05b8ae45a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'send_prometheus', 'scheduled__2024-06-18T22:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-18T22:33:14.114723546Z [2024-06-18 22:33:14,106: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T22:33:14.782740462Z [2024-06-18 22:33:14,782: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[65f1af53-e164-42dd-923a-9af59ad6d212] received 2024-06-18T22:33:14.897673774Z [2024-06-18 22:33:14,897: INFO/ForkPoolWorker-16] [65f1af53-e164-42dd-923a-9af59ad6d212] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T22:33:15.319288180Z [2024-06-18 22:33:15,314: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T22:33:15.528024816Z [2024-06-18 22:33:15,527: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T22:33:15.531368966Z [2024-06-18 22:33:15,530: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:33:15.564512067Z [2024-06-18 22:33:15,564: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T22:33:15.566360999Z [2024-06-18 22:33:15,565: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:33:15.566374439Z [2024-06-18 22:33:15,565: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:33:15.566378425Z [2024-06-18 22:33:15,565: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:33:15.566382220Z [2024-06-18 22:33:15,565: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T22:33:15.566385228Z [2024-06-18 22:33:15,566: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T22:33:15.566388430Z [2024-06-18 22:33:15,566: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:33:15.648945228Z [2024-06-18 22:33:15,648: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:33:16.194933055Z [2024-06-18 22:33:16,194: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[211cc72b-78e5-479b-b3e8-48d5e6e9fef8] received 2024-06-18T22:33:16.280237032Z [2024-06-18 22:33:16,279: INFO/ForkPoolWorker-1] [211cc72b-78e5-479b-b3e8-48d5e6e9fef8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T22:33:16.293985301Z [2024-06-18 22:33:16,293: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[078b788d-068b-4e23-853e-31c05b8ae45a] succeeded in 2.565437647999943s: None 2024-06-18T22:33:16.557948536Z [2024-06-18 22:33:16,557: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-18T22:33:16.561126513Z [2024-06-18 22:33:16,560: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:33:16.585810227Z [2024-06-18 22:33:16,585: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T22:33:16.586939980Z [2024-06-18 22:33:16,586: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:33:16.587092222Z [2024-06-18 22:33:16,586: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:33:16.587256357Z [2024-06-18 22:33:16,587: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:33:16.587357024Z [2024-06-18 22:33:16,587: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-18T22:33:16.587625056Z [2024-06-18 22:33:16,587: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-18T22:33:16.587786280Z [2024-06-18 22:33:16,587: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:33:16.608236902Z [2024-06-18 22:33:16,604: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T22:33:16.675049750Z [2024-06-18 22:33:16,674: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:33:17.962411523Z [2024-06-18 22:33:17,962: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-18T22:33:17.965724571Z [2024-06-18 22:33:17,965: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:33:18.002567818Z [2024-06-18 22:33:18,002: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T22:33:18.004012401Z [2024-06-18 22:33:18,003: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:33:18.004034627Z [2024-06-18 22:33:18,003: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:33:18.004140979Z [2024-06-18 22:33:18,003: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:33:18.004181906Z [2024-06-18 22:33:18,004: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-18T22:33:18.004447397Z [2024-06-18 22:33:18,004: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T22:33:18.004458781Z [2024-06-18 22:33:18,004: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:33:18.129089226Z [2024-06-18 22:33:18,128: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:33:18.514471888Z [2024-06-18 22:33:18,514: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[65f1af53-e164-42dd-923a-9af59ad6d212] succeeded in 3.727313474000084s: None 2024-06-18T22:33:19.628608931Z [2024-06-18 22:33:19,628: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[211cc72b-78e5-479b-b3e8-48d5e6e9fef8] succeeded in 3.421719108000161s: None 2024-06-18T22:33:26.170530200Z [2024-06-18 22:33:26,170: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9d30fce0-6205-41d6-a618-12dbf4860bf5] received 2024-06-18T22:33:26.204629263Z [2024-06-18 22:33:26,204: INFO/ForkPoolWorker-15] [9d30fce0-6205-41d6-a618-12dbf4860bf5] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T22:33:26.625226963Z [2024-06-18 22:33:26,622: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T22:33:26.806094425Z [2024-06-18 22:33:26,805: INFO/ForkPoolWorker-15] Getting SDNC list 2024-06-18T22:33:26.810619425Z [2024-06-18 22:33:26,810: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:33:26.859283800Z [2024-06-18 22:33:26,859: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T22:33:26.860920481Z [2024-06-18 22:33:26,860: INFO/ForkPoolWorker-15] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T22:33:26.861365321Z [2024-06-18 22:33:26,860: INFO/ForkPoolWorker-15] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T22:33:26.861533454Z [2024-06-18 22:33:26,861: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-06-18T22:33:26.861827490Z [2024-06-18 22:33:26,861: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T22:33:26.995639932Z [2024-06-18 22:33:26,990: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:33:27.693319116Z [2024-06-18 22:33:27,692: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9d30fce0-6205-41d6-a618-12dbf4860bf5] succeeded in 1.5206369899999572s: None 2024-06-18T22:34:00.295509648Z [2024-06-18 22:34:00,294: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9a90c5ff-396a-41a2-96b9-e74af927e0a7] received 2024-06-18T22:34:00.297595411Z [2024-06-18 22:34:00,297: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dfab18ce-92ab-4754-843d-db05327a7cc6] received 2024-06-18T22:34:00.309943848Z [2024-06-18 22:34:00,309: INFO/ForkPoolWorker-16] [dfab18ce-92ab-4754-843d-db05327a7cc6] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T22:34:00.316415548Z [2024-06-18 22:34:00,316: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c250daf3-9185-4d8c-8fa4-1f87fbf87cb5] received 2024-06-18T22:34:00.320375861Z [2024-06-18 22:34:00,320: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e321ba38-0b78-49cb-aea1-79955da62703] received 2024-06-18T22:34:00.326926262Z [2024-06-18 22:34:00,324: INFO/ForkPoolWorker-15] [9a90c5ff-396a-41a2-96b9-e74af927e0a7] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-18T22:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-18T22:34:00.334763046Z [2024-06-18 22:34:00,334: INFO/ForkPoolWorker-1] [c250daf3-9185-4d8c-8fa4-1f87fbf87cb5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T22:34:00.418583041Z [2024-06-18 22:34:00,418: INFO/ForkPoolWorker-2] [e321ba38-0b78-49cb-aea1-79955da62703] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T22:34:00.806176023Z [2024-06-18 22:34:00,801: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T22:34:00.849765005Z [2024-06-18 22:34:00,846: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-18T22:34:00.885911610Z [2024-06-18 22:34:00,880: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T22:34:00.896552195Z [2024-06-18 22:34:00,892: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T22:34:01.141884376Z [2024-06-18 22:34:01,141: INFO/ForkPoolWorker-16] Getting SDNC list 2024-06-18T22:34:01.146272824Z [2024-06-18 22:34:01,145: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:34:01.192295668Z [2024-06-18 22:34:01,192: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T22:34:01.195392456Z [2024-06-18 22:34:01,195: INFO/ForkPoolWorker-16] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T22:34:01.195476187Z [2024-06-18 22:34:01,195: INFO/ForkPoolWorker-16] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T22:34:01.195555560Z [2024-06-18 22:34:01,195: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-06-18T22:34:01.195839321Z [2024-06-18 22:34:01,195: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T22:34:01.211106401Z [2024-06-18 22:34:01,210: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:34:01.330904284Z [2024-06-18 22:34:01,330: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:34:02.153368210Z [2024-06-18 22:34:02,152: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9a90c5ff-396a-41a2-96b9-e74af927e0a7] succeeded in 1.8534122979999665s: None 2024-06-18T22:34:02.350118559Z [2024-06-18 22:34:02,349: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[dfab18ce-92ab-4754-843d-db05327a7cc6] succeeded in 2.0505980430000363s: None 2024-06-18T22:34:02.630763053Z [2024-06-18 22:34:02,630: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-18T22:34:02.634692068Z [2024-06-18 22:34:02,634: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:34:02.673599489Z [2024-06-18 22:34:02,673: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T22:34:02.677083479Z [2024-06-18 22:34:02,676: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:34:02.677101504Z [2024-06-18 22:34:02,676: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:34:02.677106637Z [2024-06-18 22:34:02,676: INFO/ForkPoolWorker-1] Read VIM 712133a2-a543-492e-a0cc-5f911b803020 (basic01_630607) 2024-06-18T22:34:02.677120546Z [2024-06-18 22:34:02,676: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '712133a2-a543-492e-a0cc-5f911b803020', 'name': 'basic01_630607', 'vim_type': 'openstack'}] 2024-06-18T22:34:02.677125717Z [2024-06-18 22:34:02,676: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-18T22:34:02.677187734Z [2024-06-18 22:34:02,677: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T22:34:02.677343405Z [2024-06-18 22:34:02,677: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:34:02.683368457Z [2024-06-18 22:34:02,683: INFO/ForkPoolWorker-1] Creating DAG vim_status_712133a2-a543-492e-a0cc-5f911b803020 2024-06-18T22:34:02.773895959Z [2024-06-18 22:34:02,773: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:34:02.816116857Z [2024-06-18 22:34:02,815: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-18T22:34:02.819267075Z [2024-06-18 22:34:02,818: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:34:02.854349336Z [2024-06-18 22:34:02,854: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-18T22:34:02.856119952Z [2024-06-18 22:34:02,855: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:34:02.856310380Z [2024-06-18 22:34:02,856: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:34:02.856476195Z [2024-06-18 22:34:02,856: INFO/ForkPoolWorker-2] Read VIM 712133a2-a543-492e-a0cc-5f911b803020 (basic01_630607) 2024-06-18T22:34:02.856792445Z [2024-06-18 22:34:02,856: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '712133a2-a543-492e-a0cc-5f911b803020', 'name': 'basic01_630607', 'vim_type': 'openstack'}] 2024-06-18T22:34:02.857206795Z [2024-06-18 22:34:02,856: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-18T22:34:02.857869390Z [2024-06-18 22:34:02,857: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-06-18T22:34:02.858194812Z [2024-06-18 22:34:02,857: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:34:02.864881195Z [2024-06-18 22:34:02,864: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_712133a2-a543-492e-a0cc-5f911b803020 2024-06-18T22:34:02.968904675Z [2024-06-18 22:34:02,968: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:34:04.234750762Z [2024-06-18 22:34:04,234: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c250daf3-9185-4d8c-8fa4-1f87fbf87cb5] succeeded in 3.9146550190000653s: None 2024-06-18T22:34:05.024774475Z [2024-06-18 22:34:05,024: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[e321ba38-0b78-49cb-aea1-79955da62703] succeeded in 4.691498346999879s: None 2024-06-18T22:34:10.235732805Z [2024-06-18 22:34:10,235: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[74fc12f0-a713-4e0b-89f2-ede32be605fb] received 2024-06-18T22:34:10.250760079Z [2024-06-18 22:34:10,250: INFO/ForkPoolWorker-15] [74fc12f0-a713-4e0b-89f2-ede32be605fb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_712133a2-a543-492e-a0cc-5f911b803020', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-18T22:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-18T22:34:10.572563705Z [2024-06-18 22:34:10,569: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T22:34:11.674328929Z [2024-06-18 22:34:11,673: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T22:34:11.677764006Z [2024-06-18 22:34:11,677: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:34:11.697236388Z [2024-06-18 22:34:11,697: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T22:34:11.698549766Z [2024-06-18 22:34:11,698: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:34:11.698604117Z [2024-06-18 22:34:11,698: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:34:11.698672809Z [2024-06-18 22:34:11,698: INFO/ForkPoolWorker-15] Read VIM 712133a2-a543-492e-a0cc-5f911b803020 (basic01_630607) 2024-06-18T22:34:11.698863704Z [2024-06-18 22:34:11,698: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '712133a2-a543-492e-a0cc-5f911b803020', 'name': 'basic01_630607', 'vim_type': 'openstack'}] 2024-06-18T22:34:11.698971681Z [2024-06-18 22:34:11,698: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T22:34:11.699245414Z [2024-06-18 22:34:11,699: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T22:34:11.699320587Z [2024-06-18 22:34:11,699: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:34:11.705282307Z [2024-06-18 22:34:11,705: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_712133a2-a543-492e-a0cc-5f911b803020 2024-06-18T22:34:11.799585835Z [2024-06-18 22:34:11,799: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:34:12.529810663Z [2024-06-18 22:34:12,529: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[74fc12f0-a713-4e0b-89f2-ede32be605fb] succeeded in 2.288798191000069s: None 2024-06-18T22:34:13.040354011Z [2024-06-18 22:34:13,039: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[acaf8519-43c7-4c44-a1c3-9de6f24ef3cd] received 2024-06-18T22:34:13.055340202Z [2024-06-18 22:34:13,054: INFO/ForkPoolWorker-15] [acaf8519-43c7-4c44-a1c3-9de6f24ef3cd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_712133a2-a543-492e-a0cc-5f911b803020', 'split_metrics', 'scheduled__2024-06-18T22:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-18T22:34:13.391230365Z [2024-06-18 22:34:13,388: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T22:34:14.569162707Z [2024-06-18 22:34:14,568: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T22:34:14.572716973Z [2024-06-18 22:34:14,572: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:34:14.594834079Z [2024-06-18 22:34:14,594: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T22:34:14.596074241Z [2024-06-18 22:34:14,595: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:34:14.596090258Z [2024-06-18 22:34:14,596: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:34:14.596260504Z [2024-06-18 22:34:14,596: INFO/ForkPoolWorker-15] Read VIM 712133a2-a543-492e-a0cc-5f911b803020 (basic01_630607) 2024-06-18T22:34:14.596386225Z [2024-06-18 22:34:14,596: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '712133a2-a543-492e-a0cc-5f911b803020', 'name': 'basic01_630607', 'vim_type': 'openstack'}] 2024-06-18T22:34:14.596434911Z [2024-06-18 22:34:14,596: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T22:34:14.596649511Z [2024-06-18 22:34:14,596: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T22:34:14.596695716Z [2024-06-18 22:34:14,596: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:34:14.603415277Z [2024-06-18 22:34:14,603: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_712133a2-a543-492e-a0cc-5f911b803020 2024-06-18T22:34:14.691856918Z [2024-06-18 22:34:14,691: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:34:15.299432883Z [2024-06-18 22:34:15,298: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[acaf8519-43c7-4c44-a1c3-9de6f24ef3cd] succeeded in 2.253607233999901s: None 2024-06-18T22:34:15.673862856Z [2024-06-18 22:34:15,673: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5a673702-8570-4d5f-a2ee-8cd2f1a5b3d9] received 2024-06-18T22:34:15.687817535Z [2024-06-18 22:34:15,686: INFO/ForkPoolWorker-15] [5a673702-8570-4d5f-a2ee-8cd2f1a5b3d9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_712133a2-a543-492e-a0cc-5f911b803020', 'collect_metrics', 'scheduled__2024-06-18T22:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-18T22:34:16.030524534Z [2024-06-18 22:34:16,027: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T22:34:17.315003546Z [2024-06-18 22:34:17,314: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T22:34:17.318765727Z [2024-06-18 22:34:17,318: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:34:17.344463887Z [2024-06-18 22:34:17,344: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T22:34:17.345980539Z [2024-06-18 22:34:17,345: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:34:17.346306904Z [2024-06-18 22:34:17,345: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:34:17.346520265Z [2024-06-18 22:34:17,346: INFO/ForkPoolWorker-15] Read VIM 712133a2-a543-492e-a0cc-5f911b803020 (basic01_630607) 2024-06-18T22:34:17.346813380Z [2024-06-18 22:34:17,346: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '712133a2-a543-492e-a0cc-5f911b803020', 'name': 'basic01_630607', 'vim_type': 'openstack'}] 2024-06-18T22:34:17.347019045Z [2024-06-18 22:34:17,346: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T22:34:17.347572412Z [2024-06-18 22:34:17,347: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T22:34:17.347801140Z [2024-06-18 22:34:17,347: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:34:17.354376315Z [2024-06-18 22:34:17,354: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_712133a2-a543-492e-a0cc-5f911b803020 2024-06-18T22:34:17.439491101Z [2024-06-18 22:34:17,438: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:34:18.102890408Z [2024-06-18 22:34:18,102: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5a673702-8570-4d5f-a2ee-8cd2f1a5b3d9] succeeded in 2.4243159130001004s: None 2024-06-18T22:34:18.312400753Z [2024-06-18 22:34:18,312: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2d81e3e8-aacd-4456-8c03-aa88a3fcea55] received 2024-06-18T22:34:18.320597628Z [2024-06-18 22:34:18,320: INFO/ForkPoolWorker-15] [2d81e3e8-aacd-4456-8c03-aa88a3fcea55] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_712133a2-a543-492e-a0cc-5f911b803020', 'send_prometheus', 'scheduled__2024-06-18T22:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-18T22:34:18.634468726Z [2024-06-18 22:34:18,631: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T22:34:19.632902002Z [2024-06-18 22:34:19,632: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cc34904f-fe16-4495-a2d5-67f0ec4a7a93] received 2024-06-18T22:34:19.646765128Z [2024-06-18 22:34:19,646: INFO/ForkPoolWorker-16] [cc34904f-fe16-4495-a2d5-67f0ec4a7a93] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_712133a2-a543-492e-a0cc-5f911b803020', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T22:34:19.657222361Z [2024-06-18 22:34:19,657: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a5af3f45-7b02-4519-8553-6a773236dada] received 2024-06-18T22:34:19.667512516Z [2024-06-18 22:34:19,666: INFO/ForkPoolWorker-1] [a5af3f45-7b02-4519-8553-6a773236dada] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_712133a2-a543-492e-a0cc-5f911b803020', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T22:34:19.824515915Z [2024-06-18 22:34:19,824: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T22:34:19.828000988Z [2024-06-18 22:34:19,827: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:34:19.851342566Z [2024-06-18 22:34:19,851: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T22:34:19.854163352Z [2024-06-18 22:34:19,853: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:34:19.854388774Z [2024-06-18 22:34:19,854: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:34:19.854668180Z [2024-06-18 22:34:19,854: INFO/ForkPoolWorker-15] Read VIM 712133a2-a543-492e-a0cc-5f911b803020 (basic01_630607) 2024-06-18T22:34:19.854923403Z [2024-06-18 22:34:19,854: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '712133a2-a543-492e-a0cc-5f911b803020', 'name': 'basic01_630607', 'vim_type': 'openstack'}] 2024-06-18T22:34:19.855095318Z [2024-06-18 22:34:19,854: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T22:34:19.855466396Z [2024-06-18 22:34:19,855: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T22:34:19.855844740Z [2024-06-18 22:34:19,855: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:34:19.866686117Z [2024-06-18 22:34:19,866: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_712133a2-a543-492e-a0cc-5f911b803020 2024-06-18T22:34:19.989970409Z [2024-06-18 22:34:19,986: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T22:34:20.058922705Z [2024-06-18 22:34:20,058: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:34:20.125145592Z [2024-06-18 22:34:20,120: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T22:34:20.712286732Z [2024-06-18 22:34:20,710: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2d81e3e8-aacd-4456-8c03-aa88a3fcea55] succeeded in 2.3960864890000266s: None 2024-06-18T22:34:21.412473147Z [2024-06-18 22:34:21,411: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-18T22:34:21.421371883Z [2024-06-18 22:34:21,420: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:34:21.424683184Z [2024-06-18 22:34:21,423: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-18T22:34:21.429453588Z [2024-06-18 22:34:21,429: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:34:21.449214415Z [2024-06-18 22:34:21,449: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T22:34:21.450462403Z [2024-06-18 22:34:21,450: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:34:21.450615955Z [2024-06-18 22:34:21,450: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:34:21.450789823Z [2024-06-18 22:34:21,450: INFO/ForkPoolWorker-1] Read VIM 712133a2-a543-492e-a0cc-5f911b803020 (basic01_630607) 2024-06-18T22:34:21.450964389Z [2024-06-18 22:34:21,450: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '712133a2-a543-492e-a0cc-5f911b803020', 'name': 'basic01_630607', 'vim_type': 'openstack'}] 2024-06-18T22:34:21.451110439Z [2024-06-18 22:34:21,450: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-18T22:34:21.451601011Z [2024-06-18 22:34:21,451: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T22:34:21.451797308Z [2024-06-18 22:34:21,451: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:34:21.458493381Z [2024-06-18 22:34:21,458: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T22:34:21.459770073Z [2024-06-18 22:34:21,459: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:34:21.460205402Z [2024-06-18 22:34:21,459: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:34:21.460428188Z [2024-06-18 22:34:21,460: INFO/ForkPoolWorker-16] Read VIM 712133a2-a543-492e-a0cc-5f911b803020 (basic01_630607) 2024-06-18T22:34:21.460667244Z [2024-06-18 22:34:21,460: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '712133a2-a543-492e-a0cc-5f911b803020', 'name': 'basic01_630607', 'vim_type': 'openstack'}] 2024-06-18T22:34:21.460801547Z [2024-06-18 22:34:21,460: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-18T22:34:21.461280830Z [2024-06-18 22:34:21,461: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-18T22:34:21.461440745Z [2024-06-18 22:34:21,461: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:34:21.465818538Z [2024-06-18 22:34:21,465: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_712133a2-a543-492e-a0cc-5f911b803020 2024-06-18T22:34:21.469572696Z [2024-06-18 22:34:21,469: INFO/ForkPoolWorker-1] Creating DAG vim_status_712133a2-a543-492e-a0cc-5f911b803020 2024-06-18T22:34:21.556763970Z [2024-06-18 22:34:21,555: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:34:21.570865201Z [2024-06-18 22:34:21,570: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:34:23.151037974Z [2024-06-18 22:34:23,150: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a5af3f45-7b02-4519-8553-6a773236dada] succeeded in 3.4905908929999896s: None 2024-06-18T22:34:23.502744776Z [2024-06-18 22:34:23,502: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[cc34904f-fe16-4495-a2d5-67f0ec4a7a93] succeeded in 3.862652270000126s: None 2024-06-18T22:35:00.583196775Z [2024-06-18 22:35:00,582: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[330bff67-8ab3-4075-8d16-e5035df68721] received 2024-06-18T22:35:00.584760584Z [2024-06-18 22:35:00,584: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4eeb8f62-5934-4f8c-b20a-a2bbcb8b4ca1] received 2024-06-18T22:35:00.588230591Z [2024-06-18 22:35:00,588: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c6aa501e-c513-45b1-8e2e-9b07911cb9d5] received 2024-06-18T22:35:00.598058061Z [2024-06-18 22:35:00,597: INFO/ForkPoolWorker-16] [4eeb8f62-5934-4f8c-b20a-a2bbcb8b4ca1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_712133a2-a543-492e-a0cc-5f911b803020', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-18T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-18T22:35:00.599382709Z [2024-06-18 22:35:00,599: INFO/ForkPoolWorker-15] [330bff67-8ab3-4075-8d16-e5035df68721] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-18T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-18T22:35:00.601350830Z [2024-06-18 22:35:00,601: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7f9d19e2-f87c-4b84-b8bd-33fd5be0bb83] received 2024-06-18T22:35:00.607724466Z [2024-06-18 22:35:00,607: INFO/ForkPoolWorker-1] [c6aa501e-c513-45b1-8e2e-9b07911cb9d5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_712133a2-a543-492e-a0cc-5f911b803020', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T22:35:00.610759994Z [2024-06-18 22:35:00,610: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fa90c5c2-d785-4d0e-9e72-cd36947bbc8a] received 2024-06-18T22:35:00.614111612Z [2024-06-18 22:35:00,613: INFO/ForkPoolWorker-2] [7f9d19e2-f87c-4b84-b8bd-33fd5be0bb83] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_712133a2-a543-492e-a0cc-5f911b803020', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T22:35:00.623083446Z [2024-06-18 22:35:00,622: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[14035d6d-bec8-4d6b-80fd-8125f91c1228] received 2024-06-18T22:35:00.629862646Z [2024-06-18 22:35:00,629: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c2d6b90f-c772-402c-b70b-09bde34c89ef] received 2024-06-18T22:35:00.688279716Z [2024-06-18 22:35:00,687: INFO/ForkPoolWorker-3] [fa90c5c2-d785-4d0e-9e72-cd36947bbc8a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T22:35:00.698606387Z [2024-06-18 22:35:00,695: INFO/ForkPoolWorker-4] [14035d6d-bec8-4d6b-80fd-8125f91c1228] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T22:35:00.729947314Z [2024-06-18 22:35:00,729: INFO/ForkPoolWorker-5] [c2d6b90f-c772-402c-b70b-09bde34c89ef] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T22:35:01.028197780Z [2024-06-18 22:35:01,024: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T22:35:01.057910213Z [2024-06-18 22:35:01,053: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T22:35:01.104752616Z [2024-06-18 22:35:01,101: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T22:35:01.575472994Z [2024-06-18 22:35:01,571: INFO/ForkPoolWorker-5] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T22:35:01.673214294Z [2024-06-18 22:35:01,657: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T22:35:01.750324749Z [2024-06-18 22:35:01,745: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T22:35:01.831220509Z [2024-06-18 22:35:01,815: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T22:35:02.074610041Z [2024-06-18 22:35:02,074: INFO/ForkPoolWorker-3] Getting SDNC list 2024-06-18T22:35:02.084774665Z [2024-06-18 22:35:02,084: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:35:02.172694241Z [2024-06-18 22:35:02,172: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-06-18T22:35:02.177058603Z [2024-06-18 22:35:02,176: INFO/ForkPoolWorker-3] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T22:35:02.177356325Z [2024-06-18 22:35:02,177: INFO/ForkPoolWorker-3] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T22:35:02.177490852Z [2024-06-18 22:35:02,177: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-06-18T22:35:02.177916266Z [2024-06-18 22:35:02,177: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T22:35:02.434393941Z [2024-06-18 22:35:02,434: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:35:02.830508497Z [2024-06-18 22:35:02,830: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T22:35:02.834211474Z [2024-06-18 22:35:02,833: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:35:02.864956288Z [2024-06-18 22:35:02,864: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T22:35:02.868533672Z [2024-06-18 22:35:02,868: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:35:02.868557412Z [2024-06-18 22:35:02,868: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:35:02.868630923Z [2024-06-18 22:35:02,868: INFO/ForkPoolWorker-15] Read VIM a6a346d3-03c7-47e5-beb3-ecad663a7f17 (basic01_592024) 2024-06-18T22:35:02.868790822Z [2024-06-18 22:35:02,868: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'a6a346d3-03c7-47e5-beb3-ecad663a7f17', 'name': 'basic01_592024', 'vim_type': 'openstack'}] 2024-06-18T22:35:02.868814584Z [2024-06-18 22:35:02,868: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T22:35:02.869265122Z [2024-06-18 22:35:02,869: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T22:35:02.869292551Z [2024-06-18 22:35:02,869: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:35:02.875215641Z [2024-06-18 22:35:02,874: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_a6a346d3-03c7-47e5-beb3-ecad663a7f17 2024-06-18T22:35:03.033555661Z [2024-06-18 22:35:03,033: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:35:03.164272804Z [2024-06-18 22:35:03,163: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-18T22:35:03.170058929Z [2024-06-18 22:35:03,169: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:35:03.224629536Z [2024-06-18 22:35:03,224: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-18T22:35:03.230184178Z [2024-06-18 22:35:03,229: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:35:03.230360337Z [2024-06-18 22:35:03,230: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:35:03.230495491Z [2024-06-18 22:35:03,230: INFO/ForkPoolWorker-2] Read VIM a6a346d3-03c7-47e5-beb3-ecad663a7f17 (basic01_592024) 2024-06-18T22:35:03.230759728Z [2024-06-18 22:35:03,230: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'a6a346d3-03c7-47e5-beb3-ecad663a7f17', 'name': 'basic01_592024', 'vim_type': 'openstack'}] 2024-06-18T22:35:03.230886648Z [2024-06-18 22:35:03,230: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-18T22:35:03.231200568Z [2024-06-18 22:35:03,231: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-06-18T22:35:03.231745140Z [2024-06-18 22:35:03,231: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:35:03.238507259Z [2024-06-18 22:35:03,238: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_a6a346d3-03c7-47e5-beb3-ecad663a7f17 2024-06-18T22:35:03.243137735Z [2024-06-18 22:35:03,242: WARNING/ForkPoolWorker-2] Dag 'vm_status_vim_712133a2-a543-492e-a0cc-5f911b803020' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T22:35:03.248720085Z [2024-06-18 22:35:03,248: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T22:35:03.249738524Z [2024-06-18 22:35:03,249: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-18T22:35:03.259320936Z [2024-06-18 22:35:03,258: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:35:03.278248924Z [2024-06-18 22:35:03,277: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[fa90c5c2-d785-4d0e-9e72-cd36947bbc8a] succeeded in 2.662938784999824s: None 2024-06-18T22:35:03.333523694Z [2024-06-18 22:35:03,333: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-18T22:35:03.337566064Z [2024-06-18 22:35:03,337: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:35:03.337652665Z [2024-06-18 22:35:03,337: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:35:03.337735540Z [2024-06-18 22:35:03,337: INFO/ForkPoolWorker-2] Read VIM a6a346d3-03c7-47e5-beb3-ecad663a7f17 (basic01_592024) 2024-06-18T22:35:03.337947083Z [2024-06-18 22:35:03,337: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'a6a346d3-03c7-47e5-beb3-ecad663a7f17', 'name': 'basic01_592024', 'vim_type': 'openstack'}] 2024-06-18T22:35:03.337985465Z [2024-06-18 22:35:03,337: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-18T22:35:03.338309526Z [2024-06-18 22:35:03,338: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-06-18T22:35:03.338373206Z [2024-06-18 22:35:03,338: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:35:03.340605564Z [2024-06-18 22:35:03,340: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_a6a346d3-03c7-47e5-beb3-ecad663a7f17 2024-06-18T22:35:03.344833042Z [2024-06-18 22:35:03,344: ERROR/ForkPoolWorker-2] [7f9d19e2-f87c-4b84-b8bd-33fd5be0bb83] Failed to execute task Dag 'vm_status_vim_712133a2-a543-492e-a0cc-5f911b803020' could not be found; either it does not exist or it failed to parse.. 2024-06-18T22:35:03.344858488Z Traceback (most recent call last): 2024-06-18T22:35:03.344863215Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-06-18T22:35:03.344867146Z args.func(args) 2024-06-18T22:35:03.344871293Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-06-18T22:35:03.344875680Z return func(*args, **kwargs) 2024-06-18T22:35:03.344879457Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-06-18T22:35:03.344882935Z return f(*args, **kwargs) 2024-06-18T22:35:03.344886457Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-06-18T22:35:03.344890748Z dag = get_dag(args.subdir, args.dag_id) 2024-06-18T22:35:03.344894259Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-06-18T22:35:03.344897801Z raise AirflowException( 2024-06-18T22:35:03.344902774Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_712133a2-a543-492e-a0cc-5f911b803020' could not be found; either it does not exist or it failed to parse. 2024-06-18T22:35:03.414380034Z [2024-06-18 22:35:03,413: ERROR/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[7f9d19e2-f87c-4b84-b8bd-33fd5be0bb83] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 7f9d19e2-f87c-4b84-b8bd-33fd5be0bb83') 2024-06-18T22:35:03.414404251Z Traceback (most recent call last): 2024-06-18T22:35:03.414408167Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-06-18T22:35:03.414411394Z R = retval = fun(*args, **kwargs) 2024-06-18T22:35:03.414414489Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-06-18T22:35:03.414417440Z return self.run(*args, **kwargs) 2024-06-18T22:35:03.414421187Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-06-18T22:35:03.414425057Z _execute_in_fork(command_to_exec, celery_task_id) 2024-06-18T22:35:03.414442163Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-06-18T22:35:03.414446276Z raise AirflowException(msg) 2024-06-18T22:35:03.414452929Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 7f9d19e2-f87c-4b84-b8bd-33fd5be0bb83 2024-06-18T22:35:03.661410772Z [2024-06-18 22:35:03,661: INFO/ForkPoolWorker-5] Getting VIM list 2024-06-18T22:35:03.665734746Z [2024-06-18 22:35:03,665: INFO/ForkPoolWorker-5] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:35:03.671517221Z [2024-06-18 22:35:03,671: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-18T22:35:03.674696161Z [2024-06-18 22:35:03,674: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:35:03.696177070Z [2024-06-18 22:35:03,695: INFO/ForkPoolWorker-5] Connected to database osm version 1.2 2024-06-18T22:35:03.698415872Z [2024-06-18 22:35:03,698: INFO/ForkPoolWorker-5] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:35:03.698569759Z [2024-06-18 22:35:03,698: INFO/ForkPoolWorker-5] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:35:03.698709481Z [2024-06-18 22:35:03,698: INFO/ForkPoolWorker-5] Read VIM a6a346d3-03c7-47e5-beb3-ecad663a7f17 (basic01_592024) 2024-06-18T22:35:03.698899692Z [2024-06-18 22:35:03,698: INFO/ForkPoolWorker-5] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'a6a346d3-03c7-47e5-beb3-ecad663a7f17', 'name': 'basic01_592024', 'vim_type': 'openstack'}] 2024-06-18T22:35:03.699018530Z [2024-06-18 22:35:03,698: INFO/ForkPoolWorker-5] Getting VIM list OK 2024-06-18T22:35:03.699321339Z [2024-06-18 22:35:03,699: INFO/ForkPoolWorker-5] VIM type 'dummy' not supported for collecting VM status 2024-06-18T22:35:03.699450938Z [2024-06-18 22:35:03,699: INFO/ForkPoolWorker-5] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:35:03.703085862Z [2024-06-18 22:35:03,702: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T22:35:03.704545756Z [2024-06-18 22:35:03,704: INFO/ForkPoolWorker-5] Creating DAG vm_status_vim_a6a346d3-03c7-47e5-beb3-ecad663a7f17 2024-06-18T22:35:03.704809230Z [2024-06-18 22:35:03,704: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:35:03.705005088Z [2024-06-18 22:35:03,704: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:35:03.705106298Z [2024-06-18 22:35:03,704: INFO/ForkPoolWorker-1] Read VIM a6a346d3-03c7-47e5-beb3-ecad663a7f17 (basic01_592024) 2024-06-18T22:35:03.705266052Z [2024-06-18 22:35:03,705: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'a6a346d3-03c7-47e5-beb3-ecad663a7f17', 'name': 'basic01_592024', 'vim_type': 'openstack'}] 2024-06-18T22:35:03.705302905Z [2024-06-18 22:35:03,705: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-18T22:35:03.705549040Z [2024-06-18 22:35:03,705: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T22:35:03.705582913Z [2024-06-18 22:35:03,705: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:35:03.709878480Z [2024-06-18 22:35:03,709: INFO/ForkPoolWorker-1] Creating DAG vim_status_a6a346d3-03c7-47e5-beb3-ecad663a7f17 2024-06-18T22:35:03.721566167Z [2024-06-18 22:35:03,721: WARNING/ForkPoolWorker-1] Dag 'vim_status_712133a2-a543-492e-a0cc-5f911b803020' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T22:35:03.733002947Z [2024-06-18 22:35:03,732: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T22:35:03.736839595Z [2024-06-18 22:35:03,736: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-18T22:35:03.739573820Z [2024-06-18 22:35:03,739: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:35:03.773622327Z [2024-06-18 22:35:03,773: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T22:35:03.774888529Z [2024-06-18 22:35:03,774: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:35:03.775008753Z [2024-06-18 22:35:03,774: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:35:03.775088583Z [2024-06-18 22:35:03,775: INFO/ForkPoolWorker-1] Read VIM a6a346d3-03c7-47e5-beb3-ecad663a7f17 (basic01_592024) 2024-06-18T22:35:03.775243209Z [2024-06-18 22:35:03,775: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'a6a346d3-03c7-47e5-beb3-ecad663a7f17', 'name': 'basic01_592024', 'vim_type': 'openstack'}] 2024-06-18T22:35:03.775367520Z [2024-06-18 22:35:03,775: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-18T22:35:03.775650761Z [2024-06-18 22:35:03,775: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T22:35:03.775787171Z [2024-06-18 22:35:03,775: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:35:03.778010807Z [2024-06-18 22:35:03,777: INFO/ForkPoolWorker-1] Creating DAG vim_status_a6a346d3-03c7-47e5-beb3-ecad663a7f17 2024-06-18T22:35:03.785077148Z [2024-06-18 22:35:03,781: ERROR/ForkPoolWorker-1] [c6aa501e-c513-45b1-8e2e-9b07911cb9d5] Failed to execute task Dag 'vim_status_712133a2-a543-492e-a0cc-5f911b803020' could not be found; either it does not exist or it failed to parse.. 2024-06-18T22:35:03.785091655Z Traceback (most recent call last): 2024-06-18T22:35:03.785096138Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-06-18T22:35:03.785100117Z args.func(args) 2024-06-18T22:35:03.785103574Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-06-18T22:35:03.785107878Z return func(*args, **kwargs) 2024-06-18T22:35:03.785111166Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-06-18T22:35:03.785114554Z return f(*args, **kwargs) 2024-06-18T22:35:03.785117851Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-06-18T22:35:03.785120952Z dag = get_dag(args.subdir, args.dag_id) 2024-06-18T22:35:03.785136385Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-06-18T22:35:03.785139420Z raise AirflowException( 2024-06-18T22:35:03.785143052Z airflow.exceptions.AirflowException: Dag 'vim_status_712133a2-a543-492e-a0cc-5f911b803020' could not be found; either it does not exist or it failed to parse. 2024-06-18T22:35:03.814705957Z [2024-06-18 22:35:03,814: INFO/ForkPoolWorker-5] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:35:03.826652097Z [2024-06-18 22:35:03,820: ERROR/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c6aa501e-c513-45b1-8e2e-9b07911cb9d5] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id c6aa501e-c513-45b1-8e2e-9b07911cb9d5') 2024-06-18T22:35:03.826678770Z Traceback (most recent call last): 2024-06-18T22:35:03.826683544Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-06-18T22:35:03.826687250Z R = retval = fun(*args, **kwargs) 2024-06-18T22:35:03.826690879Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-06-18T22:35:03.826694667Z return self.run(*args, **kwargs) 2024-06-18T22:35:03.826698701Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-06-18T22:35:03.826702752Z _execute_in_fork(command_to_exec, celery_task_id) 2024-06-18T22:35:03.826706121Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-06-18T22:35:03.826709981Z raise AirflowException(msg) 2024-06-18T22:35:03.826714012Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id c6aa501e-c513-45b1-8e2e-9b07911cb9d5 2024-06-18T22:35:03.836646599Z [2024-06-18 22:35:03,836: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[330bff67-8ab3-4075-8d16-e5035df68721] succeeded in 3.2505216979998295s: None 2024-06-18T22:35:04.023650447Z [2024-06-18 22:35:04,023: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-18T22:35:04.027059322Z [2024-06-18 22:35:04,026: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:35:04.054796016Z [2024-06-18 22:35:04,054: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T22:35:04.056287038Z [2024-06-18 22:35:04,056: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:35:04.056348879Z [2024-06-18 22:35:04,056: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:35:04.057006030Z [2024-06-18 22:35:04,056: INFO/ForkPoolWorker-16] Read VIM a6a346d3-03c7-47e5-beb3-ecad663a7f17 (basic01_592024) 2024-06-18T22:35:04.057169852Z [2024-06-18 22:35:04,056: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'a6a346d3-03c7-47e5-beb3-ecad663a7f17', 'name': 'basic01_592024', 'vim_type': 'openstack'}] 2024-06-18T22:35:04.057302650Z [2024-06-18 22:35:04,057: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-18T22:35:04.060103984Z [2024-06-18 22:35:04,059: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T22:35:04.060774082Z [2024-06-18 22:35:04,060: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:35:04.067385374Z [2024-06-18 22:35:04,067: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_a6a346d3-03c7-47e5-beb3-ecad663a7f17 2024-06-18T22:35:04.071566035Z [2024-06-18 22:35:04,071: WARNING/ForkPoolWorker-16] Dag 'vm_metrics_vim_712133a2-a543-492e-a0cc-5f911b803020' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T22:35:04.072347205Z [2024-06-18 22:35:04,071: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T22:35:04.073320178Z [2024-06-18 22:35:04,073: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-18T22:35:04.076103490Z [2024-06-18 22:35:04,075: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:35:04.092390480Z [2024-06-18 22:35:04,092: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T22:35:04.094517957Z [2024-06-18 22:35:04,094: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:35:04.094598566Z [2024-06-18 22:35:04,094: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:35:04.094606133Z [2024-06-18 22:35:04,094: INFO/ForkPoolWorker-16] Read VIM a6a346d3-03c7-47e5-beb3-ecad663a7f17 (basic01_592024) 2024-06-18T22:35:04.095105197Z [2024-06-18 22:35:04,094: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'a6a346d3-03c7-47e5-beb3-ecad663a7f17', 'name': 'basic01_592024', 'vim_type': 'openstack'}] 2024-06-18T22:35:04.095118098Z [2024-06-18 22:35:04,094: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-18T22:35:04.095582306Z [2024-06-18 22:35:04,095: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T22:35:04.095632133Z [2024-06-18 22:35:04,095: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:35:04.099107799Z [2024-06-18 22:35:04,098: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_a6a346d3-03c7-47e5-beb3-ecad663a7f17 2024-06-18T22:35:04.103760473Z [2024-06-18 22:35:04,102: ERROR/ForkPoolWorker-16] [4eeb8f62-5934-4f8c-b20a-a2bbcb8b4ca1] Failed to execute task Dag 'vm_metrics_vim_712133a2-a543-492e-a0cc-5f911b803020' could not be found; either it does not exist or it failed to parse.. 2024-06-18T22:35:04.103785076Z Traceback (most recent call last): 2024-06-18T22:35:04.103789549Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-06-18T22:35:04.103793160Z args.func(args) 2024-06-18T22:35:04.103796910Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-06-18T22:35:04.103800885Z return func(*args, **kwargs) 2024-06-18T22:35:04.103803857Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-06-18T22:35:04.103806801Z return f(*args, **kwargs) 2024-06-18T22:35:04.103809743Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-06-18T22:35:04.103823844Z dag = get_dag(args.subdir, args.dag_id) 2024-06-18T22:35:04.103827054Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-06-18T22:35:04.103829887Z raise AirflowException( 2024-06-18T22:35:04.103833716Z airflow.exceptions.AirflowException: Dag 'vm_metrics_vim_712133a2-a543-492e-a0cc-5f911b803020' could not be found; either it does not exist or it failed to parse. 2024-06-18T22:35:04.160242065Z [2024-06-18 22:35:04,158: INFO/ForkPoolWorker-4] Getting VIM list 2024-06-18T22:35:04.163845328Z [2024-06-18 22:35:04,163: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:35:04.166461180Z [2024-06-18 22:35:04,165: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4eeb8f62-5934-4f8c-b20a-a2bbcb8b4ca1] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 4eeb8f62-5934-4f8c-b20a-a2bbcb8b4ca1') 2024-06-18T22:35:04.166477530Z Traceback (most recent call last): 2024-06-18T22:35:04.166481985Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-06-18T22:35:04.166492318Z R = retval = fun(*args, **kwargs) 2024-06-18T22:35:04.166496242Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-06-18T22:35:04.166499432Z return self.run(*args, **kwargs) 2024-06-18T22:35:04.166503092Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-06-18T22:35:04.166506978Z _execute_in_fork(command_to_exec, celery_task_id) 2024-06-18T22:35:04.166510205Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-06-18T22:35:04.166513961Z raise AirflowException(msg) 2024-06-18T22:35:04.166518101Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 4eeb8f62-5934-4f8c-b20a-a2bbcb8b4ca1 2024-06-18T22:35:04.194823774Z [2024-06-18 22:35:04,194: INFO/ForkPoolWorker-4] Connected to database osm version 1.2 2024-06-18T22:35:04.197117065Z [2024-06-18 22:35:04,196: INFO/ForkPoolWorker-4] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:35:04.197134239Z [2024-06-18 22:35:04,197: INFO/ForkPoolWorker-4] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:35:04.197170900Z [2024-06-18 22:35:04,197: INFO/ForkPoolWorker-4] Read VIM a6a346d3-03c7-47e5-beb3-ecad663a7f17 (basic01_592024) 2024-06-18T22:35:04.197340441Z [2024-06-18 22:35:04,197: INFO/ForkPoolWorker-4] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'a6a346d3-03c7-47e5-beb3-ecad663a7f17', 'name': 'basic01_592024', 'vim_type': 'openstack'}] 2024-06-18T22:35:04.197358613Z [2024-06-18 22:35:04,197: INFO/ForkPoolWorker-4] Getting VIM list OK 2024-06-18T22:35:04.197638475Z [2024-06-18 22:35:04,197: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T22:35:04.197656708Z [2024-06-18 22:35:04,197: INFO/ForkPoolWorker-4] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:35:04.202834212Z [2024-06-18 22:35:04,202: INFO/ForkPoolWorker-4] Creating DAG vim_status_a6a346d3-03c7-47e5-beb3-ecad663a7f17 2024-06-18T22:35:04.321506406Z [2024-06-18 22:35:04,321: INFO/ForkPoolWorker-4] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:35:04.494125527Z [2024-06-18 22:35:04,493: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[626639bc-376d-4f2a-aaa7-91f490650272] received 2024-06-18T22:35:04.501660517Z [2024-06-18 22:35:04,501: INFO/ForkPoolWorker-15] [626639bc-376d-4f2a-aaa7-91f490650272] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'split_metrics', 'scheduled__2024-06-18T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-18T22:35:04.948693359Z [2024-06-18 22:35:04,945: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T22:35:05.850818169Z [2024-06-18 22:35:05,850: INFO/ForkPoolWorker-5] Task airflow.executors.celery_executor.execute_command[c2d6b90f-c772-402c-b70b-09bde34c89ef] succeeded in 5.216640932000018s: None 2024-06-18T22:35:05.960004552Z [2024-06-18 22:35:05,959: INFO/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[14035d6d-bec8-4d6b-80fd-8125f91c1228] succeeded in 5.334458214000051s: None 2024-06-18T22:35:06.079643097Z [2024-06-18 22:35:06,079: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T22:35:06.083163080Z [2024-06-18 22:35:06,082: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:35:06.102732059Z [2024-06-18 22:35:06,102: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T22:35:06.104142528Z [2024-06-18 22:35:06,103: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:35:06.104162483Z [2024-06-18 22:35:06,104: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:35:06.104188425Z [2024-06-18 22:35:06,104: INFO/ForkPoolWorker-15] Read VIM a6a346d3-03c7-47e5-beb3-ecad663a7f17 (basic01_592024) 2024-06-18T22:35:06.104375018Z [2024-06-18 22:35:06,104: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'a6a346d3-03c7-47e5-beb3-ecad663a7f17', 'name': 'basic01_592024', 'vim_type': 'openstack'}] 2024-06-18T22:35:06.104388442Z [2024-06-18 22:35:06,104: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T22:35:06.105019986Z [2024-06-18 22:35:06,104: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T22:35:06.105175813Z [2024-06-18 22:35:06,104: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:35:06.110744633Z [2024-06-18 22:35:06,110: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_a6a346d3-03c7-47e5-beb3-ecad663a7f17 2024-06-18T22:35:06.203086526Z [2024-06-18 22:35:06,202: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:35:06.911472919Z [2024-06-18 22:35:06,910: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[626639bc-376d-4f2a-aaa7-91f490650272] succeeded in 2.4153233740000815s: None 2024-06-18T22:35:07.155049865Z [2024-06-18 22:35:07,154: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d5030de5-d83a-471d-976f-bec8cd13af85] received 2024-06-18T22:35:07.164020234Z [2024-06-18 22:35:07,163: INFO/ForkPoolWorker-15] [d5030de5-d83a-471d-976f-bec8cd13af85] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'collect_metrics', 'scheduled__2024-06-18T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-18T22:35:07.448304306Z [2024-06-18 22:35:07,444: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T22:35:08.585400670Z [2024-06-18 22:35:08,585: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T22:35:08.588884814Z [2024-06-18 22:35:08,588: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:35:08.615802563Z [2024-06-18 22:35:08,615: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T22:35:08.617351232Z [2024-06-18 22:35:08,617: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:35:08.617612419Z [2024-06-18 22:35:08,617: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:35:08.617763686Z [2024-06-18 22:35:08,617: INFO/ForkPoolWorker-15] Read VIM a6a346d3-03c7-47e5-beb3-ecad663a7f17 (basic01_592024) 2024-06-18T22:35:08.618020577Z [2024-06-18 22:35:08,617: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'a6a346d3-03c7-47e5-beb3-ecad663a7f17', 'name': 'basic01_592024', 'vim_type': 'openstack'}] 2024-06-18T22:35:08.618182300Z [2024-06-18 22:35:08,618: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T22:35:08.618631693Z [2024-06-18 22:35:08,618: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T22:35:08.618828841Z [2024-06-18 22:35:08,618: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:35:08.625735759Z [2024-06-18 22:35:08,625: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_a6a346d3-03c7-47e5-beb3-ecad663a7f17 2024-06-18T22:35:08.733186611Z [2024-06-18 22:35:08,732: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:35:09.392035568Z [2024-06-18 22:35:09,391: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d5030de5-d83a-471d-976f-bec8cd13af85] succeeded in 2.232794919999833s: None 2024-06-18T22:35:09.697529151Z [2024-06-18 22:35:09,697: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8d826b88-feb2-4c37-8d1c-40ab5d1a4ea8] received 2024-06-18T22:35:09.704407271Z [2024-06-18 22:35:09,704: INFO/ForkPoolWorker-15] [8d826b88-feb2-4c37-8d1c-40ab5d1a4ea8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'send_prometheus', 'scheduled__2024-06-18T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-18T22:35:09.971261929Z [2024-06-18 22:35:09,968: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T22:35:11.093178213Z [2024-06-18 22:35:11,092: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T22:35:11.096991313Z [2024-06-18 22:35:11,096: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:35:11.121714683Z [2024-06-18 22:35:11,121: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T22:35:11.124302319Z [2024-06-18 22:35:11,123: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:35:11.125000203Z [2024-06-18 22:35:11,124: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:35:11.125286112Z [2024-06-18 22:35:11,125: INFO/ForkPoolWorker-15] Read VIM a6a346d3-03c7-47e5-beb3-ecad663a7f17 (basic01_592024) 2024-06-18T22:35:11.125722176Z [2024-06-18 22:35:11,125: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'a6a346d3-03c7-47e5-beb3-ecad663a7f17', 'name': 'basic01_592024', 'vim_type': 'openstack'}] 2024-06-18T22:35:11.125965532Z [2024-06-18 22:35:11,125: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T22:35:11.126917626Z [2024-06-18 22:35:11,126: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T22:35:11.127187661Z [2024-06-18 22:35:11,127: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:35:11.137873795Z [2024-06-18 22:35:11,137: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_a6a346d3-03c7-47e5-beb3-ecad663a7f17 2024-06-18T22:35:11.239791762Z [2024-06-18 22:35:11,239: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:35:11.835675891Z [2024-06-18 22:35:11,835: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8d826b88-feb2-4c37-8d1c-40ab5d1a4ea8] succeeded in 2.1361116980001498s: None 2024-06-18T22:35:14.527654042Z [2024-06-18 22:35:14,527: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ea5d731c-a376-44c7-821b-427ed6a234b7] received 2024-06-18T22:35:14.536919675Z [2024-06-18 22:35:14,536: INFO/ForkPoolWorker-15] [ea5d731c-a376-44c7-821b-427ed6a234b7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_a6a346d3-03c7-47e5-beb3-ecad663a7f17', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-18T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-18T22:35:14.774699790Z [2024-06-18 22:35:14,774: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f2603744-cc59-4389-9869-463d4333af7a] received 2024-06-18T22:35:14.781043254Z [2024-06-18 22:35:14,780: INFO/ForkPoolWorker-16] [f2603744-cc59-4389-9869-463d4333af7a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_712133a2-a543-492e-a0cc-5f911b803020', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T22:35:14.782841180Z [2024-06-18 22:35:14,782: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b83ad221-b7b3-434d-8be3-9f94ea8055c6] received 2024-06-18T22:35:14.792494572Z [2024-06-18 22:35:14,792: INFO/ForkPoolWorker-1] [b83ad221-b7b3-434d-8be3-9f94ea8055c6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_712133a2-a543-492e-a0cc-5f911b803020', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T22:35:14.828406880Z [2024-06-18 22:35:14,825: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T22:35:15.013442120Z [2024-06-18 22:35:15,013: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[70d8ce5c-626d-438c-bbd1-5e6b35763e85] received 2024-06-18T22:35:15.032546747Z [2024-06-18 22:35:15,032: INFO/ForkPoolWorker-2] [70d8ce5c-626d-438c-bbd1-5e6b35763e85] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_712133a2-a543-492e-a0cc-5f911b803020', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-18T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-18T22:35:15.147630678Z [2024-06-18 22:35:15,143: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T22:35:15.206179284Z [2024-06-18 22:35:15,202: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T22:35:15.383730015Z [2024-06-18 22:35:15,380: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T22:35:16.050438711Z [2024-06-18 22:35:16,050: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T22:35:16.053672124Z [2024-06-18 22:35:16,053: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:35:16.092152437Z [2024-06-18 22:35:16,091: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T22:35:16.096685844Z [2024-06-18 22:35:16,096: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:35:16.096700774Z [2024-06-18 22:35:16,096: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:35:16.096708938Z [2024-06-18 22:35:16,096: INFO/ForkPoolWorker-15] Read VIM a6a346d3-03c7-47e5-beb3-ecad663a7f17 (basic01_592024) 2024-06-18T22:35:16.096795884Z [2024-06-18 22:35:16,096: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'a6a346d3-03c7-47e5-beb3-ecad663a7f17', 'name': 'basic01_592024', 'vim_type': 'openstack'}] 2024-06-18T22:35:16.096834146Z [2024-06-18 22:35:16,096: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T22:35:16.097172532Z [2024-06-18 22:35:16,097: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T22:35:16.097204973Z [2024-06-18 22:35:16,097: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:35:16.102692597Z [2024-06-18 22:35:16,102: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_a6a346d3-03c7-47e5-beb3-ecad663a7f17 2024-06-18T22:35:16.204615735Z [2024-06-18 22:35:16,204: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:35:16.315489560Z [2024-06-18 22:35:16,315: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-18T22:35:16.318364665Z [2024-06-18 22:35:16,318: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:35:16.338357331Z [2024-06-18 22:35:16,338: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T22:35:16.339640044Z [2024-06-18 22:35:16,339: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:35:16.339655601Z [2024-06-18 22:35:16,339: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:35:16.339675132Z [2024-06-18 22:35:16,339: INFO/ForkPoolWorker-16] Read VIM a6a346d3-03c7-47e5-beb3-ecad663a7f17 (basic01_592024) 2024-06-18T22:35:16.339850544Z [2024-06-18 22:35:16,339: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'a6a346d3-03c7-47e5-beb3-ecad663a7f17', 'name': 'basic01_592024', 'vim_type': 'openstack'}] 2024-06-18T22:35:16.339862504Z [2024-06-18 22:35:16,339: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-18T22:35:16.340078493Z [2024-06-18 22:35:16,339: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-18T22:35:16.340089269Z [2024-06-18 22:35:16,340: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:35:16.345080254Z [2024-06-18 22:35:16,344: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_a6a346d3-03c7-47e5-beb3-ecad663a7f17 2024-06-18T22:35:16.350062573Z [2024-06-18 22:35:16,349: WARNING/ForkPoolWorker-16] Dag 'vm_status_vim_712133a2-a543-492e-a0cc-5f911b803020' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T22:35:16.350873609Z [2024-06-18 22:35:16,350: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T22:35:16.352144437Z [2024-06-18 22:35:16,351: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-18T22:35:16.354550253Z [2024-06-18 22:35:16,354: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:35:16.380800932Z [2024-06-18 22:35:16,380: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T22:35:16.384793754Z [2024-06-18 22:35:16,384: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:35:16.384842862Z [2024-06-18 22:35:16,384: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:35:16.384855006Z [2024-06-18 22:35:16,384: INFO/ForkPoolWorker-16] Read VIM a6a346d3-03c7-47e5-beb3-ecad663a7f17 (basic01_592024) 2024-06-18T22:35:16.385305807Z [2024-06-18 22:35:16,385: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'a6a346d3-03c7-47e5-beb3-ecad663a7f17', 'name': 'basic01_592024', 'vim_type': 'openstack'}] 2024-06-18T22:35:16.385317467Z [2024-06-18 22:35:16,385: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-18T22:35:16.385496019Z [2024-06-18 22:35:16,385: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-18T22:35:16.385521438Z [2024-06-18 22:35:16,385: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:35:16.387432703Z [2024-06-18 22:35:16,387: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_a6a346d3-03c7-47e5-beb3-ecad663a7f17 2024-06-18T22:35:16.390741673Z [2024-06-18 22:35:16,390: ERROR/ForkPoolWorker-16] [f2603744-cc59-4389-9869-463d4333af7a] Failed to execute task Dag 'vm_status_vim_712133a2-a543-492e-a0cc-5f911b803020' could not be found; either it does not exist or it failed to parse.. 2024-06-18T22:35:16.390769054Z Traceback (most recent call last): 2024-06-18T22:35:16.390772898Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-06-18T22:35:16.390776520Z args.func(args) 2024-06-18T22:35:16.390779930Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-06-18T22:35:16.390783244Z return func(*args, **kwargs) 2024-06-18T22:35:16.390786193Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-06-18T22:35:16.390789555Z return f(*args, **kwargs) 2024-06-18T22:35:16.390792391Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-06-18T22:35:16.390795388Z dag = get_dag(args.subdir, args.dag_id) 2024-06-18T22:35:16.390802626Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-06-18T22:35:16.390805617Z raise AirflowException( 2024-06-18T22:35:16.390809119Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_712133a2-a543-492e-a0cc-5f911b803020' could not be found; either it does not exist or it failed to parse. 2024-06-18T22:35:16.418453832Z [2024-06-18 22:35:16,417: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f2603744-cc59-4389-9869-463d4333af7a] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id f2603744-cc59-4389-9869-463d4333af7a') 2024-06-18T22:35:16.418471238Z Traceback (most recent call last): 2024-06-18T22:35:16.418475599Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-06-18T22:35:16.418479144Z R = retval = fun(*args, **kwargs) 2024-06-18T22:35:16.418482692Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-06-18T22:35:16.418485643Z return self.run(*args, **kwargs) 2024-06-18T22:35:16.418489326Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-06-18T22:35:16.418493024Z _execute_in_fork(command_to_exec, celery_task_id) 2024-06-18T22:35:16.418495967Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-06-18T22:35:16.418499696Z raise AirflowException(msg) 2024-06-18T22:35:16.418503270Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id f2603744-cc59-4389-9869-463d4333af7a 2024-06-18T22:35:16.539103821Z [2024-06-18 22:35:16,538: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-18T22:35:16.542215681Z [2024-06-18 22:35:16,541: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:35:16.581012173Z [2024-06-18 22:35:16,580: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-18T22:35:16.583759214Z [2024-06-18 22:35:16,583: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:35:16.583929515Z [2024-06-18 22:35:16,583: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:35:16.583981506Z [2024-06-18 22:35:16,583: INFO/ForkPoolWorker-2] Read VIM a6a346d3-03c7-47e5-beb3-ecad663a7f17 (basic01_592024) 2024-06-18T22:35:16.587714231Z [2024-06-18 22:35:16,583: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'a6a346d3-03c7-47e5-beb3-ecad663a7f17', 'name': 'basic01_592024', 'vim_type': 'openstack'}] 2024-06-18T22:35:16.587731323Z [2024-06-18 22:35:16,586: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-18T22:35:16.587735514Z [2024-06-18 22:35:16,586: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T22:35:16.587739720Z [2024-06-18 22:35:16,586: INFO/ForkPoolWorker-2] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:35:16.596789099Z [2024-06-18 22:35:16,596: INFO/ForkPoolWorker-2] Creating DAG vm_metrics_vim_a6a346d3-03c7-47e5-beb3-ecad663a7f17 2024-06-18T22:35:16.601811075Z [2024-06-18 22:35:16,601: WARNING/ForkPoolWorker-2] Dag 'vm_metrics_vim_712133a2-a543-492e-a0cc-5f911b803020' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T22:35:16.603696450Z [2024-06-18 22:35:16,601: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T22:35:16.604620670Z [2024-06-18 22:35:16,604: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-18T22:35:16.607478110Z [2024-06-18 22:35:16,607: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:35:16.632663850Z [2024-06-18 22:35:16,632: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-18T22:35:16.640815099Z [2024-06-18 22:35:16,640: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:35:16.640886064Z [2024-06-18 22:35:16,640: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:35:16.641202910Z [2024-06-18 22:35:16,640: INFO/ForkPoolWorker-2] Read VIM a6a346d3-03c7-47e5-beb3-ecad663a7f17 (basic01_592024) 2024-06-18T22:35:16.641215580Z [2024-06-18 22:35:16,641: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'a6a346d3-03c7-47e5-beb3-ecad663a7f17', 'name': 'basic01_592024', 'vim_type': 'openstack'}] 2024-06-18T22:35:16.641220899Z [2024-06-18 22:35:16,641: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-18T22:35:16.641533501Z [2024-06-18 22:35:16,641: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T22:35:16.642030979Z [2024-06-18 22:35:16,641: INFO/ForkPoolWorker-2] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:35:16.644993453Z [2024-06-18 22:35:16,644: INFO/ForkPoolWorker-2] Creating DAG vm_metrics_vim_a6a346d3-03c7-47e5-beb3-ecad663a7f17 2024-06-18T22:35:16.649157656Z [2024-06-18 22:35:16,648: ERROR/ForkPoolWorker-2] [70d8ce5c-626d-438c-bbd1-5e6b35763e85] Failed to execute task Dag 'vm_metrics_vim_712133a2-a543-492e-a0cc-5f911b803020' could not be found; either it does not exist or it failed to parse.. 2024-06-18T22:35:16.649187215Z Traceback (most recent call last): 2024-06-18T22:35:16.649193218Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-06-18T22:35:16.649212272Z args.func(args) 2024-06-18T22:35:16.649217835Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-06-18T22:35:16.649222442Z return func(*args, **kwargs) 2024-06-18T22:35:16.649226440Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-06-18T22:35:16.649230429Z return f(*args, **kwargs) 2024-06-18T22:35:16.649234348Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-06-18T22:35:16.649238812Z dag = get_dag(args.subdir, args.dag_id) 2024-06-18T22:35:16.649242874Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-06-18T22:35:16.649246798Z raise AirflowException( 2024-06-18T22:35:16.649251939Z airflow.exceptions.AirflowException: Dag 'vm_metrics_vim_712133a2-a543-492e-a0cc-5f911b803020' could not be found; either it does not exist or it failed to parse. 2024-06-18T22:35:16.675753774Z [2024-06-18 22:35:16,675: ERROR/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[70d8ce5c-626d-438c-bbd1-5e6b35763e85] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 70d8ce5c-626d-438c-bbd1-5e6b35763e85') 2024-06-18T22:35:16.675766092Z Traceback (most recent call last): 2024-06-18T22:35:16.675770411Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-06-18T22:35:16.675773768Z R = retval = fun(*args, **kwargs) 2024-06-18T22:35:16.675776770Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-06-18T22:35:16.675779738Z return self.run(*args, **kwargs) 2024-06-18T22:35:16.675783709Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-06-18T22:35:16.675787092Z _execute_in_fork(command_to_exec, celery_task_id) 2024-06-18T22:35:16.675790047Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-06-18T22:35:16.675793544Z raise AirflowException(msg) 2024-06-18T22:35:16.675797060Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 70d8ce5c-626d-438c-bbd1-5e6b35763e85 2024-06-18T22:35:16.686114570Z [2024-06-18 22:35:16,685: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-18T22:35:16.689404800Z [2024-06-18 22:35:16,689: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:35:16.704724076Z [2024-06-18 22:35:16,704: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T22:35:16.705850171Z [2024-06-18 22:35:16,705: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:35:16.705905463Z [2024-06-18 22:35:16,705: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:35:16.705989983Z [2024-06-18 22:35:16,705: INFO/ForkPoolWorker-1] Read VIM a6a346d3-03c7-47e5-beb3-ecad663a7f17 (basic01_592024) 2024-06-18T22:35:16.706137916Z [2024-06-18 22:35:16,705: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'a6a346d3-03c7-47e5-beb3-ecad663a7f17', 'name': 'basic01_592024', 'vim_type': 'openstack'}] 2024-06-18T22:35:16.706165142Z [2024-06-18 22:35:16,706: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-18T22:35:16.706803846Z [2024-06-18 22:35:16,706: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T22:35:16.706814774Z [2024-06-18 22:35:16,706: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:35:16.712375727Z [2024-06-18 22:35:16,712: INFO/ForkPoolWorker-1] Creating DAG vim_status_a6a346d3-03c7-47e5-beb3-ecad663a7f17 2024-06-18T22:35:16.716839106Z [2024-06-18 22:35:16,716: WARNING/ForkPoolWorker-1] Dag 'vim_status_712133a2-a543-492e-a0cc-5f911b803020' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T22:35:16.717468513Z [2024-06-18 22:35:16,716: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T22:35:16.718238163Z [2024-06-18 22:35:16,718: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-18T22:35:16.721094596Z [2024-06-18 22:35:16,720: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:35:16.738882679Z [2024-06-18 22:35:16,738: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T22:35:16.740194266Z [2024-06-18 22:35:16,739: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:35:16.740214957Z [2024-06-18 22:35:16,740: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:35:16.740282065Z [2024-06-18 22:35:16,740: INFO/ForkPoolWorker-1] Read VIM a6a346d3-03c7-47e5-beb3-ecad663a7f17 (basic01_592024) 2024-06-18T22:35:16.740594104Z [2024-06-18 22:35:16,740: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'a6a346d3-03c7-47e5-beb3-ecad663a7f17', 'name': 'basic01_592024', 'vim_type': 'openstack'}] 2024-06-18T22:35:16.740894834Z [2024-06-18 22:35:16,740: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-18T22:35:16.741214104Z [2024-06-18 22:35:16,741: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T22:35:16.741286870Z [2024-06-18 22:35:16,741: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:35:16.744087296Z [2024-06-18 22:35:16,743: INFO/ForkPoolWorker-1] Creating DAG vim_status_a6a346d3-03c7-47e5-beb3-ecad663a7f17 2024-06-18T22:35:16.752231448Z [2024-06-18 22:35:16,749: ERROR/ForkPoolWorker-1] [b83ad221-b7b3-434d-8be3-9f94ea8055c6] Failed to execute task Dag 'vim_status_712133a2-a543-492e-a0cc-5f911b803020' could not be found; either it does not exist or it failed to parse.. 2024-06-18T22:35:16.752243387Z Traceback (most recent call last): 2024-06-18T22:35:16.752248038Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-06-18T22:35:16.752252135Z args.func(args) 2024-06-18T22:35:16.752256201Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-06-18T22:35:16.752260247Z return func(*args, **kwargs) 2024-06-18T22:35:16.752263951Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-06-18T22:35:16.752279361Z return f(*args, **kwargs) 2024-06-18T22:35:16.752282823Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-06-18T22:35:16.752286227Z dag = get_dag(args.subdir, args.dag_id) 2024-06-18T22:35:16.752289818Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-06-18T22:35:16.752293229Z raise AirflowException( 2024-06-18T22:35:16.752297286Z airflow.exceptions.AirflowException: Dag 'vim_status_712133a2-a543-492e-a0cc-5f911b803020' could not be found; either it does not exist or it failed to parse. 2024-06-18T22:35:16.780780216Z [2024-06-18 22:35:16,779: ERROR/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b83ad221-b7b3-434d-8be3-9f94ea8055c6] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id b83ad221-b7b3-434d-8be3-9f94ea8055c6') 2024-06-18T22:35:16.780802227Z Traceback (most recent call last): 2024-06-18T22:35:16.780807691Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-06-18T22:35:16.780811883Z R = retval = fun(*args, **kwargs) 2024-06-18T22:35:16.780816301Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-06-18T22:35:16.780820412Z return self.run(*args, **kwargs) 2024-06-18T22:35:16.780825383Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-06-18T22:35:16.780830003Z _execute_in_fork(command_to_exec, celery_task_id) 2024-06-18T22:35:16.780834371Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-06-18T22:35:16.780838692Z raise AirflowException(msg) 2024-06-18T22:35:16.780843417Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id b83ad221-b7b3-434d-8be3-9f94ea8055c6 2024-06-18T22:35:16.878504030Z [2024-06-18 22:35:16,878: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ea5d731c-a376-44c7-821b-427ed6a234b7] succeeded in 2.348351743999956s: None 2024-06-18T22:35:17.457614966Z [2024-06-18 22:35:17,456: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3df02e44-d735-44df-a74e-784f2e2272d1] received 2024-06-18T22:35:17.468225664Z [2024-06-18 22:35:17,467: INFO/ForkPoolWorker-15] [3df02e44-d735-44df-a74e-784f2e2272d1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_a6a346d3-03c7-47e5-beb3-ecad663a7f17', 'split_metrics', 'scheduled__2024-06-18T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-18T22:35:17.767792860Z [2024-06-18 22:35:17,761: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T22:35:18.820987914Z [2024-06-18 22:35:18,820: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T22:35:18.824351117Z [2024-06-18 22:35:18,823: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:35:18.846822124Z [2024-06-18 22:35:18,846: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T22:35:18.848291973Z [2024-06-18 22:35:18,848: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:35:18.848483793Z [2024-06-18 22:35:18,848: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:35:18.848653744Z [2024-06-18 22:35:18,848: INFO/ForkPoolWorker-15] Read VIM a6a346d3-03c7-47e5-beb3-ecad663a7f17 (basic01_592024) 2024-06-18T22:35:18.848845202Z [2024-06-18 22:35:18,848: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'a6a346d3-03c7-47e5-beb3-ecad663a7f17', 'name': 'basic01_592024', 'vim_type': 'openstack'}] 2024-06-18T22:35:18.849059761Z [2024-06-18 22:35:18,848: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T22:35:18.849384464Z [2024-06-18 22:35:18,849: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T22:35:18.849507930Z [2024-06-18 22:35:18,849: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:35:18.855461732Z [2024-06-18 22:35:18,855: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_a6a346d3-03c7-47e5-beb3-ecad663a7f17 2024-06-18T22:35:18.928095119Z [2024-06-18 22:35:18,927: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:35:19.684828273Z [2024-06-18 22:35:19,684: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3df02e44-d735-44df-a74e-784f2e2272d1] succeeded in 2.2243726980000247s: None 2024-06-18T22:35:20.049750449Z [2024-06-18 22:35:20,049: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[79755133-aa6a-41d3-bfe4-9a4f240cefdb] received 2024-06-18T22:35:20.058097066Z [2024-06-18 22:35:20,057: INFO/ForkPoolWorker-15] [79755133-aa6a-41d3-bfe4-9a4f240cefdb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_a6a346d3-03c7-47e5-beb3-ecad663a7f17', 'collect_metrics', 'scheduled__2024-06-18T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-18T22:35:20.371026610Z [2024-06-18 22:35:20,357: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T22:35:21.455199014Z [2024-06-18 22:35:21,454: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T22:35:21.458678445Z [2024-06-18 22:35:21,458: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:35:21.484619367Z [2024-06-18 22:35:21,484: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T22:35:21.488753371Z [2024-06-18 22:35:21,488: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:35:21.488812825Z [2024-06-18 22:35:21,488: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:35:21.488945992Z [2024-06-18 22:35:21,488: INFO/ForkPoolWorker-15] Read VIM a6a346d3-03c7-47e5-beb3-ecad663a7f17 (basic01_592024) 2024-06-18T22:35:21.489155163Z [2024-06-18 22:35:21,488: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'a6a346d3-03c7-47e5-beb3-ecad663a7f17', 'name': 'basic01_592024', 'vim_type': 'openstack'}] 2024-06-18T22:35:21.489239267Z [2024-06-18 22:35:21,489: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T22:35:21.489518702Z [2024-06-18 22:35:21,489: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T22:35:21.489607971Z [2024-06-18 22:35:21,489: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:35:21.495907913Z [2024-06-18 22:35:21,495: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_a6a346d3-03c7-47e5-beb3-ecad663a7f17 2024-06-18T22:35:21.575598780Z [2024-06-18 22:35:21,575: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:35:22.118865907Z [2024-06-18 22:35:22,118: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[79755133-aa6a-41d3-bfe4-9a4f240cefdb] succeeded in 2.0661591519999547s: None 2024-06-18T22:35:22.435886632Z [2024-06-18 22:35:22,435: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7e082d74-9896-4740-b9a2-e12f63cf076f] received 2024-06-18T22:35:22.439869012Z [2024-06-18 22:35:22,439: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[01f53d50-754b-439a-b399-d2c17c583803] received 2024-06-18T22:35:22.451458008Z [2024-06-18 22:35:22,451: INFO/ForkPoolWorker-16] [01f53d50-754b-439a-b399-d2c17c583803] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_a6a346d3-03c7-47e5-beb3-ecad663a7f17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T22:35:22.457880972Z [2024-06-18 22:35:22,457: INFO/ForkPoolWorker-15] [7e082d74-9896-4740-b9a2-e12f63cf076f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_a6a346d3-03c7-47e5-beb3-ecad663a7f17', 'send_prometheus', 'scheduled__2024-06-18T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-18T22:35:22.769531504Z [2024-06-18 22:35:22,766: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T22:35:22.806220190Z [2024-06-18 22:35:22,802: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T22:35:23.755709975Z [2024-06-18 22:35:23,752: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[039a713d-8554-4de9-b704-6d52286e5d53] received 2024-06-18T22:35:23.780688476Z [2024-06-18 22:35:23,780: INFO/ForkPoolWorker-1] [039a713d-8554-4de9-b704-6d52286e5d53] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_a6a346d3-03c7-47e5-beb3-ecad663a7f17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T22:35:23.850039726Z [2024-06-18 22:35:23,842: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-18T22:35:23.850067425Z [2024-06-18 22:35:23,846: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:35:23.904797138Z [2024-06-18 22:35:23,904: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T22:35:23.905980563Z [2024-06-18 22:35:23,905: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:35:23.906022491Z [2024-06-18 22:35:23,905: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:35:23.906116964Z [2024-06-18 22:35:23,906: INFO/ForkPoolWorker-16] Read VIM a6a346d3-03c7-47e5-beb3-ecad663a7f17 (basic01_592024) 2024-06-18T22:35:23.906277395Z [2024-06-18 22:35:23,906: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'a6a346d3-03c7-47e5-beb3-ecad663a7f17', 'name': 'basic01_592024', 'vim_type': 'openstack'}] 2024-06-18T22:35:23.906328295Z [2024-06-18 22:35:23,906: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-18T22:35:23.906590750Z [2024-06-18 22:35:23,906: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-18T22:35:23.906673438Z [2024-06-18 22:35:23,906: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:35:23.910792668Z [2024-06-18 22:35:23,910: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_a6a346d3-03c7-47e5-beb3-ecad663a7f17 2024-06-18T22:35:23.942553398Z [2024-06-18 22:35:23,942: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T22:35:23.945886033Z [2024-06-18 22:35:23,945: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:35:23.964290054Z [2024-06-18 22:35:23,964: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T22:35:23.965419851Z [2024-06-18 22:35:23,965: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:35:23.965487734Z [2024-06-18 22:35:23,965: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:35:23.965578613Z [2024-06-18 22:35:23,965: INFO/ForkPoolWorker-15] Read VIM a6a346d3-03c7-47e5-beb3-ecad663a7f17 (basic01_592024) 2024-06-18T22:35:23.965770552Z [2024-06-18 22:35:23,965: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'a6a346d3-03c7-47e5-beb3-ecad663a7f17', 'name': 'basic01_592024', 'vim_type': 'openstack'}] 2024-06-18T22:35:23.965877762Z [2024-06-18 22:35:23,965: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T22:35:23.966534509Z [2024-06-18 22:35:23,966: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T22:35:23.966846023Z [2024-06-18 22:35:23,966: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:35:23.972473879Z [2024-06-18 22:35:23,972: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_a6a346d3-03c7-47e5-beb3-ecad663a7f17 2024-06-18T22:35:23.978884732Z [2024-06-18 22:35:23,978: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:35:24.039553890Z [2024-06-18 22:35:24,039: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:35:24.111042995Z [2024-06-18 22:35:24,107: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T22:35:24.556535147Z [2024-06-18 22:35:24,555: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7e082d74-9896-4740-b9a2-e12f63cf076f] succeeded in 2.115642905999948s: None 2024-06-18T22:35:25.215964293Z [2024-06-18 22:35:25,215: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-18T22:35:25.219215802Z [2024-06-18 22:35:25,218: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:35:25.246637988Z [2024-06-18 22:35:25,246: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T22:35:25.248099969Z [2024-06-18 22:35:25,247: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:35:25.248249705Z [2024-06-18 22:35:25,247: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:35:25.248370371Z [2024-06-18 22:35:25,248: INFO/ForkPoolWorker-1] Read VIM a6a346d3-03c7-47e5-beb3-ecad663a7f17 (basic01_592024) 2024-06-18T22:35:25.248468957Z [2024-06-18 22:35:25,248: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'a6a346d3-03c7-47e5-beb3-ecad663a7f17', 'name': 'basic01_592024', 'vim_type': 'openstack'}] 2024-06-18T22:35:25.248487623Z [2024-06-18 22:35:25,248: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-18T22:35:25.248952197Z [2024-06-18 22:35:25,248: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T22:35:25.248977479Z [2024-06-18 22:35:25,248: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:35:25.255024575Z [2024-06-18 22:35:25,254: INFO/ForkPoolWorker-1] Creating DAG vim_status_a6a346d3-03c7-47e5-beb3-ecad663a7f17 2024-06-18T22:35:25.360852393Z [2024-06-18 22:35:25,360: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:35:25.709392353Z [2024-06-18 22:35:25,709: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[01f53d50-754b-439a-b399-d2c17c583803] succeeded in 3.268347353999843s: None 2024-06-18T22:35:26.912785461Z [2024-06-18 22:35:26,912: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[039a713d-8554-4de9-b704-6d52286e5d53] succeeded in 3.151009332000058s: None 2024-06-18T22:36:00.960321082Z [2024-06-18 22:36:00,959: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[44b9bb3b-caf6-40d9-a965-83203cbc5188] received 2024-06-18T22:36:00.964422300Z [2024-06-18 22:36:00,963: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ae07f32f-1a61-4172-85aa-a7fe8279805f] received 2024-06-18T22:36:00.968217591Z [2024-06-18 22:36:00,968: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6b7ef83a-e338-4f94-a87a-908bdd52a245] received 2024-06-18T22:36:00.970519020Z [2024-06-18 22:36:00,970: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4228a5ae-1706-408f-955e-d59afe36b18a] received 2024-06-18T22:36:00.972178240Z [2024-06-18 22:36:00,971: INFO/ForkPoolWorker-15] [44b9bb3b-caf6-40d9-a965-83203cbc5188] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-18T22:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-18T22:36:00.972559193Z [2024-06-18 22:36:00,972: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9f45427c-dca2-4b45-a33c-94d9cfbd04fe] received 2024-06-18T22:36:00.975744376Z [2024-06-18 22:36:00,975: INFO/ForkPoolWorker-1] [6b7ef83a-e338-4f94-a87a-908bdd52a245] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T22:36:00.976119764Z [2024-06-18 22:36:00,975: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6ae103c3-2c22-4b39-81a3-b5864feae920] received 2024-06-18T22:36:00.978227892Z [2024-06-18 22:36:00,978: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4120d1ae-be93-4c0a-afc4-375bc855e3e4] received 2024-06-18T22:36:00.980005069Z [2024-06-18 22:36:00,979: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[22959bfd-7e75-47f8-9526-6e5cd5864f24] received 2024-06-18T22:36:00.983936933Z [2024-06-18 22:36:00,983: INFO/ForkPoolWorker-2] [4228a5ae-1706-408f-955e-d59afe36b18a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_712133a2-a543-492e-a0cc-5f911b803020', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T22:36:00.990318337Z [2024-06-18 22:36:00,990: INFO/ForkPoolWorker-4] [6ae103c3-2c22-4b39-81a3-b5864feae920] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T22:36:00.992626031Z [2024-06-18 22:36:00,992: INFO/ForkPoolWorker-16] [ae07f32f-1a61-4172-85aa-a7fe8279805f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_a6a346d3-03c7-47e5-beb3-ecad663a7f17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T22:36:00.993490413Z [2024-06-18 22:36:00,993: INFO/ForkPoolWorker-3] [9f45427c-dca2-4b45-a33c-94d9cfbd04fe] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T22:36:01.012927494Z [2024-06-18 22:36:01,012: INFO/ForkPoolWorker-5] [4120d1ae-be93-4c0a-afc4-375bc855e3e4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_a6a346d3-03c7-47e5-beb3-ecad663a7f17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T22:36:01.062470633Z [2024-06-18 22:36:01,062: INFO/ForkPoolWorker-6] [22959bfd-7e75-47f8-9526-6e5cd5864f24] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_712133a2-a543-492e-a0cc-5f911b803020', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T22:36:01.382770660Z [2024-06-18 22:36:01,378: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T22:36:01.462431423Z [2024-06-18 22:36:01,459: INFO/ForkPoolWorker-6] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T22:36:01.500224114Z [2024-06-18 22:36:01,496: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T22:36:01.613225597Z [2024-06-18 22:36:01,607: INFO/ForkPoolWorker-5] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T22:36:01.875488935Z [2024-06-18 22:36:01,871: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T22:36:01.877333850Z [2024-06-18 22:36:01,873: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T22:36:01.923669762Z [2024-06-18 22:36:01,920: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-18T22:36:01.939580153Z [2024-06-18 22:36:01,934: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T22:36:02.481202152Z [2024-06-18 22:36:02,480: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:36:02.545971218Z [2024-06-18 22:36:02,545: INFO/ForkPoolWorker-4] Getting SDNC list 2024-06-18T22:36:02.550539318Z [2024-06-18 22:36:02,550: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:36:02.570493506Z [2024-06-18 22:36:02,570: INFO/ForkPoolWorker-4] Connected to database osm version 1.2 2024-06-18T22:36:02.572127062Z [2024-06-18 22:36:02,571: INFO/ForkPoolWorker-4] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T22:36:02.572410398Z [2024-06-18 22:36:02,572: INFO/ForkPoolWorker-4] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T22:36:02.572659885Z [2024-06-18 22:36:02,572: INFO/ForkPoolWorker-4] Getting SDNC list OK 2024-06-18T22:36:02.573076950Z [2024-06-18 22:36:02,572: INFO/ForkPoolWorker-4] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T22:36:02.843244108Z [2024-06-18 22:36:02,842: INFO/ForkPoolWorker-4] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:36:03.584125849Z [2024-06-18 22:36:03,583: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[44b9bb3b-caf6-40d9-a965-83203cbc5188] succeeded in 2.618418279000025s: None 2024-06-18T22:36:03.787387182Z [2024-06-18 22:36:03,787: INFO/ForkPoolWorker-6] Getting VIM list 2024-06-18T22:36:03.791139131Z [2024-06-18 22:36:03,790: INFO/ForkPoolWorker-6] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:36:03.821474383Z [2024-06-18 22:36:03,821: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-18T22:36:03.824048845Z [2024-06-18 22:36:03,823: INFO/ForkPoolWorker-6] Connected to database osm version 1.2 2024-06-18T22:36:03.826041955Z [2024-06-18 22:36:03,825: INFO/ForkPoolWorker-6] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:36:03.826063309Z [2024-06-18 22:36:03,825: INFO/ForkPoolWorker-6] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:36:03.826173978Z [2024-06-18 22:36:03,826: INFO/ForkPoolWorker-6] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:36:03.826184833Z [2024-06-18 22:36:03,826: INFO/ForkPoolWorker-6] Getting VIM list OK 2024-06-18T22:36:03.826407723Z [2024-06-18 22:36:03,826: INFO/ForkPoolWorker-6] VIM type 'dummy' not supported for collecting VM status 2024-06-18T22:36:03.826454625Z [2024-06-18 22:36:03,826: INFO/ForkPoolWorker-6] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:36:03.844015779Z [2024-06-18 22:36:03,843: WARNING/ForkPoolWorker-6] Dag 'vm_status_vim_712133a2-a543-492e-a0cc-5f911b803020' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T22:36:03.844791440Z [2024-06-18 22:36:03,844: INFO/ForkPoolWorker-6] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T22:36:03.846896766Z [2024-06-18 22:36:03,846: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:36:03.848384059Z [2024-06-18 22:36:03,848: INFO/ForkPoolWorker-6] Getting VIM list 2024-06-18T22:36:03.850951916Z [2024-06-18 22:36:03,850: INFO/ForkPoolWorker-6] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:36:03.873956127Z [2024-06-18 22:36:03,873: INFO/ForkPoolWorker-6] Connected to database osm version 1.2 2024-06-18T22:36:03.876120479Z [2024-06-18 22:36:03,875: INFO/ForkPoolWorker-6] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:36:03.877203115Z [2024-06-18 22:36:03,876: INFO/ForkPoolWorker-6] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:36:03.877391929Z [2024-06-18 22:36:03,876: INFO/ForkPoolWorker-6] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:36:03.877596509Z [2024-06-18 22:36:03,877: INFO/ForkPoolWorker-6] Getting VIM list OK 2024-06-18T22:36:03.878649797Z [2024-06-18 22:36:03,877: INFO/ForkPoolWorker-6] VIM type 'dummy' not supported for collecting VM status 2024-06-18T22:36:03.880703117Z [2024-06-18 22:36:03,880: INFO/ForkPoolWorker-6] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:36:03.897630360Z [2024-06-18 22:36:03,897: INFO/ForkPoolWorker-3] Getting VIM list 2024-06-18T22:36:03.897908720Z [2024-06-18 22:36:03,896: ERROR/ForkPoolWorker-6] [22959bfd-7e75-47f8-9526-6e5cd5864f24] Failed to execute task Dag 'vm_status_vim_712133a2-a543-492e-a0cc-5f911b803020' could not be found; either it does not exist or it failed to parse.. 2024-06-18T22:36:03.897920920Z Traceback (most recent call last): 2024-06-18T22:36:03.897932816Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-06-18T22:36:03.897936933Z args.func(args) 2024-06-18T22:36:03.897940504Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-06-18T22:36:03.897944130Z return func(*args, **kwargs) 2024-06-18T22:36:03.897947296Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-06-18T22:36:03.897950334Z return f(*args, **kwargs) 2024-06-18T22:36:03.897953319Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-06-18T22:36:03.897956191Z dag = get_dag(args.subdir, args.dag_id) 2024-06-18T22:36:03.897978125Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-06-18T22:36:03.897981967Z raise AirflowException( 2024-06-18T22:36:03.897997380Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_712133a2-a543-492e-a0cc-5f911b803020' could not be found; either it does not exist or it failed to parse. 2024-06-18T22:36:03.901313882Z [2024-06-18 22:36:03,900: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:36:03.912878106Z [2024-06-18 22:36:03,912: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-18T22:36:03.918735331Z [2024-06-18 22:36:03,918: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:36:03.918750923Z [2024-06-18 22:36:03,918: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:36:03.918849227Z [2024-06-18 22:36:03,918: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:36:03.918875467Z [2024-06-18 22:36:03,918: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-18T22:36:03.920247959Z [2024-06-18 22:36:03,920: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T22:36:03.920372954Z [2024-06-18 22:36:03,920: INFO/ForkPoolWorker-2] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:36:03.929864831Z [2024-06-18 22:36:03,929: WARNING/ForkPoolWorker-2] Dag 'vim_status_712133a2-a543-492e-a0cc-5f911b803020' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T22:36:03.932869477Z [2024-06-18 22:36:03,932: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-06-18T22:36:03.936945736Z [2024-06-18 22:36:03,936: INFO/ForkPoolWorker-3] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:36:03.939571796Z [2024-06-18 22:36:03,936: INFO/ForkPoolWorker-3] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:36:03.939634146Z [2024-06-18 22:36:03,930: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T22:36:03.939973650Z [2024-06-18 22:36:03,939: INFO/ForkPoolWorker-3] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:36:03.940633204Z [2024-06-18 22:36:03,940: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-06-18T22:36:03.941381306Z [2024-06-18 22:36:03,941: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-18T22:36:03.941761897Z [2024-06-18 22:36:03,941: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-06-18T22:36:03.941983452Z [2024-06-18 22:36:03,941: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:36:03.946059658Z [2024-06-18 22:36:03,945: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:36:03.968190400Z [2024-06-18 22:36:03,967: ERROR/ForkPoolWorker-6] Task airflow.executors.celery_executor.execute_command[22959bfd-7e75-47f8-9526-6e5cd5864f24] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 22959bfd-7e75-47f8-9526-6e5cd5864f24') 2024-06-18T22:36:03.968218555Z Traceback (most recent call last): 2024-06-18T22:36:03.968222731Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-06-18T22:36:03.968225833Z R = retval = fun(*args, **kwargs) 2024-06-18T22:36:03.968228706Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-06-18T22:36:03.968244676Z return self.run(*args, **kwargs) 2024-06-18T22:36:03.968248379Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-06-18T22:36:03.968251966Z _execute_in_fork(command_to_exec, celery_task_id) 2024-06-18T22:36:03.968254894Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-06-18T22:36:03.968258352Z raise AirflowException(msg) 2024-06-18T22:36:03.968262057Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 22959bfd-7e75-47f8-9526-6e5cd5864f24 2024-06-18T22:36:03.988839184Z [2024-06-18 22:36:03,988: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-18T22:36:03.995277253Z [2024-06-18 22:36:03,994: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:36:03.995296266Z [2024-06-18 22:36:03,995: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:36:03.995551694Z [2024-06-18 22:36:03,995: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:36:03.995880312Z [2024-06-18 22:36:03,995: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-18T22:36:03.996586665Z [2024-06-18 22:36:03,996: INFO/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[6ae103c3-2c22-4b39-81a3-b5864feae920] succeeded in 3.017576770000005s: None 2024-06-18T22:36:03.999439428Z [2024-06-18 22:36:03,999: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T22:36:03.999527776Z [2024-06-18 22:36:03,999: INFO/ForkPoolWorker-2] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:36:04.011516354Z [2024-06-18 22:36:04,010: ERROR/ForkPoolWorker-2] [4228a5ae-1706-408f-955e-d59afe36b18a] Failed to execute task Dag 'vim_status_712133a2-a543-492e-a0cc-5f911b803020' could not be found; either it does not exist or it failed to parse.. 2024-06-18T22:36:04.011542465Z Traceback (most recent call last): 2024-06-18T22:36:04.011594268Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-06-18T22:36:04.011600249Z args.func(args) 2024-06-18T22:36:04.011605526Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-06-18T22:36:04.011610840Z return func(*args, **kwargs) 2024-06-18T22:36:04.011615384Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-06-18T22:36:04.011619801Z return f(*args, **kwargs) 2024-06-18T22:36:04.011624442Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-06-18T22:36:04.011643888Z dag = get_dag(args.subdir, args.dag_id) 2024-06-18T22:36:04.011649251Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-06-18T22:36:04.011653973Z raise AirflowException( 2024-06-18T22:36:04.011676139Z airflow.exceptions.AirflowException: Dag 'vim_status_712133a2-a543-492e-a0cc-5f911b803020' could not be found; either it does not exist or it failed to parse. 2024-06-18T22:36:04.046129818Z [2024-06-18 22:36:04,045: ERROR/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[4228a5ae-1706-408f-955e-d59afe36b18a] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 4228a5ae-1706-408f-955e-d59afe36b18a') 2024-06-18T22:36:04.046153933Z Traceback (most recent call last): 2024-06-18T22:36:04.046178644Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-06-18T22:36:04.046184160Z R = retval = fun(*args, **kwargs) 2024-06-18T22:36:04.046188608Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-06-18T22:36:04.046193098Z return self.run(*args, **kwargs) 2024-06-18T22:36:04.046198063Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-06-18T22:36:04.046202836Z _execute_in_fork(command_to_exec, celery_task_id) 2024-06-18T22:36:04.046206970Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-06-18T22:36:04.046212001Z raise AirflowException(msg) 2024-06-18T22:36:04.046217183Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 4228a5ae-1706-408f-955e-d59afe36b18a 2024-06-18T22:36:04.051475905Z [2024-06-18 22:36:04,051: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:36:04.179624195Z [2024-06-18 22:36:04,179: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-18T22:36:04.182917324Z [2024-06-18 22:36:04,182: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:36:04.213719014Z [2024-06-18 22:36:04,213: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T22:36:04.216187277Z [2024-06-18 22:36:04,215: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:36:04.216202154Z [2024-06-18 22:36:04,216: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:36:04.216356631Z [2024-06-18 22:36:04,216: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:36:04.216398315Z [2024-06-18 22:36:04,216: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-18T22:36:04.216640218Z [2024-06-18 22:36:04,216: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T22:36:04.216715091Z [2024-06-18 22:36:04,216: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:36:04.348256269Z [2024-06-18 22:36:04,347: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:36:04.636570508Z [2024-06-18 22:36:04,636: INFO/ForkPoolWorker-5] Getting VIM list 2024-06-18T22:36:04.640453245Z [2024-06-18 22:36:04,640: INFO/ForkPoolWorker-5] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:36:04.696950085Z [2024-06-18 22:36:04,696: INFO/ForkPoolWorker-5] Connected to database osm version 1.2 2024-06-18T22:36:04.700693286Z [2024-06-18 22:36:04,700: INFO/ForkPoolWorker-5] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:36:04.700817749Z [2024-06-18 22:36:04,700: INFO/ForkPoolWorker-5] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:36:04.701074506Z [2024-06-18 22:36:04,700: INFO/ForkPoolWorker-5] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:36:04.702236128Z [2024-06-18 22:36:04,701: INFO/ForkPoolWorker-5] Getting VIM list OK 2024-06-18T22:36:04.702825529Z [2024-06-18 22:36:04,702: INFO/ForkPoolWorker-5] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T22:36:04.703243748Z [2024-06-18 22:36:04,702: INFO/ForkPoolWorker-5] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:36:04.714301132Z [2024-06-18 22:36:04,714: WARNING/ForkPoolWorker-5] Dag 'vim_status_a6a346d3-03c7-47e5-beb3-ecad663a7f17' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T22:36:04.715351832Z [2024-06-18 22:36:04,714: INFO/ForkPoolWorker-5] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T22:36:04.716267887Z [2024-06-18 22:36:04,716: INFO/ForkPoolWorker-5] Getting VIM list 2024-06-18T22:36:04.719119387Z [2024-06-18 22:36:04,718: INFO/ForkPoolWorker-5] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:36:04.734760817Z [2024-06-18 22:36:04,734: INFO/ForkPoolWorker-5] Connected to database osm version 1.2 2024-06-18T22:36:04.737006588Z [2024-06-18 22:36:04,736: INFO/ForkPoolWorker-5] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:36:04.737020012Z [2024-06-18 22:36:04,736: INFO/ForkPoolWorker-5] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:36:04.737263629Z [2024-06-18 22:36:04,737: INFO/ForkPoolWorker-5] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:36:04.737367128Z [2024-06-18 22:36:04,737: INFO/ForkPoolWorker-5] Getting VIM list OK 2024-06-18T22:36:04.737784997Z [2024-06-18 22:36:04,737: INFO/ForkPoolWorker-5] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T22:36:04.737910525Z [2024-06-18 22:36:04,737: INFO/ForkPoolWorker-5] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:36:04.745290306Z [2024-06-18 22:36:04,744: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-18T22:36:04.747000326Z [2024-06-18 22:36:04,746: ERROR/ForkPoolWorker-5] [4120d1ae-be93-4c0a-afc4-375bc855e3e4] Failed to execute task Dag 'vim_status_a6a346d3-03c7-47e5-beb3-ecad663a7f17' could not be found; either it does not exist or it failed to parse.. 2024-06-18T22:36:04.747019092Z Traceback (most recent call last): 2024-06-18T22:36:04.747025342Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-06-18T22:36:04.747047053Z args.func(args) 2024-06-18T22:36:04.747064147Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-06-18T22:36:04.747084840Z return func(*args, **kwargs) 2024-06-18T22:36:04.747089334Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-06-18T22:36:04.747093970Z return f(*args, **kwargs) 2024-06-18T22:36:04.747098650Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-06-18T22:36:04.747103027Z dag = get_dag(args.subdir, args.dag_id) 2024-06-18T22:36:04.747108121Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-06-18T22:36:04.747112547Z raise AirflowException( 2024-06-18T22:36:04.747117479Z airflow.exceptions.AirflowException: Dag 'vim_status_a6a346d3-03c7-47e5-beb3-ecad663a7f17' could not be found; either it does not exist or it failed to parse. 2024-06-18T22:36:04.749047875Z [2024-06-18 22:36:04,748: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:36:04.777533444Z [2024-06-18 22:36:04,777: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T22:36:04.778867316Z [2024-06-18 22:36:04,778: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:36:04.778970288Z [2024-06-18 22:36:04,778: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:36:04.779143683Z [2024-06-18 22:36:04,778: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:36:04.779252486Z [2024-06-18 22:36:04,779: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-18T22:36:04.779627947Z [2024-06-18 22:36:04,779: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-18T22:36:04.779808392Z [2024-06-18 22:36:04,779: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:36:04.786509320Z [2024-06-18 22:36:04,786: WARNING/ForkPoolWorker-16] Dag 'vm_status_vim_a6a346d3-03c7-47e5-beb3-ecad663a7f17' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T22:36:04.787427225Z [2024-06-18 22:36:04,786: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T22:36:04.788847920Z [2024-06-18 22:36:04,788: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-18T22:36:04.792340973Z [2024-06-18 22:36:04,792: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:36:04.792353580Z [2024-06-18 22:36:04,791: ERROR/ForkPoolWorker-5] Task airflow.executors.celery_executor.execute_command[4120d1ae-be93-4c0a-afc4-375bc855e3e4] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 4120d1ae-be93-4c0a-afc4-375bc855e3e4') 2024-06-18T22:36:04.792370756Z Traceback (most recent call last): 2024-06-18T22:36:04.792374764Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-06-18T22:36:04.792378115Z R = retval = fun(*args, **kwargs) 2024-06-18T22:36:04.792381070Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-06-18T22:36:04.792384147Z return self.run(*args, **kwargs) 2024-06-18T22:36:04.792387726Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-06-18T22:36:04.792391484Z _execute_in_fork(command_to_exec, celery_task_id) 2024-06-18T22:36:04.792394982Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-06-18T22:36:04.792398377Z raise AirflowException(msg) 2024-06-18T22:36:04.792401930Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 4120d1ae-be93-4c0a-afc4-375bc855e3e4 2024-06-18T22:36:04.802151065Z [2024-06-18 22:36:04,801: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T22:36:04.803333793Z [2024-06-18 22:36:04,803: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:36:04.803423866Z [2024-06-18 22:36:04,803: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:36:04.803560687Z [2024-06-18 22:36:04,803: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:36:04.803625648Z [2024-06-18 22:36:04,803: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-18T22:36:04.804111783Z [2024-06-18 22:36:04,803: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-18T22:36:04.804173403Z [2024-06-18 22:36:04,804: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:36:04.807224728Z [2024-06-18 22:36:04,806: ERROR/ForkPoolWorker-16] [ae07f32f-1a61-4172-85aa-a7fe8279805f] Failed to execute task Dag 'vm_status_vim_a6a346d3-03c7-47e5-beb3-ecad663a7f17' could not be found; either it does not exist or it failed to parse.. 2024-06-18T22:36:04.807240110Z Traceback (most recent call last): 2024-06-18T22:36:04.807245924Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-06-18T22:36:04.807251393Z args.func(args) 2024-06-18T22:36:04.807256444Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-06-18T22:36:04.807267477Z return func(*args, **kwargs) 2024-06-18T22:36:04.807276792Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-06-18T22:36:04.807281912Z return f(*args, **kwargs) 2024-06-18T22:36:04.807287157Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-06-18T22:36:04.807292056Z dag = get_dag(args.subdir, args.dag_id) 2024-06-18T22:36:04.807296696Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-06-18T22:36:04.807301353Z raise AirflowException( 2024-06-18T22:36:04.807306734Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_a6a346d3-03c7-47e5-beb3-ecad663a7f17' could not be found; either it does not exist or it failed to parse. 2024-06-18T22:36:04.839831212Z [2024-06-18 22:36:04,839: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ae07f32f-1a61-4172-85aa-a7fe8279805f] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id ae07f32f-1a61-4172-85aa-a7fe8279805f') 2024-06-18T22:36:04.839863493Z Traceback (most recent call last): 2024-06-18T22:36:04.839879166Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-06-18T22:36:04.839882407Z R = retval = fun(*args, **kwargs) 2024-06-18T22:36:04.839885422Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-06-18T22:36:04.839888283Z return self.run(*args, **kwargs) 2024-06-18T22:36:04.839891599Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-06-18T22:36:04.839895197Z _execute_in_fork(command_to_exec, celery_task_id) 2024-06-18T22:36:04.839898140Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-06-18T22:36:04.839901582Z raise AirflowException(msg) 2024-06-18T22:36:04.839905016Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id ae07f32f-1a61-4172-85aa-a7fe8279805f 2024-06-18T22:36:05.905963965Z [2024-06-18 22:36:05,905: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6b7ef83a-e338-4f94-a87a-908bdd52a245] succeeded in 4.935875071000055s: None 2024-06-18T22:36:06.218671249Z [2024-06-18 22:36:06,217: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[9f45427c-dca2-4b45-a33c-94d9cfbd04fe] succeeded in 5.242506512999853s: None 2024-06-18T22:36:14.822664050Z [2024-06-18 22:36:14,822: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6d2eea33-0e09-4c45-8b29-5f7b7bfcf333] received 2024-06-18T22:36:14.824032614Z [2024-06-18 22:36:14,823: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c22516fe-26e7-4845-a64a-b54523047492] received 2024-06-18T22:36:14.830138487Z [2024-06-18 22:36:14,829: INFO/ForkPoolWorker-16] [c22516fe-26e7-4845-a64a-b54523047492] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_712133a2-a543-492e-a0cc-5f911b803020', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T22:36:14.830927539Z [2024-06-18 22:36:14,830: INFO/ForkPoolWorker-15] [6d2eea33-0e09-4c45-8b29-5f7b7bfcf333] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_712133a2-a543-492e-a0cc-5f911b803020', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T22:36:15.142127015Z [2024-06-18 22:36:15,138: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T22:36:15.152332370Z [2024-06-18 22:36:15,148: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T22:36:15.510465430Z [2024-06-18 22:36:15,510: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[20750692-3d0e-4eb1-bd60-837534e7c502] received 2024-06-18T22:36:15.512692890Z [2024-06-18 22:36:15,512: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[28d86cee-35b8-4266-97d6-abc322c78085] received 2024-06-18T22:36:15.519931861Z [2024-06-18 22:36:15,519: INFO/ForkPoolWorker-2] [28d86cee-35b8-4266-97d6-abc322c78085] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_a6a346d3-03c7-47e5-beb3-ecad663a7f17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T22:36:15.520069539Z [2024-06-18 22:36:15,519: INFO/ForkPoolWorker-1] [20750692-3d0e-4eb1-bd60-837534e7c502] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_a6a346d3-03c7-47e5-beb3-ecad663a7f17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T22:36:15.844392333Z [2024-06-18 22:36:15,841: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T22:36:15.894682225Z [2024-06-18 22:36:15,891: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T22:36:16.445659674Z [2024-06-18 22:36:16,445: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-18T22:36:16.448938773Z [2024-06-18 22:36:16,448: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:36:16.458632714Z [2024-06-18 22:36:16,445: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T22:36:16.465976066Z [2024-06-18 22:36:16,465: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T22:36:16.467187318Z [2024-06-18 22:36:16,467: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:36:16.467320728Z [2024-06-18 22:36:16,467: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:36:16.467505612Z [2024-06-18 22:36:16,467: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:36:16.467514795Z [2024-06-18 22:36:16,466: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:36:16.467553460Z [2024-06-18 22:36:16,467: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-18T22:36:16.472056020Z [2024-06-18 22:36:16,471: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-18T22:36:16.472095772Z [2024-06-18 22:36:16,471: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:36:16.480608703Z [2024-06-18 22:36:16,480: WARNING/ForkPoolWorker-16] Dag 'vm_status_vim_712133a2-a543-492e-a0cc-5f911b803020' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T22:36:16.481420950Z [2024-06-18 22:36:16,480: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T22:36:16.482290966Z [2024-06-18 22:36:16,482: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-18T22:36:16.485208611Z [2024-06-18 22:36:16,484: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:36:16.517511257Z [2024-06-18 22:36:16,517: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T22:36:16.519113561Z [2024-06-18 22:36:16,518: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:36:16.519167754Z [2024-06-18 22:36:16,519: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:36:16.519445050Z [2024-06-18 22:36:16,519: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:36:16.519504392Z [2024-06-18 22:36:16,519: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-18T22:36:16.519763245Z [2024-06-18 22:36:16,519: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-18T22:36:16.519809027Z [2024-06-18 22:36:16,519: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:36:16.525274828Z [2024-06-18 22:36:16,523: ERROR/ForkPoolWorker-16] [c22516fe-26e7-4845-a64a-b54523047492] Failed to execute task Dag 'vm_status_vim_712133a2-a543-492e-a0cc-5f911b803020' could not be found; either it does not exist or it failed to parse.. 2024-06-18T22:36:16.525286816Z Traceback (most recent call last): 2024-06-18T22:36:16.525291517Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-06-18T22:36:16.525295747Z args.func(args) 2024-06-18T22:36:16.525300138Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-06-18T22:36:16.525304104Z return func(*args, **kwargs) 2024-06-18T22:36:16.525307619Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-06-18T22:36:16.525311344Z return f(*args, **kwargs) 2024-06-18T22:36:16.525314983Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-06-18T22:36:16.525319046Z dag = get_dag(args.subdir, args.dag_id) 2024-06-18T22:36:16.525322577Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-06-18T22:36:16.525325976Z raise AirflowException( 2024-06-18T22:36:16.525330078Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_712133a2-a543-492e-a0cc-5f911b803020' could not be found; either it does not exist or it failed to parse. 2024-06-18T22:36:16.540988465Z [2024-06-18 22:36:16,540: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T22:36:16.544635801Z [2024-06-18 22:36:16,544: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:36:16.544844208Z [2024-06-18 22:36:16,544: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:36:16.545012945Z [2024-06-18 22:36:16,544: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:36:16.545033011Z [2024-06-18 22:36:16,544: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T22:36:16.545360632Z [2024-06-18 22:36:16,545: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T22:36:16.545482142Z [2024-06-18 22:36:16,545: INFO/ForkPoolWorker-15] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:36:16.551618753Z [2024-06-18 22:36:16,551: WARNING/ForkPoolWorker-15] Dag 'vim_status_712133a2-a543-492e-a0cc-5f911b803020' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T22:36:16.552525230Z [2024-06-18 22:36:16,551: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T22:36:16.553345124Z [2024-06-18 22:36:16,553: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T22:36:16.558354370Z [2024-06-18 22:36:16,558: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:36:16.577286457Z [2024-06-18 22:36:16,576: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c22516fe-26e7-4845-a64a-b54523047492] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id c22516fe-26e7-4845-a64a-b54523047492') 2024-06-18T22:36:16.577312244Z Traceback (most recent call last): 2024-06-18T22:36:16.577316868Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-06-18T22:36:16.577319857Z R = retval = fun(*args, **kwargs) 2024-06-18T22:36:16.577323480Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-06-18T22:36:16.577326449Z return self.run(*args, **kwargs) 2024-06-18T22:36:16.577330028Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-06-18T22:36:16.577333721Z _execute_in_fork(command_to_exec, celery_task_id) 2024-06-18T22:36:16.577336997Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-06-18T22:36:16.577340431Z raise AirflowException(msg) 2024-06-18T22:36:16.577346375Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id c22516fe-26e7-4845-a64a-b54523047492 2024-06-18T22:36:16.595978553Z [2024-06-18 22:36:16,594: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T22:36:16.597339087Z [2024-06-18 22:36:16,597: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:36:16.597367975Z [2024-06-18 22:36:16,597: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:36:16.597872514Z [2024-06-18 22:36:16,597: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:36:16.597934948Z [2024-06-18 22:36:16,597: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T22:36:16.598213382Z [2024-06-18 22:36:16,598: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T22:36:16.598273295Z [2024-06-18 22:36:16,598: INFO/ForkPoolWorker-15] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:36:16.604533308Z [2024-06-18 22:36:16,602: ERROR/ForkPoolWorker-15] [6d2eea33-0e09-4c45-8b29-5f7b7bfcf333] Failed to execute task Dag 'vim_status_712133a2-a543-492e-a0cc-5f911b803020' could not be found; either it does not exist or it failed to parse.. 2024-06-18T22:36:16.604548810Z Traceback (most recent call last): 2024-06-18T22:36:16.604562792Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-06-18T22:36:16.604567738Z args.func(args) 2024-06-18T22:36:16.604572735Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-06-18T22:36:16.604588224Z return func(*args, **kwargs) 2024-06-18T22:36:16.604591266Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-06-18T22:36:16.604594332Z return f(*args, **kwargs) 2024-06-18T22:36:16.604597457Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-06-18T22:36:16.604600291Z dag = get_dag(args.subdir, args.dag_id) 2024-06-18T22:36:16.604603258Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-06-18T22:36:16.604606180Z raise AirflowException( 2024-06-18T22:36:16.604609617Z airflow.exceptions.AirflowException: Dag 'vim_status_712133a2-a543-492e-a0cc-5f911b803020' could not be found; either it does not exist or it failed to parse. 2024-06-18T22:36:16.664047326Z [2024-06-18 22:36:16,663: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6d2eea33-0e09-4c45-8b29-5f7b7bfcf333] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 6d2eea33-0e09-4c45-8b29-5f7b7bfcf333') 2024-06-18T22:36:16.664064749Z Traceback (most recent call last): 2024-06-18T22:36:16.664068621Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-06-18T22:36:16.664071667Z R = retval = fun(*args, **kwargs) 2024-06-18T22:36:16.664074852Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-06-18T22:36:16.664078073Z return self.run(*args, **kwargs) 2024-06-18T22:36:16.664081952Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-06-18T22:36:16.664085565Z _execute_in_fork(command_to_exec, celery_task_id) 2024-06-18T22:36:16.664088548Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-06-18T22:36:16.664092155Z raise AirflowException(msg) 2024-06-18T22:36:16.664095798Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 6d2eea33-0e09-4c45-8b29-5f7b7bfcf333 2024-06-18T22:36:17.164381190Z [2024-06-18 22:36:17,164: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-18T22:36:17.167494458Z [2024-06-18 22:36:17,167: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:36:17.192660799Z [2024-06-18 22:36:17,192: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-18T22:36:17.194101673Z [2024-06-18 22:36:17,193: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:36:17.194152144Z [2024-06-18 22:36:17,194: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:36:17.194320912Z [2024-06-18 22:36:17,194: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:36:17.194381960Z [2024-06-18 22:36:17,194: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-18T22:36:17.194761328Z [2024-06-18 22:36:17,194: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-06-18T22:36:17.194808546Z [2024-06-18 22:36:17,194: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:36:17.204968690Z [2024-06-18 22:36:17,204: WARNING/ForkPoolWorker-2] Dag 'vm_status_vim_a6a346d3-03c7-47e5-beb3-ecad663a7f17' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T22:36:17.205590505Z [2024-06-18 22:36:17,204: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T22:36:17.206337759Z [2024-06-18 22:36:17,206: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-18T22:36:17.209199433Z [2024-06-18 22:36:17,208: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:36:17.231160648Z [2024-06-18 22:36:17,230: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-18T22:36:17.235971113Z [2024-06-18 22:36:17,235: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:36:17.236519350Z [2024-06-18 22:36:17,236: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-18T22:36:17.237766679Z [2024-06-18 22:36:17,237: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:36:17.237856296Z [2024-06-18 22:36:17,237: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:36:17.238033281Z [2024-06-18 22:36:17,237: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:36:17.238106206Z [2024-06-18 22:36:17,238: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-18T22:36:17.238429750Z [2024-06-18 22:36:17,238: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-06-18T22:36:17.238898916Z [2024-06-18 22:36:17,238: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:36:17.242610422Z [2024-06-18 22:36:17,241: ERROR/ForkPoolWorker-2] [28d86cee-35b8-4266-97d6-abc322c78085] Failed to execute task Dag 'vm_status_vim_a6a346d3-03c7-47e5-beb3-ecad663a7f17' could not be found; either it does not exist or it failed to parse.. 2024-06-18T22:36:17.242624772Z Traceback (most recent call last): 2024-06-18T22:36:17.242629414Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-06-18T22:36:17.242633676Z args.func(args) 2024-06-18T22:36:17.242638304Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-06-18T22:36:17.242642280Z return func(*args, **kwargs) 2024-06-18T22:36:17.242645742Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-06-18T22:36:17.242649158Z return f(*args, **kwargs) 2024-06-18T22:36:17.242652488Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-06-18T22:36:17.242656184Z dag = get_dag(args.subdir, args.dag_id) 2024-06-18T22:36:17.242659765Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-06-18T22:36:17.242663407Z raise AirflowException( 2024-06-18T22:36:17.242680287Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_a6a346d3-03c7-47e5-beb3-ecad663a7f17' could not be found; either it does not exist or it failed to parse. 2024-06-18T22:36:17.255615659Z [2024-06-18 22:36:17,255: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T22:36:17.258439217Z [2024-06-18 22:36:17,256: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:36:17.258446061Z [2024-06-18 22:36:17,257: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:36:17.258449851Z [2024-06-18 22:36:17,257: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:36:17.258453696Z [2024-06-18 22:36:17,257: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-18T22:36:17.258460716Z [2024-06-18 22:36:17,257: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T22:36:17.258464033Z [2024-06-18 22:36:17,257: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:36:17.265254970Z [2024-06-18 22:36:17,265: WARNING/ForkPoolWorker-1] Dag 'vim_status_a6a346d3-03c7-47e5-beb3-ecad663a7f17' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T22:36:17.266287339Z [2024-06-18 22:36:17,265: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T22:36:17.267159765Z [2024-06-18 22:36:17,266: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-18T22:36:17.270234519Z [2024-06-18 22:36:17,269: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:36:17.290555871Z [2024-06-18 22:36:17,289: ERROR/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[28d86cee-35b8-4266-97d6-abc322c78085] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 28d86cee-35b8-4266-97d6-abc322c78085') 2024-06-18T22:36:17.290575022Z Traceback (most recent call last): 2024-06-18T22:36:17.290580023Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-06-18T22:36:17.290583616Z R = retval = fun(*args, **kwargs) 2024-06-18T22:36:17.290587156Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-06-18T22:36:17.290591143Z return self.run(*args, **kwargs) 2024-06-18T22:36:17.290595201Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-06-18T22:36:17.290599788Z _execute_in_fork(command_to_exec, celery_task_id) 2024-06-18T22:36:17.290603229Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-06-18T22:36:17.290607279Z raise AirflowException(msg) 2024-06-18T22:36:17.290611714Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 28d86cee-35b8-4266-97d6-abc322c78085 2024-06-18T22:36:17.299671807Z [2024-06-18 22:36:17,299: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T22:36:17.301289781Z [2024-06-18 22:36:17,300: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:36:17.301401731Z [2024-06-18 22:36:17,301: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:36:17.301658283Z [2024-06-18 22:36:17,301: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:36:17.301719930Z [2024-06-18 22:36:17,301: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-18T22:36:17.302209110Z [2024-06-18 22:36:17,302: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T22:36:17.302303169Z [2024-06-18 22:36:17,302: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:36:17.306881382Z [2024-06-18 22:36:17,306: ERROR/ForkPoolWorker-1] [20750692-3d0e-4eb1-bd60-837534e7c502] Failed to execute task Dag 'vim_status_a6a346d3-03c7-47e5-beb3-ecad663a7f17' could not be found; either it does not exist or it failed to parse.. 2024-06-18T22:36:17.306897523Z Traceback (most recent call last): 2024-06-18T22:36:17.306903922Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-06-18T22:36:17.306909366Z args.func(args) 2024-06-18T22:36:17.306914751Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-06-18T22:36:17.306919894Z return func(*args, **kwargs) 2024-06-18T22:36:17.306924691Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-06-18T22:36:17.306929302Z return f(*args, **kwargs) 2024-06-18T22:36:17.306934853Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-06-18T22:36:17.306949958Z dag = get_dag(args.subdir, args.dag_id) 2024-06-18T22:36:17.306955248Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-06-18T22:36:17.306959908Z raise AirflowException( 2024-06-18T22:36:17.306965324Z airflow.exceptions.AirflowException: Dag 'vim_status_a6a346d3-03c7-47e5-beb3-ecad663a7f17' could not be found; either it does not exist or it failed to parse. 2024-06-18T22:36:17.350168491Z [2024-06-18 22:36:17,349: ERROR/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[20750692-3d0e-4eb1-bd60-837534e7c502] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 20750692-3d0e-4eb1-bd60-837534e7c502') 2024-06-18T22:36:17.350191498Z Traceback (most recent call last): 2024-06-18T22:36:17.350195833Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-06-18T22:36:17.350199208Z R = retval = fun(*args, **kwargs) 2024-06-18T22:36:17.350202492Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-06-18T22:36:17.350260424Z return self.run(*args, **kwargs) 2024-06-18T22:36:17.350267603Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-06-18T22:36:17.350273202Z _execute_in_fork(command_to_exec, celery_task_id) 2024-06-18T22:36:17.350278715Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-06-18T22:36:17.350284859Z raise AirflowException(msg) 2024-06-18T22:36:17.350295132Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 20750692-3d0e-4eb1-bd60-837534e7c502 2024-06-18T22:37:00.679828685Z [2024-06-18 22:37:00,679: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[399428cd-0c95-4257-a1e2-a763f0332921] received 2024-06-18T22:37:00.684926758Z [2024-06-18 22:37:00,684: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4481f2d7-0634-442a-a2e4-3b088ee465a7] received 2024-06-18T22:37:00.696212023Z [2024-06-18 22:37:00,695: INFO/ForkPoolWorker-15] [399428cd-0c95-4257-a1e2-a763f0332921] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T22:37:00.698654004Z [2024-06-18 22:37:00,698: INFO/ForkPoolWorker-16] [4481f2d7-0634-442a-a2e4-3b088ee465a7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_a6a346d3-03c7-47e5-beb3-ecad663a7f17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T22:37:00.708203105Z [2024-06-18 22:37:00,707: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e0ce7167-c93c-4dda-9294-11e5be0f0db3] received 2024-06-18T22:37:00.709878200Z [2024-06-18 22:37:00,709: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[52808b2d-8232-46c7-94bf-fb560ba304ea] received 2024-06-18T22:37:00.718969107Z [2024-06-18 22:37:00,718: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[73667ba8-5a4d-42e1-971f-dc34ec8b86a7] received 2024-06-18T22:37:00.731775852Z [2024-06-18 22:37:00,731: INFO/ForkPoolWorker-1] [e0ce7167-c93c-4dda-9294-11e5be0f0db3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T22:37:00.732735900Z [2024-06-18 22:37:00,732: INFO/ForkPoolWorker-2] [52808b2d-8232-46c7-94bf-fb560ba304ea] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T22:37:00.753081167Z [2024-06-18 22:37:00,752: INFO/ForkPoolWorker-3] [73667ba8-5a4d-42e1-971f-dc34ec8b86a7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_a6a346d3-03c7-47e5-beb3-ecad663a7f17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T22:37:01.059747552Z [2024-06-18 22:37:01,056: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T22:37:01.062523890Z [2024-06-18 22:37:01,053: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T22:37:01.142579312Z [2024-06-18 22:37:01,138: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T22:37:01.217454219Z [2024-06-18 22:37:01,213: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T22:37:01.270040921Z [2024-06-18 22:37:01,266: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T22:37:01.356447234Z [2024-06-18 22:37:01,355: INFO/ForkPoolWorker-2] Getting SDNC list 2024-06-18T22:37:01.362296398Z [2024-06-18 22:37:01,361: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:37:01.439082216Z [2024-06-18 22:37:01,438: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-18T22:37:01.441239845Z [2024-06-18 22:37:01,440: INFO/ForkPoolWorker-2] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T22:37:01.441275418Z [2024-06-18 22:37:01,441: INFO/ForkPoolWorker-2] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T22:37:01.441396661Z [2024-06-18 22:37:01,441: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-06-18T22:37:01.441644484Z [2024-06-18 22:37:01,441: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T22:37:01.591560247Z [2024-06-18 22:37:01,591: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:37:02.641948658Z [2024-06-18 22:37:02,641: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[52808b2d-8232-46c7-94bf-fb560ba304ea] succeeded in 1.9294324720001441s: None 2024-06-18T22:37:02.869204987Z [2024-06-18 22:37:02,868: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T22:37:02.872431202Z [2024-06-18 22:37:02,872: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:37:02.896538867Z [2024-06-18 22:37:02,896: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T22:37:02.899702552Z [2024-06-18 22:37:02,899: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:37:02.899839860Z [2024-06-18 22:37:02,899: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:37:02.900012138Z [2024-06-18 22:37:02,899: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:37:02.900114100Z [2024-06-18 22:37:02,900: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T22:37:02.900395283Z [2024-06-18 22:37:02,900: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-06-18T22:37:02.900505144Z [2024-06-18 22:37:02,900: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:37:02.906961543Z [2024-06-18 22:37:02,906: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-18T22:37:02.911119916Z [2024-06-18 22:37:02,910: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:37:02.945557457Z [2024-06-18 22:37:02,945: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T22:37:02.948401524Z [2024-06-18 22:37:02,948: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:37:02.948417324Z [2024-06-18 22:37:02,948: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:37:02.948495484Z [2024-06-18 22:37:02,948: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:37:02.948519272Z [2024-06-18 22:37:02,948: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-18T22:37:02.948833537Z [2024-06-18 22:37:02,948: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T22:37:02.948892379Z [2024-06-18 22:37:02,948: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:37:02.969625753Z [2024-06-18 22:37:02,969: INFO/ForkPoolWorker-3] Getting VIM list 2024-06-18T22:37:02.972782430Z [2024-06-18 22:37:02,972: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:37:02.994905499Z [2024-06-18 22:37:02,994: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-18T22:37:02.995974982Z [2024-06-18 22:37:02,995: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:37:02.998714722Z [2024-06-18 22:37:02,998: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:37:03.015205722Z [2024-06-18 22:37:03,014: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-06-18T22:37:03.016511472Z [2024-06-18 22:37:03,016: INFO/ForkPoolWorker-3] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:37:03.017782346Z [2024-06-18 22:37:03,017: INFO/ForkPoolWorker-3] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:37:03.017898384Z [2024-06-18 22:37:03,017: INFO/ForkPoolWorker-3] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:37:03.018041421Z [2024-06-18 22:37:03,017: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-06-18T22:37:03.018296461Z [2024-06-18 22:37:03,018: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-06-18T22:37:03.018667802Z [2024-06-18 22:37:03,018: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:37:03.026598203Z [2024-06-18 22:37:03,026: WARNING/ForkPoolWorker-3] Dag 'vm_status_vim_a6a346d3-03c7-47e5-beb3-ecad663a7f17' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T22:37:03.027362058Z [2024-06-18 22:37:03,026: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T22:37:03.029319210Z [2024-06-18 22:37:03,028: INFO/ForkPoolWorker-3] Getting VIM list 2024-06-18T22:37:03.032634692Z [2024-06-18 22:37:03,031: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:37:03.033340694Z [2024-06-18 22:37:03,033: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T22:37:03.036457951Z [2024-06-18 22:37:03,036: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:37:03.036658666Z [2024-06-18 22:37:03,036: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:37:03.036856789Z [2024-06-18 22:37:03,036: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:37:03.037110316Z [2024-06-18 22:37:03,036: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-18T22:37:03.037493985Z [2024-06-18 22:37:03,037: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T22:37:03.037610657Z [2024-06-18 22:37:03,037: INFO/ForkPoolWorker-16] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:37:03.047726025Z [2024-06-18 22:37:03,047: WARNING/ForkPoolWorker-16] Dag 'vim_status_a6a346d3-03c7-47e5-beb3-ecad663a7f17' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T22:37:03.048742521Z [2024-06-18 22:37:03,047: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T22:37:03.049954475Z [2024-06-18 22:37:03,049: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-18T22:37:03.050114387Z [2024-06-18 22:37:03,049: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-06-18T22:37:03.051327021Z [2024-06-18 22:37:03,051: INFO/ForkPoolWorker-3] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:37:03.051410279Z [2024-06-18 22:37:03,051: INFO/ForkPoolWorker-3] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:37:03.051545789Z [2024-06-18 22:37:03,051: INFO/ForkPoolWorker-3] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:37:03.051606407Z [2024-06-18 22:37:03,051: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-06-18T22:37:03.051897487Z [2024-06-18 22:37:03,051: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-06-18T22:37:03.054066716Z [2024-06-18 22:37:03,053: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:37:03.056325072Z [2024-06-18 22:37:03,056: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:37:03.059391128Z [2024-06-18 22:37:03,058: ERROR/ForkPoolWorker-3] [73667ba8-5a4d-42e1-971f-dc34ec8b86a7] Failed to execute task Dag 'vm_status_vim_a6a346d3-03c7-47e5-beb3-ecad663a7f17' could not be found; either it does not exist or it failed to parse.. 2024-06-18T22:37:03.059399396Z Traceback (most recent call last): 2024-06-18T22:37:03.059403853Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-06-18T22:37:03.059408068Z args.func(args) 2024-06-18T22:37:03.059411872Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-06-18T22:37:03.059415875Z return func(*args, **kwargs) 2024-06-18T22:37:03.059419251Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-06-18T22:37:03.059436496Z return f(*args, **kwargs) 2024-06-18T22:37:03.059440091Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-06-18T22:37:03.059443417Z dag = get_dag(args.subdir, args.dag_id) 2024-06-18T22:37:03.059453960Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-06-18T22:37:03.059457350Z raise AirflowException( 2024-06-18T22:37:03.059461409Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_a6a346d3-03c7-47e5-beb3-ecad663a7f17' could not be found; either it does not exist or it failed to parse. 2024-06-18T22:37:03.066100635Z [2024-06-18 22:37:03,065: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:37:03.081636640Z [2024-06-18 22:37:03,081: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T22:37:03.084369600Z [2024-06-18 22:37:03,084: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:37:03.084499407Z [2024-06-18 22:37:03,084: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:37:03.084691544Z [2024-06-18 22:37:03,084: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:37:03.084831685Z [2024-06-18 22:37:03,084: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-18T22:37:03.085136460Z [2024-06-18 22:37:03,085: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T22:37:03.085386521Z [2024-06-18 22:37:03,085: INFO/ForkPoolWorker-16] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:37:03.089196418Z [2024-06-18 22:37:03,088: ERROR/ForkPoolWorker-16] [4481f2d7-0634-442a-a2e4-3b088ee465a7] Failed to execute task Dag 'vim_status_a6a346d3-03c7-47e5-beb3-ecad663a7f17' could not be found; either it does not exist or it failed to parse.. 2024-06-18T22:37:03.089211025Z Traceback (most recent call last): 2024-06-18T22:37:03.089215095Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-06-18T22:37:03.089218898Z args.func(args) 2024-06-18T22:37:03.089222532Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-06-18T22:37:03.089226497Z return func(*args, **kwargs) 2024-06-18T22:37:03.089233138Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-06-18T22:37:03.089236212Z return f(*args, **kwargs) 2024-06-18T22:37:03.089239228Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-06-18T22:37:03.089242413Z dag = get_dag(args.subdir, args.dag_id) 2024-06-18T22:37:03.089245503Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-06-18T22:37:03.089248545Z raise AirflowException( 2024-06-18T22:37:03.089252195Z airflow.exceptions.AirflowException: Dag 'vim_status_a6a346d3-03c7-47e5-beb3-ecad663a7f17' could not be found; either it does not exist or it failed to parse. 2024-06-18T22:37:03.103407998Z [2024-06-18 22:37:03,102: ERROR/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[73667ba8-5a4d-42e1-971f-dc34ec8b86a7] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 73667ba8-5a4d-42e1-971f-dc34ec8b86a7') 2024-06-18T22:37:03.103449594Z Traceback (most recent call last): 2024-06-18T22:37:03.103454846Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-06-18T22:37:03.103458853Z R = retval = fun(*args, **kwargs) 2024-06-18T22:37:03.103462930Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-06-18T22:37:03.103466975Z return self.run(*args, **kwargs) 2024-06-18T22:37:03.103472036Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-06-18T22:37:03.103476726Z _execute_in_fork(command_to_exec, celery_task_id) 2024-06-18T22:37:03.103480681Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-06-18T22:37:03.103485518Z raise AirflowException(msg) 2024-06-18T22:37:03.103490774Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 73667ba8-5a4d-42e1-971f-dc34ec8b86a7 2024-06-18T22:37:03.124097051Z [2024-06-18 22:37:03,123: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4481f2d7-0634-442a-a2e4-3b088ee465a7] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 4481f2d7-0634-442a-a2e4-3b088ee465a7') 2024-06-18T22:37:03.124127017Z Traceback (most recent call last): 2024-06-18T22:37:03.124134378Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-06-18T22:37:03.124140312Z R = retval = fun(*args, **kwargs) 2024-06-18T22:37:03.124145832Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-06-18T22:37:03.124151598Z return self.run(*args, **kwargs) 2024-06-18T22:37:03.124158064Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-06-18T22:37:03.124164400Z _execute_in_fork(command_to_exec, celery_task_id) 2024-06-18T22:37:03.124169978Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-06-18T22:37:03.124176527Z raise AirflowException(msg) 2024-06-18T22:37:03.124183015Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 4481f2d7-0634-442a-a2e4-3b088ee465a7 2024-06-18T22:37:04.795995588Z [2024-06-18 22:37:04,795: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e0ce7167-c93c-4dda-9294-11e5be0f0db3] succeeded in 4.082573828000022s: None 2024-06-18T22:37:05.382303278Z [2024-06-18 22:37:05,381: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[399428cd-0c95-4257-a1e2-a763f0332921] succeeded in 4.6970099899999695s: None 2024-06-18T22:37:14.873137817Z [2024-06-18 22:37:14,872: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c5cee086-1bed-42a1-9930-20a23944f6dc] received 2024-06-18T22:37:14.876998967Z [2024-06-18 22:37:14,876: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d8c3e25e-717f-493d-82ae-69d65d8fa090] received 2024-06-18T22:37:14.886188795Z [2024-06-18 22:37:14,885: INFO/ForkPoolWorker-16] [d8c3e25e-717f-493d-82ae-69d65d8fa090] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_a6a346d3-03c7-47e5-beb3-ecad663a7f17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T22:37:14.886892688Z [2024-06-18 22:37:14,886: INFO/ForkPoolWorker-15] [c5cee086-1bed-42a1-9930-20a23944f6dc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_a6a346d3-03c7-47e5-beb3-ecad663a7f17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T22:37:15.154273079Z [2024-06-18 22:37:15,150: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T22:37:15.220285709Z [2024-06-18 22:37:15,217: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T22:37:16.217727047Z [2024-06-18 22:37:16,217: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T22:37:16.221052024Z [2024-06-18 22:37:16,220: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:37:16.242930021Z [2024-06-18 22:37:16,242: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T22:37:16.244333811Z [2024-06-18 22:37:16,244: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:37:16.244385530Z [2024-06-18 22:37:16,244: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:37:16.244525552Z [2024-06-18 22:37:16,244: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:37:16.244625221Z [2024-06-18 22:37:16,244: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T22:37:16.244896525Z [2024-06-18 22:37:16,244: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T22:37:16.244906047Z [2024-06-18 22:37:16,244: INFO/ForkPoolWorker-15] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:37:16.251479910Z [2024-06-18 22:37:16,251: WARNING/ForkPoolWorker-15] Dag 'vim_status_a6a346d3-03c7-47e5-beb3-ecad663a7f17' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T22:37:16.252370704Z [2024-06-18 22:37:16,251: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T22:37:16.253198148Z [2024-06-18 22:37:16,253: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T22:37:16.256043452Z [2024-06-18 22:37:16,255: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:37:16.276509304Z [2024-06-18 22:37:16,276: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T22:37:16.280817230Z [2024-06-18 22:37:16,280: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:37:16.280892336Z [2024-06-18 22:37:16,280: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:37:16.281079649Z [2024-06-18 22:37:16,280: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:37:16.281166764Z [2024-06-18 22:37:16,281: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T22:37:16.281437805Z [2024-06-18 22:37:16,281: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T22:37:16.281505043Z [2024-06-18 22:37:16,281: INFO/ForkPoolWorker-15] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:37:16.286227982Z [2024-06-18 22:37:16,285: ERROR/ForkPoolWorker-15] [c5cee086-1bed-42a1-9930-20a23944f6dc] Failed to execute task Dag 'vim_status_a6a346d3-03c7-47e5-beb3-ecad663a7f17' could not be found; either it does not exist or it failed to parse.. 2024-06-18T22:37:16.286243885Z Traceback (most recent call last): 2024-06-18T22:37:16.286247656Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-06-18T22:37:16.286273593Z args.func(args) 2024-06-18T22:37:16.286277578Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-06-18T22:37:16.286280969Z return func(*args, **kwargs) 2024-06-18T22:37:16.286283911Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-06-18T22:37:16.286287094Z return f(*args, **kwargs) 2024-06-18T22:37:16.286290140Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-06-18T22:37:16.286293161Z dag = get_dag(args.subdir, args.dag_id) 2024-06-18T22:37:16.286296031Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-06-18T22:37:16.286298970Z raise AirflowException( 2024-06-18T22:37:16.286302627Z airflow.exceptions.AirflowException: Dag 'vim_status_a6a346d3-03c7-47e5-beb3-ecad663a7f17' could not be found; either it does not exist or it failed to parse. 2024-06-18T22:37:16.319772819Z [2024-06-18 22:37:16,319: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c5cee086-1bed-42a1-9930-20a23944f6dc] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id c5cee086-1bed-42a1-9930-20a23944f6dc') 2024-06-18T22:37:16.319788990Z Traceback (most recent call last): 2024-06-18T22:37:16.319792976Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-06-18T22:37:16.319796018Z R = retval = fun(*args, **kwargs) 2024-06-18T22:37:16.319799026Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-06-18T22:37:16.319802176Z return self.run(*args, **kwargs) 2024-06-18T22:37:16.319805739Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-06-18T22:37:16.319809267Z _execute_in_fork(command_to_exec, celery_task_id) 2024-06-18T22:37:16.319812562Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-06-18T22:37:16.319816218Z raise AirflowException(msg) 2024-06-18T22:37:16.319819697Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id c5cee086-1bed-42a1-9930-20a23944f6dc 2024-06-18T22:37:16.336652182Z [2024-06-18 22:37:16,336: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-18T22:37:16.339914784Z [2024-06-18 22:37:16,339: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:37:16.358986776Z [2024-06-18 22:37:16,358: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T22:37:16.360352538Z [2024-06-18 22:37:16,360: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:37:16.360683171Z [2024-06-18 22:37:16,360: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:37:16.360980793Z [2024-06-18 22:37:16,360: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:37:16.361131728Z [2024-06-18 22:37:16,361: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-18T22:37:16.361735467Z [2024-06-18 22:37:16,361: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-18T22:37:16.361874216Z [2024-06-18 22:37:16,361: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:37:16.367435350Z [2024-06-18 22:37:16,367: WARNING/ForkPoolWorker-16] Dag 'vm_status_vim_a6a346d3-03c7-47e5-beb3-ecad663a7f17' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T22:37:16.368361259Z [2024-06-18 22:37:16,367: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T22:37:16.369233723Z [2024-06-18 22:37:16,369: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-18T22:37:16.371797740Z [2024-06-18 22:37:16,371: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:37:16.384754821Z [2024-06-18 22:37:16,384: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T22:37:16.385901970Z [2024-06-18 22:37:16,385: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:37:16.386057321Z [2024-06-18 22:37:16,385: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:37:16.386247668Z [2024-06-18 22:37:16,386: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:37:16.386372874Z [2024-06-18 22:37:16,386: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-18T22:37:16.386671518Z [2024-06-18 22:37:16,386: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-18T22:37:16.386800792Z [2024-06-18 22:37:16,386: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:37:16.389928428Z [2024-06-18 22:37:16,389: ERROR/ForkPoolWorker-16] [d8c3e25e-717f-493d-82ae-69d65d8fa090] Failed to execute task Dag 'vm_status_vim_a6a346d3-03c7-47e5-beb3-ecad663a7f17' could not be found; either it does not exist or it failed to parse.. 2024-06-18T22:37:16.389943686Z Traceback (most recent call last): 2024-06-18T22:37:16.389947631Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-06-18T22:37:16.389951140Z args.func(args) 2024-06-18T22:37:16.389956404Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-06-18T22:37:16.389960294Z return func(*args, **kwargs) 2024-06-18T22:37:16.389975649Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-06-18T22:37:16.389978756Z return f(*args, **kwargs) 2024-06-18T22:37:16.389981776Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-06-18T22:37:16.389984819Z dag = get_dag(args.subdir, args.dag_id) 2024-06-18T22:37:16.389988036Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-06-18T22:37:16.389991253Z raise AirflowException( 2024-06-18T22:37:16.389995626Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_a6a346d3-03c7-47e5-beb3-ecad663a7f17' could not be found; either it does not exist or it failed to parse. 2024-06-18T22:37:16.432499323Z [2024-06-18 22:37:16,431: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d8c3e25e-717f-493d-82ae-69d65d8fa090] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id d8c3e25e-717f-493d-82ae-69d65d8fa090') 2024-06-18T22:37:16.432551231Z Traceback (most recent call last): 2024-06-18T22:37:16.432561965Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-06-18T22:37:16.432570458Z R = retval = fun(*args, **kwargs) 2024-06-18T22:37:16.432578746Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-06-18T22:37:16.432587163Z return self.run(*args, **kwargs) 2024-06-18T22:37:16.432596101Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-06-18T22:37:16.432605975Z _execute_in_fork(command_to_exec, celery_task_id) 2024-06-18T22:37:16.432614366Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-06-18T22:37:16.432623366Z raise AirflowException(msg) 2024-06-18T22:37:16.432637552Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id d8c3e25e-717f-493d-82ae-69d65d8fa090 2024-06-18T22:38:00.356567538Z [2024-06-18 22:38:00,356: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bb046f8d-6ec9-4de8-b4df-b1e0aaa35a56] received 2024-06-18T22:38:00.358942771Z [2024-06-18 22:38:00,358: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[42f69590-9188-41ea-af93-37481d5fa2ed] received 2024-06-18T22:38:00.369115371Z [2024-06-18 22:38:00,368: INFO/ForkPoolWorker-16] [42f69590-9188-41ea-af93-37481d5fa2ed] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T22:38:00.370338617Z [2024-06-18 22:38:00,370: INFO/ForkPoolWorker-15] [bb046f8d-6ec9-4de8-b4df-b1e0aaa35a56] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-18T22:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-18T22:38:00.403043815Z [2024-06-18 22:38:00,402: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8944b03b-10a0-4a0e-b40f-47d96ac3bb06] received 2024-06-18T22:38:00.409531954Z [2024-06-18 22:38:00,409: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d0193d97-889b-4ff7-9b8c-195092de5736] received 2024-06-18T22:38:00.411949307Z [2024-06-18 22:38:00,411: INFO/ForkPoolWorker-1] [8944b03b-10a0-4a0e-b40f-47d96ac3bb06] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T22:38:00.426495826Z [2024-06-18 22:38:00,426: INFO/ForkPoolWorker-2] [d0193d97-889b-4ff7-9b8c-195092de5736] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T22:38:00.930867498Z [2024-06-18 22:38:00,927: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T22:38:00.978797217Z [2024-06-18 22:38:00,975: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T22:38:01.012337526Z [2024-06-18 22:38:01,008: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-18T22:38:01.031213641Z [2024-06-18 22:38:01,023: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T22:38:01.257215562Z [2024-06-18 22:38:01,256: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:38:01.372269835Z [2024-06-18 22:38:01,371: INFO/ForkPoolWorker-16] Getting SDNC list 2024-06-18T22:38:01.387888209Z [2024-06-18 22:38:01,387: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:38:01.441348802Z [2024-06-18 22:38:01,441: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T22:38:01.444500951Z [2024-06-18 22:38:01,444: INFO/ForkPoolWorker-16] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T22:38:01.444604616Z [2024-06-18 22:38:01,444: INFO/ForkPoolWorker-16] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T22:38:01.444666013Z [2024-06-18 22:38:01,444: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-06-18T22:38:01.444934797Z [2024-06-18 22:38:01,444: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T22:38:01.577245469Z [2024-06-18 22:38:01,576: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:38:01.903167909Z [2024-06-18 22:38:01,902: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bb046f8d-6ec9-4de8-b4df-b1e0aaa35a56] succeeded in 1.540863274000003s: None 2024-06-18T22:38:02.428564375Z [2024-06-18 22:38:02,428: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[42f69590-9188-41ea-af93-37481d5fa2ed] succeeded in 2.0674180270000306s: None 2024-06-18T22:38:02.540835972Z [2024-06-18 22:38:02,540: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-18T22:38:02.544147471Z [2024-06-18 22:38:02,543: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:38:02.572081265Z [2024-06-18 22:38:02,571: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-18T22:38:02.573496023Z [2024-06-18 22:38:02,573: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:38:02.573512658Z [2024-06-18 22:38:02,573: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:38:02.573634594Z [2024-06-18 22:38:02,573: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:38:02.573644473Z [2024-06-18 22:38:02,573: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-18T22:38:02.573908598Z [2024-06-18 22:38:02,573: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-06-18T22:38:02.573919356Z [2024-06-18 22:38:02,573: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:38:02.670413333Z [2024-06-18 22:38:02,670: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:38:02.710216654Z [2024-06-18 22:38:02,709: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-18T22:38:02.713473156Z [2024-06-18 22:38:02,713: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:38:02.737537599Z [2024-06-18 22:38:02,737: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T22:38:02.738660708Z [2024-06-18 22:38:02,738: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:38:02.738671952Z [2024-06-18 22:38:02,738: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:38:02.738751297Z [2024-06-18 22:38:02,738: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:38:02.738832216Z [2024-06-18 22:38:02,738: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-18T22:38:02.739032589Z [2024-06-18 22:38:02,738: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T22:38:02.739042669Z [2024-06-18 22:38:02,738: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:38:02.834926487Z [2024-06-18 22:38:02,834: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:38:04.483585644Z [2024-06-18 22:38:04,482: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8944b03b-10a0-4a0e-b40f-47d96ac3bb06] succeeded in 4.07858581000005s: None 2024-06-18T22:38:05.088530744Z [2024-06-18 22:38:05,087: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d0193d97-889b-4ff7-9b8c-195092de5736] succeeded in 4.675305931000139s: None 2024-06-18T22:39:00.812883064Z [2024-06-18 22:39:00,812: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[478d9e6a-dd74-4ce8-b341-1a310cc9283b] received 2024-06-18T22:39:00.829489496Z [2024-06-18 22:39:00,829: INFO/ForkPoolWorker-15] [478d9e6a-dd74-4ce8-b341-1a310cc9283b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T22:39:00.836389735Z [2024-06-18 22:39:00,836: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[510c6317-e2a5-48dd-8dfd-0ec87532f7cb] received 2024-06-18T22:39:00.842604703Z [2024-06-18 22:39:00,842: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f88ce0db-7d4b-4447-a64b-2d26d9d43341] received 2024-06-18T22:39:00.892901168Z [2024-06-18 22:39:00,892: INFO/ForkPoolWorker-16] [510c6317-e2a5-48dd-8dfd-0ec87532f7cb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T22:39:00.914994685Z [2024-06-18 22:39:00,914: INFO/ForkPoolWorker-1] [f88ce0db-7d4b-4447-a64b-2d26d9d43341] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T22:39:01.431171354Z [2024-06-18 22:39:01,426: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T22:39:01.604042678Z [2024-06-18 22:39:01,599: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T22:39:01.633175697Z [2024-06-18 22:39:01,628: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T22:39:01.808471573Z [2024-06-18 22:39:01,808: INFO/ForkPoolWorker-1] Getting SDNC list 2024-06-18T22:39:01.813062485Z [2024-06-18 22:39:01,812: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:39:01.897448626Z [2024-06-18 22:39:01,896: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T22:39:01.903052985Z [2024-06-18 22:39:01,902: INFO/ForkPoolWorker-1] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T22:39:01.903325367Z [2024-06-18 22:39:01,902: INFO/ForkPoolWorker-1] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T22:39:01.903475440Z [2024-06-18 22:39:01,903: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-06-18T22:39:01.903804132Z [2024-06-18 22:39:01,903: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T22:39:02.095303282Z [2024-06-18 22:39:02,095: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:39:03.274134254Z [2024-06-18 22:39:03,273: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f88ce0db-7d4b-4447-a64b-2d26d9d43341] succeeded in 2.3979569269999956s: None 2024-06-18T22:39:03.621120428Z [2024-06-18 22:39:03,620: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T22:39:03.624561901Z [2024-06-18 22:39:03,624: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:39:03.639866403Z [2024-06-18 22:39:03,639: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-18T22:39:03.643727346Z [2024-06-18 22:39:03,643: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:39:03.657451838Z [2024-06-18 22:39:03,657: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T22:39:03.664140221Z [2024-06-18 22:39:03,663: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:39:03.664310428Z [2024-06-18 22:39:03,664: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:39:03.664659976Z [2024-06-18 22:39:03,664: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:39:03.664837495Z [2024-06-18 22:39:03,664: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T22:39:03.665167404Z [2024-06-18 22:39:03,665: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T22:39:03.665681792Z [2024-06-18 22:39:03,665: INFO/ForkPoolWorker-15] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:39:03.692385360Z [2024-06-18 22:39:03,692: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T22:39:03.693644489Z [2024-06-18 22:39:03,693: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:39:03.693661334Z [2024-06-18 22:39:03,693: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:39:03.693788107Z [2024-06-18 22:39:03,693: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:39:03.693837365Z [2024-06-18 22:39:03,693: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-18T22:39:03.694043493Z [2024-06-18 22:39:03,693: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-18T22:39:03.694080087Z [2024-06-18 22:39:03,694: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:39:03.771145406Z [2024-06-18 22:39:03,770: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:39:03.810565313Z [2024-06-18 22:39:03,810: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:39:06.106546619Z [2024-06-18 22:39:06,105: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[478d9e6a-dd74-4ce8-b341-1a310cc9283b] succeeded in 5.289463348000027s: None 2024-06-18T22:39:07.482324540Z [2024-06-18 22:39:07,481: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[510c6317-e2a5-48dd-8dfd-0ec87532f7cb] succeeded in 6.602049132000047s: None 2024-06-18T22:40:01.014221218Z [2024-06-18 22:40:01,013: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0fc35adf-6ab9-4c75-afc6-cf0d175900ad] received 2024-06-18T22:40:01.016479850Z [2024-06-18 22:40:01,016: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ccac2930-33c4-45eb-83dc-090961161c85] received 2024-06-18T22:40:01.034266421Z [2024-06-18 22:40:01,034: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2ed67797-7fa4-4423-9bff-06d9c4cf4c0b] received 2024-06-18T22:40:01.053751929Z [2024-06-18 22:40:01,053: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d068268e-afa7-4680-98ce-2adb9e9c63f7] received 2024-06-18T22:40:01.054378076Z [2024-06-18 22:40:01,053: INFO/ForkPoolWorker-1] [2ed67797-7fa4-4423-9bff-06d9c4cf4c0b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T22:40:01.059298979Z [2024-06-18 22:40:01,053: INFO/ForkPoolWorker-16] [ccac2930-33c4-45eb-83dc-090961161c85] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-18T22:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-18T22:40:01.062589955Z [2024-06-18 22:40:01,062: INFO/ForkPoolWorker-15] [0fc35adf-6ab9-4c75-afc6-cf0d175900ad] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-18T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-18T22:40:01.068163514Z [2024-06-18 22:40:01,067: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[57e4b84c-8947-4856-b25f-b416067189a0] received 2024-06-18T22:40:01.087815846Z [2024-06-18 22:40:01,087: INFO/ForkPoolWorker-2] [d068268e-afa7-4680-98ce-2adb9e9c63f7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T22:40:01.159719397Z [2024-06-18 22:40:01,159: INFO/ForkPoolWorker-3] [57e4b84c-8947-4856-b25f-b416067189a0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T22:40:01.797752010Z [2024-06-18 22:40:01,788: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T22:40:01.813812011Z [2024-06-18 22:40:01,788: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T22:40:01.871631954Z [2024-06-18 22:40:01,867: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-18T22:40:02.034304672Z [2024-06-18 22:40:02,016: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T22:40:02.059049345Z [2024-06-18 22:40:02,052: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T22:40:02.634717329Z [2024-06-18 22:40:02,634: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:40:02.742949230Z [2024-06-18 22:40:02,742: INFO/ForkPoolWorker-1] Getting SDNC list 2024-06-18T22:40:02.748304331Z [2024-06-18 22:40:02,747: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:40:02.789500758Z [2024-06-18 22:40:02,789: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T22:40:02.791630554Z [2024-06-18 22:40:02,791: INFO/ForkPoolWorker-1] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T22:40:02.791888167Z [2024-06-18 22:40:02,791: INFO/ForkPoolWorker-1] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T22:40:02.792005653Z [2024-06-18 22:40:02,791: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-06-18T22:40:02.792272430Z [2024-06-18 22:40:02,792: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T22:40:02.983986237Z [2024-06-18 22:40:02,983: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:40:04.156812651Z [2024-06-18 22:40:04,156: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ccac2930-33c4-45eb-83dc-090961161c85] succeeded in 3.1367721379999693s: None 2024-06-18T22:40:04.376725218Z [2024-06-18 22:40:04,376: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2ed67797-7fa4-4423-9bff-06d9c4cf4c0b] succeeded in 3.338862949000031s: None 2024-06-18T22:40:04.793816773Z [2024-06-18 22:40:04,793: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-18T22:40:04.797737629Z [2024-06-18 22:40:04,796: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:40:04.825947154Z [2024-06-18 22:40:04,825: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-18T22:40:04.830109497Z [2024-06-18 22:40:04,829: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:40:04.830197390Z [2024-06-18 22:40:04,830: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:40:04.832930528Z [2024-06-18 22:40:04,830: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:40:04.833077666Z [2024-06-18 22:40:04,832: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-18T22:40:04.833459126Z [2024-06-18 22:40:04,833: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-06-18T22:40:04.833519941Z [2024-06-18 22:40:04,833: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:40:04.959736756Z [2024-06-18 22:40:04,959: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:40:05.200555848Z [2024-06-18 22:40:05,200: INFO/ForkPoolWorker-3] Getting VIM list 2024-06-18T22:40:05.204921240Z [2024-06-18 22:40:05,204: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:40:05.261780545Z [2024-06-18 22:40:05,261: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-06-18T22:40:05.265265089Z [2024-06-18 22:40:05,264: INFO/ForkPoolWorker-3] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:40:05.265348170Z [2024-06-18 22:40:05,265: INFO/ForkPoolWorker-3] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:40:05.265478186Z [2024-06-18 22:40:05,265: INFO/ForkPoolWorker-3] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:40:05.265603270Z [2024-06-18 22:40:05,265: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-06-18T22:40:05.265910534Z [2024-06-18 22:40:05,265: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T22:40:05.266055970Z [2024-06-18 22:40:05,265: INFO/ForkPoolWorker-3] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:40:05.301405535Z [2024-06-18 22:40:05,301: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T22:40:05.305066756Z [2024-06-18 22:40:05,304: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:40:05.354964607Z [2024-06-18 22:40:05,354: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T22:40:05.361523277Z [2024-06-18 22:40:05,361: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:40:05.361596964Z [2024-06-18 22:40:05,361: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:40:05.361904508Z [2024-06-18 22:40:05,361: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:40:05.362041246Z [2024-06-18 22:40:05,361: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T22:40:05.362490346Z [2024-06-18 22:40:05,362: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T22:40:05.362627752Z [2024-06-18 22:40:05,362: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:40:05.379549538Z [2024-06-18 22:40:05,379: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:40:05.452526757Z [2024-06-18 22:40:05,452: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:40:06.234088682Z [2024-06-18 22:40:06,233: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0fc35adf-6ab9-4c75-afc6-cf0d175900ad] succeeded in 5.216077359999872s: None 2024-06-18T22:40:06.376233901Z [2024-06-18 22:40:06,375: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[19f877eb-e422-4d9e-816c-d10c8ea24d4d] received 2024-06-18T22:40:06.384687182Z [2024-06-18 22:40:06,384: INFO/ForkPoolWorker-15] [19f877eb-e422-4d9e-816c-d10c8ea24d4d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'split_metrics', 'scheduled__2024-06-18T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-18T22:40:06.788917793Z [2024-06-18 22:40:06,785: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T22:40:07.153498747Z [2024-06-18 22:40:07,153: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[57e4b84c-8947-4856-b25f-b416067189a0] succeeded in 6.076389870000185s: None 2024-06-18T22:40:08.247569459Z [2024-06-18 22:40:08,247: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T22:40:08.251457578Z [2024-06-18 22:40:08,251: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:40:08.274156234Z [2024-06-18 22:40:08,273: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T22:40:08.275502124Z [2024-06-18 22:40:08,275: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:40:08.275986788Z [2024-06-18 22:40:08,275: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:40:08.275998284Z [2024-06-18 22:40:08,275: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:40:08.276002083Z [2024-06-18 22:40:08,275: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T22:40:08.276125030Z [2024-06-18 22:40:08,275: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T22:40:08.276358698Z [2024-06-18 22:40:08,276: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:40:08.360173361Z [2024-06-18 22:40:08,359: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:40:08.741461854Z [2024-06-18 22:40:08,740: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d068268e-afa7-4680-98ce-2adb9e9c63f7] succeeded in 7.6608197230000314s: None 2024-06-18T22:40:09.175402379Z [2024-06-18 22:40:09,174: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[19f877eb-e422-4d9e-816c-d10c8ea24d4d] succeeded in 2.796816243999956s: None 2024-06-18T22:40:10.184725560Z [2024-06-18 22:40:10,184: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ffd6a386-be20-4052-b6e6-76b54ad50106] received 2024-06-18T22:40:10.198571810Z [2024-06-18 22:40:10,198: INFO/ForkPoolWorker-15] [ffd6a386-be20-4052-b6e6-76b54ad50106] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'collect_metrics', 'scheduled__2024-06-18T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-18T22:40:10.508451737Z [2024-06-18 22:40:10,505: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T22:40:11.579409270Z [2024-06-18 22:40:11,579: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T22:40:11.582823774Z [2024-06-18 22:40:11,582: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:40:11.604588619Z [2024-06-18 22:40:11,604: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T22:40:11.606118951Z [2024-06-18 22:40:11,605: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:40:11.606258514Z [2024-06-18 22:40:11,606: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:40:11.606459179Z [2024-06-18 22:40:11,606: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:40:11.606602136Z [2024-06-18 22:40:11,606: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T22:40:11.606922263Z [2024-06-18 22:40:11,606: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T22:40:11.607166109Z [2024-06-18 22:40:11,606: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:40:11.713185006Z [2024-06-18 22:40:11,712: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:40:12.434852647Z [2024-06-18 22:40:12,434: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ffd6a386-be20-4052-b6e6-76b54ad50106] succeeded in 2.2486292720000165s: None 2024-06-18T22:40:12.617919941Z [2024-06-18 22:40:12,617: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d1f3c0f3-44a7-4d24-8e08-b726c7a962a4] received 2024-06-18T22:40:12.634246521Z [2024-06-18 22:40:12,633: INFO/ForkPoolWorker-15] [d1f3c0f3-44a7-4d24-8e08-b726c7a962a4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'send_prometheus', 'scheduled__2024-06-18T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-18T22:40:12.990921433Z [2024-06-18 22:40:12,987: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T22:40:14.237936318Z [2024-06-18 22:40:14,237: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T22:40:14.241555786Z [2024-06-18 22:40:14,241: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:40:14.264401312Z [2024-06-18 22:40:14,264: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T22:40:14.266130072Z [2024-06-18 22:40:14,265: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:40:14.266335017Z [2024-06-18 22:40:14,266: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:40:14.266620704Z [2024-06-18 22:40:14,266: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:40:14.266905425Z [2024-06-18 22:40:14,266: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T22:40:14.267504962Z [2024-06-18 22:40:14,267: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T22:40:14.267662191Z [2024-06-18 22:40:14,267: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:40:14.375850596Z [2024-06-18 22:40:14,375: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:40:15.014414489Z [2024-06-18 22:40:15,013: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d1f3c0f3-44a7-4d24-8e08-b726c7a962a4] succeeded in 2.3928142859999753s: None 2024-06-18T22:41:00.225814188Z [2024-06-18 22:41:00,225: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d7c9cef4-b149-4702-b4d1-ee49f0966d1f] received 2024-06-18T22:41:00.234337260Z [2024-06-18 22:41:00,234: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6c0a68b6-9e21-4221-8e90-6e1e4b108654] received 2024-06-18T22:41:00.239306966Z [2024-06-18 22:41:00,239: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b2fe3df9-c4fa-4749-9f4b-f7f1b919fc3a] received 2024-06-18T22:41:00.240553118Z [2024-06-18 22:41:00,240: INFO/ForkPoolWorker-15] [d7c9cef4-b149-4702-b4d1-ee49f0966d1f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T22:41:00.251389837Z [2024-06-18 22:41:00,251: INFO/ForkPoolWorker-1] [b2fe3df9-c4fa-4749-9f4b-f7f1b919fc3a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T22:41:00.255252511Z [2024-06-18 22:41:00,254: INFO/ForkPoolWorker-16] [6c0a68b6-9e21-4221-8e90-6e1e4b108654] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T22:41:00.562180808Z [2024-06-18 22:41:00,558: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T22:41:00.581912175Z [2024-06-18 22:41:00,577: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T22:41:00.583370285Z [2024-06-18 22:41:00,578: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T22:41:00.756983069Z [2024-06-18 22:41:00,756: INFO/ForkPoolWorker-15] Getting SDNC list 2024-06-18T22:41:00.764692741Z [2024-06-18 22:41:00,763: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:41:00.794184908Z [2024-06-18 22:41:00,793: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T22:41:00.795482434Z [2024-06-18 22:41:00,795: INFO/ForkPoolWorker-15] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T22:41:00.795853142Z [2024-06-18 22:41:00,795: INFO/ForkPoolWorker-15] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T22:41:00.795872478Z [2024-06-18 22:41:00,795: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-06-18T22:41:00.796230233Z [2024-06-18 22:41:00,796: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T22:41:00.917546010Z [2024-06-18 22:41:00,916: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:41:01.710367438Z [2024-06-18 22:41:01,709: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d7c9cef4-b149-4702-b4d1-ee49f0966d1f] succeeded in 1.4795356560000528s: None 2024-06-18T22:41:01.873864705Z [2024-06-18 22:41:01,873: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-18T22:41:01.877054774Z [2024-06-18 22:41:01,876: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:41:01.921485061Z [2024-06-18 22:41:01,921: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T22:41:01.923309713Z [2024-06-18 22:41:01,922: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:41:01.923326376Z [2024-06-18 22:41:01,923: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:41:01.923594908Z [2024-06-18 22:41:01,923: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:41:01.923675718Z [2024-06-18 22:41:01,923: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-18T22:41:01.924050713Z [2024-06-18 22:41:01,923: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T22:41:01.924135172Z [2024-06-18 22:41:01,923: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:41:02.027194613Z [2024-06-18 22:41:02,026: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:41:02.058598087Z [2024-06-18 22:41:02,058: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-18T22:41:02.062452320Z [2024-06-18 22:41:02,061: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:41:02.103836268Z [2024-06-18 22:41:02,103: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T22:41:02.105329306Z [2024-06-18 22:41:02,105: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:41:02.105345033Z [2024-06-18 22:41:02,105: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:41:02.105503862Z [2024-06-18 22:41:02,105: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:41:02.105515814Z [2024-06-18 22:41:02,105: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-18T22:41:02.105857131Z [2024-06-18 22:41:02,105: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-18T22:41:02.105899182Z [2024-06-18 22:41:02,105: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:41:02.238289250Z [2024-06-18 22:41:02,227: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:41:03.715586001Z [2024-06-18 22:41:03,714: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b2fe3df9-c4fa-4749-9f4b-f7f1b919fc3a] succeeded in 3.4732797949998258s: None 2024-06-18T22:41:04.298143432Z [2024-06-18 22:41:04,297: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6c0a68b6-9e21-4221-8e90-6e1e4b108654] succeeded in 4.057977749999964s: None 2024-06-18T22:42:00.586653139Z [2024-06-18 22:42:00,586: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f141fb73-14c3-46ed-925b-d1f47e48f482] received 2024-06-18T22:42:00.589793943Z [2024-06-18 22:42:00,589: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5e784dae-b2df-4e22-8003-2ba86dea1b1b] received 2024-06-18T22:42:00.591755265Z [2024-06-18 22:42:00,591: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4e6d5f92-194a-41a0-84a7-24dbf3231308] received 2024-06-18T22:42:00.593692349Z [2024-06-18 22:42:00,593: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[24c9a51b-4f59-44f5-8f0d-b8247d3f8c47] received 2024-06-18T22:42:00.615327629Z [2024-06-18 22:42:00,614: INFO/ForkPoolWorker-16] [5e784dae-b2df-4e22-8003-2ba86dea1b1b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T22:42:00.616821045Z [2024-06-18 22:42:00,616: INFO/ForkPoolWorker-1] [4e6d5f92-194a-41a0-84a7-24dbf3231308] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T22:42:00.617978093Z [2024-06-18 22:42:00,617: INFO/ForkPoolWorker-2] [24c9a51b-4f59-44f5-8f0d-b8247d3f8c47] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T22:42:00.621825883Z [2024-06-18 22:42:00,621: INFO/ForkPoolWorker-15] [f141fb73-14c3-46ed-925b-d1f47e48f482] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-18T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-18T22:42:00.979535130Z [2024-06-18 22:42:00,976: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T22:42:01.013143694Z [2024-06-18 22:42:01,009: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-18T22:42:01.061962144Z [2024-06-18 22:42:01,054: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T22:42:01.088732915Z [2024-06-18 22:42:01,084: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T22:42:01.177086210Z [2024-06-18 22:42:01,176: INFO/ForkPoolWorker-16] Getting SDNC list 2024-06-18T22:42:01.181415177Z [2024-06-18 22:42:01,180: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:42:01.226561502Z [2024-06-18 22:42:01,226: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T22:42:01.228770590Z [2024-06-18 22:42:01,228: INFO/ForkPoolWorker-16] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T22:42:01.229055291Z [2024-06-18 22:42:01,228: INFO/ForkPoolWorker-16] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T22:42:01.229337287Z [2024-06-18 22:42:01,228: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-06-18T22:42:01.230720119Z [2024-06-18 22:42:01,230: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T22:42:01.292552190Z [2024-06-18 22:42:01,292: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:42:01.356322417Z [2024-06-18 22:42:01,356: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:42:01.908856893Z [2024-06-18 22:42:01,908: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f141fb73-14c3-46ed-925b-d1f47e48f482] succeeded in 1.3168494690000898s: None 2024-06-18T22:42:01.999423175Z [2024-06-18 22:42:01,999: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5e784dae-b2df-4e22-8003-2ba86dea1b1b] succeeded in 1.4046145960001013s: None 2024-06-18T22:42:02.488216567Z [2024-06-18 22:42:02,487: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-18T22:42:02.492537483Z [2024-06-18 22:42:02,492: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:42:02.500992668Z [2024-06-18 22:42:02,500: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-18T22:42:02.504084946Z [2024-06-18 22:42:02,503: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:42:02.512188515Z [2024-06-18 22:42:02,511: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-18T22:42:02.514125101Z [2024-06-18 22:42:02,513: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:42:02.514808892Z [2024-06-18 22:42:02,514: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:42:02.515103512Z [2024-06-18 22:42:02,514: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:42:02.515238151Z [2024-06-18 22:42:02,515: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-18T22:42:02.515923415Z [2024-06-18 22:42:02,515: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-06-18T22:42:02.516081471Z [2024-06-18 22:42:02,515: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:42:02.526251093Z [2024-06-18 22:42:02,526: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T22:42:02.527637035Z [2024-06-18 22:42:02,527: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:42:02.527706237Z [2024-06-18 22:42:02,527: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:42:02.527928555Z [2024-06-18 22:42:02,527: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:42:02.527963785Z [2024-06-18 22:42:02,527: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-18T22:42:02.528221581Z [2024-06-18 22:42:02,528: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T22:42:02.528266568Z [2024-06-18 22:42:02,528: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:42:02.632216063Z [2024-06-18 22:42:02,631: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:42:02.635677948Z [2024-06-18 22:42:02,635: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:42:04.536328873Z [2024-06-18 22:42:04,535: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4e6d5f92-194a-41a0-84a7-24dbf3231308] succeeded in 3.938365669999939s: None 2024-06-18T22:42:05.341686423Z [2024-06-18 22:42:05,341: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[24c9a51b-4f59-44f5-8f0d-b8247d3f8c47] succeeded in 4.740678253999931s: None 2024-06-18T22:43:01.004320044Z [2024-06-18 22:43:01,003: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1d9bf455-ba92-4a4b-b4d3-05e6be5d50c0] received 2024-06-18T22:43:01.007511366Z [2024-06-18 22:43:01,007: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9c61d09a-b056-41dc-852b-60f3f3e2f4a3] received 2024-06-18T22:43:01.010406241Z [2024-06-18 22:43:01,010: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5ef3285c-60d9-4df8-ac59-d7c8f9086ea8] received 2024-06-18T22:43:01.022791252Z [2024-06-18 22:43:01,022: INFO/ForkPoolWorker-1] [5ef3285c-60d9-4df8-ac59-d7c8f9086ea8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T22:43:01.027279601Z [2024-06-18 22:43:01,026: INFO/ForkPoolWorker-15] [1d9bf455-ba92-4a4b-b4d3-05e6be5d50c0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T22:43:01.029325991Z [2024-06-18 22:43:01,028: INFO/ForkPoolWorker-16] [9c61d09a-b056-41dc-852b-60f3f3e2f4a3] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T22:43:01.337662571Z [2024-06-18 22:43:01,330: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T22:43:01.371782417Z [2024-06-18 22:43:01,367: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T22:43:01.383018448Z [2024-06-18 22:43:01,378: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T22:43:01.520288588Z [2024-06-18 22:43:01,519: INFO/ForkPoolWorker-16] Getting SDNC list 2024-06-18T22:43:01.527822454Z [2024-06-18 22:43:01,527: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:43:01.558331457Z [2024-06-18 22:43:01,558: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T22:43:01.559966355Z [2024-06-18 22:43:01,559: INFO/ForkPoolWorker-16] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T22:43:01.560228433Z [2024-06-18 22:43:01,559: INFO/ForkPoolWorker-16] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T22:43:01.560388680Z [2024-06-18 22:43:01,560: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-06-18T22:43:01.561048567Z [2024-06-18 22:43:01,560: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T22:43:01.677091736Z [2024-06-18 22:43:01,676: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:43:02.717136065Z [2024-06-18 22:43:02,716: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9c61d09a-b056-41dc-852b-60f3f3e2f4a3] succeeded in 1.7057305470000301s: None 2024-06-18T22:43:02.988090248Z [2024-06-18 22:43:02,987: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T22:43:02.991844807Z [2024-06-18 22:43:02,991: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:43:03.029068751Z [2024-06-18 22:43:03,028: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T22:43:03.031267754Z [2024-06-18 22:43:03,030: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:43:03.031446339Z [2024-06-18 22:43:03,031: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:43:03.031604255Z [2024-06-18 22:43:03,031: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:43:03.031774080Z [2024-06-18 22:43:03,031: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T22:43:03.032129249Z [2024-06-18 22:43:03,031: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-06-18T22:43:03.032376408Z [2024-06-18 22:43:03,032: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:43:03.079420971Z [2024-06-18 22:43:03,078: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-18T22:43:03.083117201Z [2024-06-18 22:43:03,082: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:43:03.111042868Z [2024-06-18 22:43:03,110: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T22:43:03.112972713Z [2024-06-18 22:43:03,112: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:43:03.113130266Z [2024-06-18 22:43:03,112: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:43:03.113381089Z [2024-06-18 22:43:03,113: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:43:03.113521859Z [2024-06-18 22:43:03,113: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-18T22:43:03.114306334Z [2024-06-18 22:43:03,114: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T22:43:03.114377746Z [2024-06-18 22:43:03,114: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:43:03.147821558Z [2024-06-18 22:43:03,147: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:43:03.229880226Z [2024-06-18 22:43:03,229: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:43:05.016830062Z [2024-06-18 22:43:05,014: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5ef3285c-60d9-4df8-ac59-d7c8f9086ea8] succeeded in 4.0027974869999525s: None 2024-06-18T22:43:05.531482686Z [2024-06-18 22:43:05,530: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1d9bf455-ba92-4a4b-b4d3-05e6be5d50c0] succeeded in 4.523934519000022s: None 2024-06-18T22:44:01.297584955Z [2024-06-18 22:44:01,296: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b52bf3e1-2338-45a0-a040-b69e1c3c71d9] received 2024-06-18T22:44:01.311058546Z [2024-06-18 22:44:01,310: INFO/ForkPoolWorker-15] [b52bf3e1-2338-45a0-a040-b69e1c3c71d9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T22:44:01.316267229Z [2024-06-18 22:44:01,316: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[579ce86e-2e2d-4d43-9334-ebab4e3668c3] received 2024-06-18T22:44:01.324036741Z [2024-06-18 22:44:01,323: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[13002687-36bd-4387-9605-bb628d037b22] received 2024-06-18T22:44:01.342948547Z [2024-06-18 22:44:01,342: INFO/ForkPoolWorker-1] [13002687-36bd-4387-9605-bb628d037b22] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T22:44:01.346109940Z [2024-06-18 22:44:01,344: INFO/ForkPoolWorker-16] [579ce86e-2e2d-4d43-9334-ebab4e3668c3] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-18T22:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-18T22:44:01.346218437Z [2024-06-18 22:44:01,343: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ac4fc1ab-3f03-45ef-b601-36c10b619d3e] received 2024-06-18T22:44:01.369097464Z [2024-06-18 22:44:01,368: INFO/ForkPoolWorker-2] [ac4fc1ab-3f03-45ef-b601-36c10b619d3e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T22:44:01.810715468Z [2024-06-18 22:44:01,806: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T22:44:01.872802983Z [2024-06-18 22:44:01,867: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-18T22:44:01.894532194Z [2024-06-18 22:44:01,883: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T22:44:01.943315919Z [2024-06-18 22:44:01,933: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T22:44:02.140097865Z [2024-06-18 22:44:02,139: INFO/ForkPoolWorker-15] Getting SDNC list 2024-06-18T22:44:02.148259118Z [2024-06-18 22:44:02,143: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:44:02.189971970Z [2024-06-18 22:44:02,189: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T22:44:02.193580555Z [2024-06-18 22:44:02,193: INFO/ForkPoolWorker-15] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T22:44:02.194335499Z [2024-06-18 22:44:02,193: INFO/ForkPoolWorker-15] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T22:44:02.195511756Z [2024-06-18 22:44:02,194: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-06-18T22:44:02.196251323Z [2024-06-18 22:44:02,196: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T22:44:02.228168684Z [2024-06-18 22:44:02,226: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:44:02.507348177Z [2024-06-18 22:44:02,507: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:44:02.954198634Z [2024-06-18 22:44:02,952: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[579ce86e-2e2d-4d43-9334-ebab4e3668c3] succeeded in 1.6319978910000827s: None 2024-06-18T22:44:03.272252515Z [2024-06-18 22:44:03,271: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b52bf3e1-2338-45a0-a040-b69e1c3c71d9] succeeded in 1.9702233990001332s: None 2024-06-18T22:44:03.566479585Z [2024-06-18 22:44:03,566: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-18T22:44:03.569707298Z [2024-06-18 22:44:03,569: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:44:03.597705991Z [2024-06-18 22:44:03,597: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-18T22:44:03.598994170Z [2024-06-18 22:44:03,598: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:44:03.599052498Z [2024-06-18 22:44:03,598: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:44:03.599230575Z [2024-06-18 22:44:03,599: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:44:03.599319223Z [2024-06-18 22:44:03,599: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-18T22:44:03.599637332Z [2024-06-18 22:44:03,599: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T22:44:03.599757155Z [2024-06-18 22:44:03,599: INFO/ForkPoolWorker-2] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:44:03.659386319Z [2024-06-18 22:44:03,658: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-18T22:44:03.662575910Z [2024-06-18 22:44:03,662: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:44:03.675559854Z [2024-06-18 22:44:03,674: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:44:03.687620800Z [2024-06-18 22:44:03,687: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T22:44:03.691549842Z [2024-06-18 22:44:03,691: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:44:03.691563197Z [2024-06-18 22:44:03,691: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:44:03.691697615Z [2024-06-18 22:44:03,691: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:44:03.691760477Z [2024-06-18 22:44:03,691: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-18T22:44:03.692146244Z [2024-06-18 22:44:03,691: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-06-18T22:44:03.692203632Z [2024-06-18 22:44:03,692: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:44:03.790267589Z [2024-06-18 22:44:03,789: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:44:05.698470972Z [2024-06-18 22:44:05,697: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[ac4fc1ab-3f03-45ef-b601-36c10b619d3e] succeeded in 4.346883043000162s: None 2024-06-18T22:44:06.596886958Z [2024-06-18 22:44:06,596: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[13002687-36bd-4387-9605-bb628d037b22] succeeded in 5.2700025010001355s: None 2024-06-18T22:45:00.639002715Z [2024-06-18 22:45:00,638: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2504060d-e024-4d8f-a5a0-04c062907499] received 2024-06-18T22:45:00.644538709Z [2024-06-18 22:45:00,644: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a7726c7b-4713-4af6-85f6-bbdc6effb8d8] received 2024-06-18T22:45:00.655696592Z [2024-06-18 22:45:00,655: INFO/ForkPoolWorker-15] [2504060d-e024-4d8f-a5a0-04c062907499] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-18T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-18T22:45:00.659475091Z [2024-06-18 22:45:00,659: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d01086bc-2d28-4ac1-b391-5582dc8bf2a5] received 2024-06-18T22:45:00.663238801Z [2024-06-18 22:45:00,662: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[56437701-ec38-480e-9395-dfda3284f930] received 2024-06-18T22:45:00.664235743Z [2024-06-18 22:45:00,663: INFO/ForkPoolWorker-16] [a7726c7b-4713-4af6-85f6-bbdc6effb8d8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T22:45:00.679405095Z [2024-06-18 22:45:00,679: INFO/ForkPoolWorker-2] [56437701-ec38-480e-9395-dfda3284f930] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T22:45:00.687830501Z [2024-06-18 22:45:00,684: INFO/ForkPoolWorker-1] [d01086bc-2d28-4ac1-b391-5582dc8bf2a5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T22:45:01.107377082Z [2024-06-18 22:45:01,103: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T22:45:01.133571450Z [2024-06-18 22:45:01,128: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T22:45:01.175139448Z [2024-06-18 22:45:01,171: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T22:45:01.290931719Z [2024-06-18 22:45:01,286: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T22:45:01.301005927Z [2024-06-18 22:45:01,300: INFO/ForkPoolWorker-2] Getting SDNC list 2024-06-18T22:45:01.305926115Z [2024-06-18 22:45:01,305: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:45:01.358320523Z [2024-06-18 22:45:01,357: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-18T22:45:01.359166160Z [2024-06-18 22:45:01,358: INFO/ForkPoolWorker-2] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T22:45:01.359335984Z [2024-06-18 22:45:01,359: INFO/ForkPoolWorker-2] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T22:45:01.359461710Z [2024-06-18 22:45:01,359: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-06-18T22:45:01.359802011Z [2024-06-18 22:45:01,359: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T22:45:01.492730448Z [2024-06-18 22:45:01,492: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:45:02.243919302Z [2024-06-18 22:45:02,243: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[56437701-ec38-480e-9395-dfda3284f930] succeeded in 1.577404070000057s: None 2024-06-18T22:45:02.921371269Z [2024-06-18 22:45:02,920: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-18T22:45:02.925930297Z [2024-06-18 22:45:02,925: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:45:02.953952264Z [2024-06-18 22:45:02,953: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T22:45:02.956318626Z [2024-06-18 22:45:02,956: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:45:02.957262637Z [2024-06-18 22:45:02,956: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:45:02.957290297Z [2024-06-18 22:45:02,956: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:45:02.957294693Z [2024-06-18 22:45:02,956: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-18T22:45:02.957298256Z [2024-06-18 22:45:02,956: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T22:45:02.957309165Z [2024-06-18 22:45:02,957: INFO/ForkPoolWorker-16] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:45:02.959086026Z [2024-06-18 22:45:02,958: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T22:45:02.970354233Z [2024-06-18 22:45:02,967: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:45:03.022958709Z [2024-06-18 22:45:03,022: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-18T22:45:03.026251572Z [2024-06-18 22:45:03,025: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:45:03.028742638Z [2024-06-18 22:45:03,028: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T22:45:03.032823909Z [2024-06-18 22:45:03,032: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:45:03.032864630Z [2024-06-18 22:45:03,032: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:45:03.032959506Z [2024-06-18 22:45:03,032: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:45:03.032997435Z [2024-06-18 22:45:03,032: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T22:45:03.033219866Z [2024-06-18 22:45:03,033: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T22:45:03.033251204Z [2024-06-18 22:45:03,033: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:45:03.058369435Z [2024-06-18 22:45:03,058: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T22:45:03.060916768Z [2024-06-18 22:45:03,060: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:45:03.060931213Z [2024-06-18 22:45:03,060: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:45:03.061035248Z [2024-06-18 22:45:03,060: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:45:03.061073258Z [2024-06-18 22:45:03,060: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-18T22:45:03.061355040Z [2024-06-18 22:45:03,061: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-06-18T22:45:03.061397666Z [2024-06-18 22:45:03,061: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:45:03.065730142Z [2024-06-18 22:45:03,065: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:45:03.136527357Z [2024-06-18 22:45:03,136: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:45:03.203697094Z [2024-06-18 22:45:03,203: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:45:03.992989297Z [2024-06-18 22:45:03,990: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2504060d-e024-4d8f-a5a0-04c062907499] succeeded in 3.349915772000031s: None 2024-06-18T22:45:04.081570887Z [2024-06-18 22:45:04,081: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9d195185-988c-4918-a806-06e86e3c23c0] received 2024-06-18T22:45:04.114910992Z [2024-06-18 22:45:04,110: INFO/ForkPoolWorker-15] [9d195185-988c-4918-a806-06e86e3c23c0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'split_metrics', 'scheduled__2024-06-18T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-18T22:45:04.493253997Z [2024-06-18 22:45:04,489: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T22:45:04.781036767Z [2024-06-18 22:45:04,778: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a7726c7b-4713-4af6-85f6-bbdc6effb8d8] succeeded in 4.131545896000034s: None 2024-06-18T22:45:05.775529156Z [2024-06-18 22:45:05,775: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d01086bc-2d28-4ac1-b391-5582dc8bf2a5] succeeded in 5.1127603039999485s: None 2024-06-18T22:45:05.842533873Z [2024-06-18 22:45:05,842: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T22:45:05.845994013Z [2024-06-18 22:45:05,845: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:45:05.875143404Z [2024-06-18 22:45:05,874: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T22:45:05.876900679Z [2024-06-18 22:45:05,876: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:45:05.877149098Z [2024-06-18 22:45:05,876: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:45:05.877548342Z [2024-06-18 22:45:05,877: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:45:05.877561177Z [2024-06-18 22:45:05,877: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T22:45:05.877949474Z [2024-06-18 22:45:05,877: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T22:45:05.878195737Z [2024-06-18 22:45:05,878: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:45:05.975594216Z [2024-06-18 22:45:05,975: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:45:06.640150981Z [2024-06-18 22:45:06,639: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9d195185-988c-4918-a806-06e86e3c23c0] succeeded in 2.5525282169999173s: None 2024-06-18T22:45:07.693063435Z [2024-06-18 22:45:07,689: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e7bdc74b-84cc-45c7-8f94-f09ffd6522b4] received 2024-06-18T22:45:07.701202682Z [2024-06-18 22:45:07,700: INFO/ForkPoolWorker-15] [e7bdc74b-84cc-45c7-8f94-f09ffd6522b4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'collect_metrics', 'scheduled__2024-06-18T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-18T22:45:08.008723650Z [2024-06-18 22:45:08,005: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T22:45:09.111879822Z [2024-06-18 22:45:09,111: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T22:45:09.115486163Z [2024-06-18 22:45:09,115: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:45:09.139099568Z [2024-06-18 22:45:09,138: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T22:45:09.142028572Z [2024-06-18 22:45:09,141: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:45:09.142114614Z [2024-06-18 22:45:09,141: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:45:09.142353632Z [2024-06-18 22:45:09,142: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:45:09.142661692Z [2024-06-18 22:45:09,142: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T22:45:09.143097023Z [2024-06-18 22:45:09,142: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T22:45:09.143306591Z [2024-06-18 22:45:09,143: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:45:09.297472630Z [2024-06-18 22:45:09,297: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:45:09.919325118Z [2024-06-18 22:45:09,918: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e7bdc74b-84cc-45c7-8f94-f09ffd6522b4] succeeded in 2.2266551370000798s: None 2024-06-18T22:45:10.559943000Z [2024-06-18 22:45:10,558: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d84eb837-5e5f-4261-985a-1208e17d596a] received 2024-06-18T22:45:10.577597459Z [2024-06-18 22:45:10,577: INFO/ForkPoolWorker-15] [d84eb837-5e5f-4261-985a-1208e17d596a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'send_prometheus', 'scheduled__2024-06-18T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-18T22:45:10.885299550Z [2024-06-18 22:45:10,881: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T22:45:12.014303895Z [2024-06-18 22:45:12,013: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T22:45:12.017805537Z [2024-06-18 22:45:12,017: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:45:12.040014453Z [2024-06-18 22:45:12,039: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T22:45:12.041361756Z [2024-06-18 22:45:12,041: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:45:12.041517287Z [2024-06-18 22:45:12,041: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:45:12.041747151Z [2024-06-18 22:45:12,041: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:45:12.041883341Z [2024-06-18 22:45:12,041: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T22:45:12.042255831Z [2024-06-18 22:45:12,042: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T22:45:12.042323041Z [2024-06-18 22:45:12,042: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:45:12.145758269Z [2024-06-18 22:45:12,145: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:45:12.891441933Z [2024-06-18 22:45:12,890: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d84eb837-5e5f-4261-985a-1208e17d596a] succeeded in 2.329019349999953s: None 2024-06-18T22:46:00.334188731Z [2024-06-18 22:46:00,333: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fdb4f209-550b-440a-9152-93f91ea7f0be] received 2024-06-18T22:46:00.339030930Z [2024-06-18 22:46:00,338: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e996ab18-7177-4eae-a5e7-55ac33d45c07] received 2024-06-18T22:46:00.343067001Z [2024-06-18 22:46:00,342: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2a5fcc13-5791-40db-b841-da4b5a0dc217] received 2024-06-18T22:46:00.346388450Z [2024-06-18 22:46:00,346: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f7840f91-63f7-4a8c-a21f-82604650dc72] received 2024-06-18T22:46:00.370663403Z [2024-06-18 22:46:00,369: INFO/ForkPoolWorker-2] [f7840f91-63f7-4a8c-a21f-82604650dc72] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T22:46:00.371259352Z [2024-06-18 22:46:00,370: INFO/ForkPoolWorker-15] [fdb4f209-550b-440a-9152-93f91ea7f0be] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-18T22:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-18T22:46:00.371811540Z [2024-06-18 22:46:00,371: INFO/ForkPoolWorker-1] [2a5fcc13-5791-40db-b841-da4b5a0dc217] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T22:46:00.391016730Z [2024-06-18 22:46:00,380: INFO/ForkPoolWorker-16] [e996ab18-7177-4eae-a5e7-55ac33d45c07] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T22:46:00.946099144Z [2024-06-18 22:46:00,930: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-18T22:46:01.048635371Z [2024-06-18 22:46:01,044: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T22:46:01.075133423Z [2024-06-18 22:46:01,064: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T22:46:01.241052239Z [2024-06-18 22:46:01,240: INFO/ForkPoolWorker-1] Getting SDNC list 2024-06-18T22:46:01.246470530Z [2024-06-18 22:46:01,246: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:46:01.258823336Z [2024-06-18 22:46:01,254: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T22:46:01.291375343Z [2024-06-18 22:46:01,291: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T22:46:01.297842014Z [2024-06-18 22:46:01,294: INFO/ForkPoolWorker-1] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T22:46:01.298534266Z [2024-06-18 22:46:01,298: INFO/ForkPoolWorker-1] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T22:46:01.298750531Z [2024-06-18 22:46:01,298: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-06-18T22:46:01.299206989Z [2024-06-18 22:46:01,299: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T22:46:01.470751077Z [2024-06-18 22:46:01,470: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:46:01.499639305Z [2024-06-18 22:46:01,499: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:46:02.107795235Z [2024-06-18 22:46:02,107: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2a5fcc13-5791-40db-b841-da4b5a0dc217] succeeded in 1.7566549319999467s: None 2024-06-18T22:46:02.118666215Z [2024-06-18 22:46:02,118: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fdb4f209-550b-440a-9152-93f91ea7f0be] succeeded in 1.7811005360001673s: None 2024-06-18T22:46:02.868452063Z [2024-06-18 22:46:02,867: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-18T22:46:02.872013376Z [2024-06-18 22:46:02,871: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:46:02.902218345Z [2024-06-18 22:46:02,901: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-18T22:46:02.905995580Z [2024-06-18 22:46:02,905: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:46:02.925071628Z [2024-06-18 22:46:02,924: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-18T22:46:02.926900993Z [2024-06-18 22:46:02,926: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:46:02.927026995Z [2024-06-18 22:46:02,926: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:46:02.927254848Z [2024-06-18 22:46:02,927: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:46:02.927441334Z [2024-06-18 22:46:02,927: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-18T22:46:02.928016681Z [2024-06-18 22:46:02,927: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-06-18T22:46:02.928183709Z [2024-06-18 22:46:02,928: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:46:02.940303230Z [2024-06-18 22:46:02,940: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T22:46:02.945152858Z [2024-06-18 22:46:02,944: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:46:02.945176979Z [2024-06-18 22:46:02,944: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:46:02.945440273Z [2024-06-18 22:46:02,945: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:46:02.945453962Z [2024-06-18 22:46:02,945: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-18T22:46:02.945788375Z [2024-06-18 22:46:02,945: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T22:46:02.945825775Z [2024-06-18 22:46:02,945: INFO/ForkPoolWorker-16] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:46:03.036047733Z [2024-06-18 22:46:03,035: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:46:03.036255281Z [2024-06-18 22:46:03,035: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:46:04.770133555Z [2024-06-18 22:46:04,769: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[f7840f91-63f7-4a8c-a21f-82604650dc72] succeeded in 4.417831666999973s: None 2024-06-18T22:46:04.865623379Z [2024-06-18 22:46:04,864: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e996ab18-7177-4eae-a5e7-55ac33d45c07] succeeded in 4.517872867999813s: None 2024-06-18T22:47:00.294627618Z [2024-06-18 22:47:00,294: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e6ef3a49-87df-436c-bd77-e95c557f5e3f] received 2024-06-18T22:47:00.296112297Z [2024-06-18 22:47:00,295: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0eae108f-3f0b-4fae-8664-ca5891321b67] received 2024-06-18T22:47:00.306726019Z [2024-06-18 22:47:00,306: INFO/ForkPoolWorker-15] [e6ef3a49-87df-436c-bd77-e95c557f5e3f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T22:47:00.313470563Z [2024-06-18 22:47:00,313: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aade4b17-13ea-4ae5-9652-7716839d21e7] received 2024-06-18T22:47:00.314958666Z [2024-06-18 22:47:00,314: INFO/ForkPoolWorker-16] [0eae108f-3f0b-4fae-8664-ca5891321b67] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T22:47:00.332184598Z [2024-06-18 22:47:00,331: INFO/ForkPoolWorker-1] [aade4b17-13ea-4ae5-9652-7716839d21e7] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T22:47:00.591273800Z [2024-06-18 22:47:00,587: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T22:47:00.612691881Z [2024-06-18 22:47:00,609: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T22:47:00.641156911Z [2024-06-18 22:47:00,637: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T22:47:00.805637342Z [2024-06-18 22:47:00,805: INFO/ForkPoolWorker-1] Getting SDNC list 2024-06-18T22:47:00.809937475Z [2024-06-18 22:47:00,809: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:47:00.837375162Z [2024-06-18 22:47:00,837: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T22:47:00.838623783Z [2024-06-18 22:47:00,838: INFO/ForkPoolWorker-1] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T22:47:00.838786820Z [2024-06-18 22:47:00,838: INFO/ForkPoolWorker-1] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T22:47:00.838924095Z [2024-06-18 22:47:00,838: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-06-18T22:47:00.839239977Z [2024-06-18 22:47:00,839: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T22:47:00.935457580Z [2024-06-18 22:47:00,935: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:47:01.556635387Z [2024-06-18 22:47:01,556: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[aade4b17-13ea-4ae5-9652-7716839d21e7] succeeded in 1.2395893660000183s: None 2024-06-18T22:47:01.959751891Z [2024-06-18 22:47:01,959: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-18T22:47:01.975434260Z [2024-06-18 22:47:01,974: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:47:02.012255212Z [2024-06-18 22:47:02,012: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T22:47:02.013451230Z [2024-06-18 22:47:02,013: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:47:02.013665834Z [2024-06-18 22:47:02,013: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:47:02.013831954Z [2024-06-18 22:47:02,013: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:47:02.013866280Z [2024-06-18 22:47:02,013: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-18T22:47:02.014109620Z [2024-06-18 22:47:02,013: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-18T22:47:02.014122722Z [2024-06-18 22:47:02,014: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:47:02.043610619Z [2024-06-18 22:47:02,043: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T22:47:02.046966202Z [2024-06-18 22:47:02,046: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:47:02.062185783Z [2024-06-18 22:47:02,061: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T22:47:02.063331712Z [2024-06-18 22:47:02,063: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:47:02.063351430Z [2024-06-18 22:47:02,063: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:47:02.063558748Z [2024-06-18 22:47:02,063: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:47:02.063575375Z [2024-06-18 22:47:02,063: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T22:47:02.063783470Z [2024-06-18 22:47:02,063: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T22:47:02.063832279Z [2024-06-18 22:47:02,063: INFO/ForkPoolWorker-15] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:47:02.133382905Z [2024-06-18 22:47:02,133: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:47:02.152540292Z [2024-06-18 22:47:02,152: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:47:03.867801314Z [2024-06-18 22:47:03,866: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e6ef3a49-87df-436c-bd77-e95c557f5e3f] succeeded in 3.5693906649999008s: None 2024-06-18T22:47:04.446504597Z [2024-06-18 22:47:04,445: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0eae108f-3f0b-4fae-8664-ca5891321b67] succeeded in 4.139454981999961s: None 2024-06-18T22:48:01.011571728Z [2024-06-18 22:48:01,009: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9906d4df-c543-485f-a919-d61de336864e] received 2024-06-18T22:48:01.016738275Z [2024-06-18 22:48:01,016: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[35306d78-1dc4-4e20-b663-040c79828b65] received 2024-06-18T22:48:01.020184039Z [2024-06-18 22:48:01,019: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f7e2f18b-78b3-4bbc-83d8-cd2f9f545bd2] received 2024-06-18T22:48:01.022372413Z [2024-06-18 22:48:01,022: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1c8a99c3-efce-4d80-ba4f-0c73469409b2] received 2024-06-18T22:48:01.022874904Z [2024-06-18 22:48:01,022: INFO/ForkPoolWorker-15] [9906d4df-c543-485f-a919-d61de336864e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-18T22:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-18T22:48:01.062367710Z [2024-06-18 22:48:01,061: INFO/ForkPoolWorker-2] [1c8a99c3-efce-4d80-ba4f-0c73469409b2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T22:48:01.079304333Z [2024-06-18 22:48:01,078: INFO/ForkPoolWorker-1] [f7e2f18b-78b3-4bbc-83d8-cd2f9f545bd2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T22:48:01.096551181Z [2024-06-18 22:48:01,095: INFO/ForkPoolWorker-16] [35306d78-1dc4-4e20-b663-040c79828b65] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T22:48:01.555090543Z [2024-06-18 22:48:01,549: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-18T22:48:01.578235886Z [2024-06-18 22:48:01,573: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T22:48:01.622990434Z [2024-06-18 22:48:01,616: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T22:48:01.634907993Z [2024-06-18 22:48:01,626: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T22:48:01.845957002Z [2024-06-18 22:48:01,845: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:48:01.928260048Z [2024-06-18 22:48:01,927: INFO/ForkPoolWorker-16] Getting SDNC list 2024-06-18T22:48:01.934831782Z [2024-06-18 22:48:01,931: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:48:02.006173761Z [2024-06-18 22:48:02,005: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T22:48:02.009271244Z [2024-06-18 22:48:02,009: INFO/ForkPoolWorker-16] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T22:48:02.009293732Z [2024-06-18 22:48:02,009: INFO/ForkPoolWorker-16] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T22:48:02.009341132Z [2024-06-18 22:48:02,009: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-06-18T22:48:02.009553203Z [2024-06-18 22:48:02,009: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T22:48:02.170419511Z [2024-06-18 22:48:02,170: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:48:02.695759293Z [2024-06-18 22:48:02,695: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9906d4df-c543-485f-a919-d61de336864e] succeeded in 1.6820639780003148s: None 2024-06-18T22:48:02.982285829Z [2024-06-18 22:48:02,981: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[35306d78-1dc4-4e20-b663-040c79828b65] succeeded in 1.949954696000077s: None 2024-06-18T22:48:03.596028065Z [2024-06-18 22:48:03,594: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-18T22:48:03.603046602Z [2024-06-18 22:48:03,601: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:48:03.659885423Z [2024-06-18 22:48:03,659: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-18T22:48:03.665936330Z [2024-06-18 22:48:03,665: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:48:03.665970579Z [2024-06-18 22:48:03,665: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:48:03.666076552Z [2024-06-18 22:48:03,665: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:48:03.666090227Z [2024-06-18 22:48:03,666: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-18T22:48:03.667214299Z [2024-06-18 22:48:03,666: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T22:48:03.667232051Z [2024-06-18 22:48:03,666: INFO/ForkPoolWorker-2] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:48:03.829870165Z [2024-06-18 22:48:03,829: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-18T22:48:03.833997232Z [2024-06-18 22:48:03,833: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:48:03.858353946Z [2024-06-18 22:48:03,858: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T22:48:03.859286493Z [2024-06-18 22:48:03,859: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:48:03.863805269Z [2024-06-18 22:48:03,859: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:48:03.863834264Z [2024-06-18 22:48:03,860: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:48:03.863840215Z [2024-06-18 22:48:03,860: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:48:03.863845409Z [2024-06-18 22:48:03,860: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-18T22:48:03.863849718Z [2024-06-18 22:48:03,861: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-06-18T22:48:03.863853944Z [2024-06-18 22:48:03,861: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:48:03.986845332Z [2024-06-18 22:48:03,986: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:48:05.611643082Z [2024-06-18 22:48:05,611: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[1c8a99c3-efce-4d80-ba4f-0c73469409b2] succeeded in 4.573992124999677s: None 2024-06-18T22:48:06.091500999Z [2024-06-18 22:48:06,091: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f7e2f18b-78b3-4bbc-83d8-cd2f9f545bd2] succeeded in 5.066338172999622s: None 2024-06-18T22:48:40.587846483Z [2024-06-18 22:48:40,587: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e2468b96-2fa2-448e-b245-e2b122f0bd5e] received 2024-06-18T22:48:40.605182094Z [2024-06-18 22:48:40,604: INFO/ForkPoolWorker-15] [e2468b96-2fa2-448e-b245-e2b122f0bd5e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_d8ab743c-7a82-4d12-b942-27539d176b78', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T22:48:40.910738870Z [2024-06-18 22:48:40,906: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T22:48:41.696892289Z [2024-06-18 22:48:41,696: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f113e32f-e3ba-40a2-a24c-e1b15b5b278c] received 2024-06-18T22:48:41.714501130Z [2024-06-18 22:48:41,713: INFO/ForkPoolWorker-16] [f113e32f-e3ba-40a2-a24c-e1b15b5b278c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_d8ab743c-7a82-4d12-b942-27539d176b78', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T22:48:42.088082261Z [2024-06-18 22:48:42,084: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T22:48:42.120383144Z [2024-06-18 22:48:42,119: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T22:48:42.123623757Z [2024-06-18 22:48:42,123: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:48:42.150065904Z [2024-06-18 22:48:42,149: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T22:48:42.151515775Z [2024-06-18 22:48:42,151: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:48:42.151570772Z [2024-06-18 22:48:42,151: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:48:42.151588172Z [2024-06-18 22:48:42,151: INFO/ForkPoolWorker-15] Read VIM d8ab743c-7a82-4d12-b942-27539d176b78 (basic_08_vim_test) 2024-06-18T22:48:42.151855938Z [2024-06-18 22:48:42,151: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'd8ab743c-7a82-4d12-b942-27539d176b78', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-06-18T22:48:42.151871724Z [2024-06-18 22:48:42,151: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T22:48:42.152159105Z [2024-06-18 22:48:42,151: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T22:48:42.152166622Z [2024-06-18 22:48:42,152: INFO/ForkPoolWorker-15] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:48:42.157622729Z [2024-06-18 22:48:42,157: INFO/ForkPoolWorker-15] Creating DAG vim_status_d8ab743c-7a82-4d12-b942-27539d176b78 2024-06-18T22:48:42.246618960Z [2024-06-18 22:48:42,242: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:48:43.414112269Z [2024-06-18 22:48:43,413: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-18T22:48:43.418495363Z [2024-06-18 22:48:43,417: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:48:43.450448714Z [2024-06-18 22:48:43,450: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T22:48:43.452905344Z [2024-06-18 22:48:43,452: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:48:43.452939747Z [2024-06-18 22:48:43,452: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:48:43.453170682Z [2024-06-18 22:48:43,452: INFO/ForkPoolWorker-16] Read VIM d8ab743c-7a82-4d12-b942-27539d176b78 (basic_08_vim_test) 2024-06-18T22:48:43.453472145Z [2024-06-18 22:48:43,453: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'd8ab743c-7a82-4d12-b942-27539d176b78', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-06-18T22:48:43.453582479Z [2024-06-18 22:48:43,453: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-18T22:48:43.454132926Z [2024-06-18 22:48:43,453: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-18T22:48:43.454286754Z [2024-06-18 22:48:43,454: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:48:43.460782485Z [2024-06-18 22:48:43,460: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_d8ab743c-7a82-4d12-b942-27539d176b78 2024-06-18T22:48:43.557354833Z [2024-06-18 22:48:43,556: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:48:43.789575918Z [2024-06-18 22:48:43,789: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e2468b96-2fa2-448e-b245-e2b122f0bd5e] succeeded in 3.1980091369996444s: None 2024-06-18T22:48:45.399287644Z [2024-06-18 22:48:45,398: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f113e32f-e3ba-40a2-a24c-e1b15b5b278c] succeeded in 3.697393768999973s: None 2024-06-18T22:49:01.132053336Z [2024-06-18 22:49:01,131: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d4478f5b-9200-4d05-b838-44b51c3b07f9] received 2024-06-18T22:49:01.134032952Z [2024-06-18 22:49:01,133: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8b05c944-06c4-46fe-a3fa-ab739b69d42a] received 2024-06-18T22:49:01.136221004Z [2024-06-18 22:49:01,136: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a64a9030-ed1c-4d00-bf52-f1e0996916ba] received 2024-06-18T22:49:01.137802150Z [2024-06-18 22:49:01,137: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[45d71636-0d7a-4486-ae3d-36f4177ff233] received 2024-06-18T22:49:01.139288191Z [2024-06-18 22:49:01,139: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a49461a6-f23b-48e4-85ff-4bff6cab2460] received 2024-06-18T22:49:01.144540629Z [2024-06-18 22:49:01,144: INFO/ForkPoolWorker-15] [d4478f5b-9200-4d05-b838-44b51c3b07f9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T22:49:01.148865584Z [2024-06-18 22:49:01,148: INFO/ForkPoolWorker-2] [45d71636-0d7a-4486-ae3d-36f4177ff233] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T22:49:01.154158471Z [2024-06-18 22:49:01,153: INFO/ForkPoolWorker-3] [a49461a6-f23b-48e4-85ff-4bff6cab2460] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T22:49:01.157381650Z [2024-06-18 22:49:01,156: INFO/ForkPoolWorker-1] [a64a9030-ed1c-4d00-bf52-f1e0996916ba] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_d8ab743c-7a82-4d12-b942-27539d176b78', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T22:49:01.169122403Z [2024-06-18 22:49:01,168: INFO/ForkPoolWorker-16] [8b05c944-06c4-46fe-a3fa-ab739b69d42a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_d8ab743c-7a82-4d12-b942-27539d176b78', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T22:49:01.462093965Z [2024-06-18 22:49:01,457: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T22:49:01.531268807Z [2024-06-18 22:49:01,527: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T22:49:01.572577239Z [2024-06-18 22:49:01,561: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T22:49:01.609223152Z [2024-06-18 22:49:01,605: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T22:49:01.623518104Z [2024-06-18 22:49:01,617: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T22:49:02.191658200Z [2024-06-18 22:49:02,191: INFO/ForkPoolWorker-15] Getting SDNC list 2024-06-18T22:49:02.208436475Z [2024-06-18 22:49:02,195: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:49:02.434760623Z [2024-06-18 22:49:02,434: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T22:49:02.446208618Z [2024-06-18 22:49:02,445: INFO/ForkPoolWorker-15] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T22:49:02.446234423Z [2024-06-18 22:49:02,446: INFO/ForkPoolWorker-15] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T22:49:02.446305163Z [2024-06-18 22:49:02,446: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-06-18T22:49:02.446542325Z [2024-06-18 22:49:02,446: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T22:49:02.658456483Z [2024-06-18 22:49:02,658: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:49:03.270202142Z [2024-06-18 22:49:03,269: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-18T22:49:03.273780527Z [2024-06-18 22:49:03,273: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:49:03.329784935Z [2024-06-18 22:49:03,329: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T22:49:03.331800737Z [2024-06-18 22:49:03,331: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:49:03.331956857Z [2024-06-18 22:49:03,331: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:49:03.332026546Z [2024-06-18 22:49:03,331: INFO/ForkPoolWorker-16] Read VIM d8ab743c-7a82-4d12-b942-27539d176b78 (basic_08_vim_test) 2024-06-18T22:49:03.332201557Z [2024-06-18 22:49:03,332: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'd8ab743c-7a82-4d12-b942-27539d176b78', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-06-18T22:49:03.332276397Z [2024-06-18 22:49:03,332: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-18T22:49:03.332533829Z [2024-06-18 22:49:03,332: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-18T22:49:03.333027757Z [2024-06-18 22:49:03,332: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:49:03.338052853Z [2024-06-18 22:49:03,337: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_d8ab743c-7a82-4d12-b942-27539d176b78 2024-06-18T22:49:03.395849408Z [2024-06-18 22:49:03,395: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-18T22:49:03.399821585Z [2024-06-18 22:49:03,399: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:49:03.400764973Z [2024-06-18 22:49:03,400: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-18T22:49:03.403980001Z [2024-06-18 22:49:03,403: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:49:03.444168053Z [2024-06-18 22:49:03,443: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-18T22:49:03.449136895Z [2024-06-18 22:49:03,448: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:49:03.449312811Z [2024-06-18 22:49:03,449: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:49:03.449490512Z [2024-06-18 22:49:03,449: INFO/ForkPoolWorker-2] Read VIM d8ab743c-7a82-4d12-b942-27539d176b78 (basic_08_vim_test) 2024-06-18T22:49:03.449719477Z [2024-06-18 22:49:03,449: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'd8ab743c-7a82-4d12-b942-27539d176b78', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-06-18T22:49:03.449828814Z [2024-06-18 22:49:03,449: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-18T22:49:03.450199879Z [2024-06-18 22:49:03,450: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T22:49:03.450852773Z [2024-06-18 22:49:03,450: INFO/ForkPoolWorker-2] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:49:03.457607450Z [2024-06-18 22:49:03,457: INFO/ForkPoolWorker-2] Creating DAG vim_status_d8ab743c-7a82-4d12-b942-27539d176b78 2024-06-18T22:49:03.468353961Z [2024-06-18 22:49:03,468: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T22:49:03.469966688Z [2024-06-18 22:49:03,469: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:49:03.469983232Z [2024-06-18 22:49:03,469: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:49:03.470123931Z [2024-06-18 22:49:03,470: INFO/ForkPoolWorker-1] Read VIM d8ab743c-7a82-4d12-b942-27539d176b78 (basic_08_vim_test) 2024-06-18T22:49:03.470296040Z [2024-06-18 22:49:03,470: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'd8ab743c-7a82-4d12-b942-27539d176b78', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-06-18T22:49:03.470354788Z [2024-06-18 22:49:03,470: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-18T22:49:03.470643450Z [2024-06-18 22:49:03,470: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T22:49:03.470695475Z [2024-06-18 22:49:03,470: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:49:03.475752251Z [2024-06-18 22:49:03,475: INFO/ForkPoolWorker-1] Creating DAG vim_status_d8ab743c-7a82-4d12-b942-27539d176b78 2024-06-18T22:49:03.532450805Z [2024-06-18 22:49:03,532: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:49:03.587914407Z [2024-06-18 22:49:03,587: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:49:03.644490117Z [2024-06-18 22:49:03,644: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:49:04.089077598Z [2024-06-18 22:49:04,088: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d4478f5b-9200-4d05-b838-44b51c3b07f9] succeeded in 2.954506867999953s: None 2024-06-18T22:49:04.494296051Z [2024-06-18 22:49:04,493: INFO/ForkPoolWorker-3] Getting VIM list 2024-06-18T22:49:04.498452661Z [2024-06-18 22:49:04,497: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:49:04.523605993Z [2024-06-18 22:49:04,523: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-06-18T22:49:04.525373941Z [2024-06-18 22:49:04,525: INFO/ForkPoolWorker-3] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:49:04.525505831Z [2024-06-18 22:49:04,525: INFO/ForkPoolWorker-3] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:49:04.525658692Z [2024-06-18 22:49:04,525: INFO/ForkPoolWorker-3] Read VIM d8ab743c-7a82-4d12-b942-27539d176b78 (basic_08_vim_test) 2024-06-18T22:49:04.525913674Z [2024-06-18 22:49:04,525: INFO/ForkPoolWorker-3] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'd8ab743c-7a82-4d12-b942-27539d176b78', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-06-18T22:49:04.526097832Z [2024-06-18 22:49:04,525: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-06-18T22:49:04.526481849Z [2024-06-18 22:49:04,526: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-06-18T22:49:04.526586438Z [2024-06-18 22:49:04,526: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:49:04.532207791Z [2024-06-18 22:49:04,531: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_d8ab743c-7a82-4d12-b942-27539d176b78 2024-06-18T22:49:04.640798987Z [2024-06-18 22:49:04,640: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:49:05.220342895Z [2024-06-18 22:49:05,219: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[46ab2bb7-f69e-4b92-8289-fac1f5bcbe20] received 2024-06-18T22:49:05.232454324Z [2024-06-18 22:49:05,232: INFO/ForkPoolWorker-15] [46ab2bb7-f69e-4b92-8289-fac1f5bcbe20] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d8ab743c-7a82-4d12-b942-27539d176b78', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-18T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-18T22:49:05.513558162Z [2024-06-18 22:49:05,509: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T22:49:05.571731939Z [2024-06-18 22:49:05,571: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[45d71636-0d7a-4486-ae3d-36f4177ff233] succeeded in 4.430768261000139s: None 2024-06-18T22:49:05.784124126Z [2024-06-18 22:49:05,783: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a64a9030-ed1c-4d00-bf52-f1e0996916ba] succeeded in 4.642026737999913s: None 2024-06-18T22:49:06.121426643Z [2024-06-18 22:49:06,120: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8b05c944-06c4-46fe-a3fa-ab739b69d42a] succeeded in 4.9658210729999155s: None 2024-06-18T22:49:06.728917810Z [2024-06-18 22:49:06,728: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[a49461a6-f23b-48e4-85ff-4bff6cab2460] succeeded in 5.585659274000136s: None 2024-06-18T22:49:06.837813323Z [2024-06-18 22:49:06,837: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T22:49:06.841383655Z [2024-06-18 22:49:06,840: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:49:06.861996198Z [2024-06-18 22:49:06,861: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T22:49:06.864161561Z [2024-06-18 22:49:06,863: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:49:06.864208211Z [2024-06-18 22:49:06,864: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:49:06.869627670Z [2024-06-18 22:49:06,869: INFO/ForkPoolWorker-15] Read VIM d8ab743c-7a82-4d12-b942-27539d176b78 (basic_08_vim_test) 2024-06-18T22:49:06.869756251Z [2024-06-18 22:49:06,869: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'd8ab743c-7a82-4d12-b942-27539d176b78', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-06-18T22:49:06.869848578Z [2024-06-18 22:49:06,869: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T22:49:06.870372473Z [2024-06-18 22:49:06,870: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T22:49:06.870869559Z [2024-06-18 22:49:06,870: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:49:06.877018581Z [2024-06-18 22:49:06,876: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_d8ab743c-7a82-4d12-b942-27539d176b78 2024-06-18T22:49:06.987803480Z [2024-06-18 22:49:06,985: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:49:07.633305640Z [2024-06-18 22:49:07,632: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[46ab2bb7-f69e-4b92-8289-fac1f5bcbe20] succeeded in 2.408037151999906s: None 2024-06-18T22:49:07.743859709Z [2024-06-18 22:49:07,743: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c99c3e49-c06b-492c-87c7-0b9094e6d1c3] received 2024-06-18T22:49:07.753790811Z [2024-06-18 22:49:07,753: INFO/ForkPoolWorker-15] [c99c3e49-c06b-492c-87c7-0b9094e6d1c3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d8ab743c-7a82-4d12-b942-27539d176b78', 'split_metrics', 'scheduled__2024-06-18T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-18T22:49:08.033439446Z [2024-06-18 22:49:08,029: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T22:49:09.135815467Z [2024-06-18 22:49:09,135: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T22:49:09.140406252Z [2024-06-18 22:49:09,139: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:49:09.172998057Z [2024-06-18 22:49:09,172: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T22:49:09.176216776Z [2024-06-18 22:49:09,175: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:49:09.176422051Z [2024-06-18 22:49:09,176: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:49:09.176579854Z [2024-06-18 22:49:09,176: INFO/ForkPoolWorker-15] Read VIM d8ab743c-7a82-4d12-b942-27539d176b78 (basic_08_vim_test) 2024-06-18T22:49:09.176937460Z [2024-06-18 22:49:09,176: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'd8ab743c-7a82-4d12-b942-27539d176b78', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-06-18T22:49:09.177078501Z [2024-06-18 22:49:09,176: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T22:49:09.177521202Z [2024-06-18 22:49:09,177: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T22:49:09.177685434Z [2024-06-18 22:49:09,177: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:49:09.186350648Z [2024-06-18 22:49:09,186: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_d8ab743c-7a82-4d12-b942-27539d176b78 2024-06-18T22:49:09.297874946Z [2024-06-18 22:49:09,297: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:49:10.076843351Z [2024-06-18 22:49:10,076: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c99c3e49-c06b-492c-87c7-0b9094e6d1c3] succeeded in 2.3289148560002104s: None 2024-06-18T22:49:10.279725331Z [2024-06-18 22:49:10,279: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8d2731f2-ec8a-42f7-8562-051a44bcee7a] received 2024-06-18T22:49:10.291134422Z [2024-06-18 22:49:10,290: INFO/ForkPoolWorker-15] [8d2731f2-ec8a-42f7-8562-051a44bcee7a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d8ab743c-7a82-4d12-b942-27539d176b78', 'collect_metrics', 'scheduled__2024-06-18T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-18T22:49:10.582177641Z [2024-06-18 22:49:10,578: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T22:49:11.840348547Z [2024-06-18 22:49:11,839: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T22:49:11.843840368Z [2024-06-18 22:49:11,843: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:49:11.890225779Z [2024-06-18 22:49:11,889: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T22:49:11.897541782Z [2024-06-18 22:49:11,896: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:49:11.897563892Z [2024-06-18 22:49:11,896: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:49:11.897567667Z [2024-06-18 22:49:11,896: INFO/ForkPoolWorker-15] Read VIM d8ab743c-7a82-4d12-b942-27539d176b78 (basic_08_vim_test) 2024-06-18T22:49:11.897574047Z [2024-06-18 22:49:11,896: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'd8ab743c-7a82-4d12-b942-27539d176b78', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-06-18T22:49:11.897578060Z [2024-06-18 22:49:11,896: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T22:49:11.897581580Z [2024-06-18 22:49:11,896: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T22:49:11.897584731Z [2024-06-18 22:49:11,897: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:49:11.904048769Z [2024-06-18 22:49:11,903: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_d8ab743c-7a82-4d12-b942-27539d176b78 2024-06-18T22:49:12.033549951Z [2024-06-18 22:49:12,033: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:49:12.734042769Z [2024-06-18 22:49:12,728: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8d2731f2-ec8a-42f7-8562-051a44bcee7a] succeeded in 2.4446040389998416s: None 2024-06-18T22:49:13.252228946Z [2024-06-18 22:49:13,251: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[516baf29-1e5a-4e7b-9ca2-72a7289cdc79] received 2024-06-18T22:49:13.264541857Z [2024-06-18 22:49:13,264: INFO/ForkPoolWorker-15] [516baf29-1e5a-4e7b-9ca2-72a7289cdc79] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d8ab743c-7a82-4d12-b942-27539d176b78', 'send_prometheus', 'scheduled__2024-06-18T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-18T22:49:13.613749966Z [2024-06-18 22:49:13,609: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T22:49:14.959297507Z [2024-06-18 22:49:14,958: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T22:49:14.962833242Z [2024-06-18 22:49:14,962: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:49:14.998516810Z [2024-06-18 22:49:14,998: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T22:49:14.999977649Z [2024-06-18 22:49:14,999: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:49:15.000214168Z [2024-06-18 22:49:15,000: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:49:15.000310944Z [2024-06-18 22:49:15,000: INFO/ForkPoolWorker-15] Read VIM d8ab743c-7a82-4d12-b942-27539d176b78 (basic_08_vim_test) 2024-06-18T22:49:15.000582683Z [2024-06-18 22:49:15,000: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'd8ab743c-7a82-4d12-b942-27539d176b78', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-06-18T22:49:15.000751423Z [2024-06-18 22:49:15,000: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T22:49:15.001329371Z [2024-06-18 22:49:15,001: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T22:49:15.001492602Z [2024-06-18 22:49:15,001: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:49:15.010913654Z [2024-06-18 22:49:15,010: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_d8ab743c-7a82-4d12-b942-27539d176b78 2024-06-18T22:49:15.143489630Z [2024-06-18 22:49:15,142: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:49:15.848373259Z [2024-06-18 22:49:15,847: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[516baf29-1e5a-4e7b-9ca2-72a7289cdc79] succeeded in 2.592610840999896s: None 2024-06-18T22:50:01.473768601Z [2024-06-18 22:50:01,472: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[372b2458-d017-4b77-9859-45553f0443ce] received 2024-06-18T22:50:01.484399343Z [2024-06-18 22:50:01,484: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[93844fb5-4351-426d-8bcf-b1e26df345ac] received 2024-06-18T22:50:01.484663136Z [2024-06-18 22:50:01,484: INFO/ForkPoolWorker-15] [372b2458-d017-4b77-9859-45553f0443ce] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d8ab743c-7a82-4d12-b942-27539d176b78', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-18T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-18T22:50:01.488038928Z [2024-06-18 22:50:01,487: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[af7c4f8a-d1dc-40c9-a617-21f7a370927d] received 2024-06-18T22:50:01.494321981Z [2024-06-18 22:50:01,494: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4498fe9b-1e5d-4db6-adcf-8b49aaf33a4a] received 2024-06-18T22:50:01.504330627Z [2024-06-18 22:50:01,504: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[04ce48d9-c422-4206-8fa2-6fdaa91bdbb8] received 2024-06-18T22:50:01.506872866Z [2024-06-18 22:50:01,506: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a4c35e7d-9262-472a-8d3e-031bad60f479] received 2024-06-18T22:50:01.508723055Z [2024-06-18 22:50:01,508: INFO/ForkPoolWorker-1] [af7c4f8a-d1dc-40c9-a617-21f7a370927d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T22:50:01.509188399Z [2024-06-18 22:50:01,509: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[27125920-f951-49f8-aa71-cec11e6b1d43] received 2024-06-18T22:50:01.519471654Z [2024-06-18 22:50:01,519: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2bbbf094-40dc-4b58-970c-9023651c64e4] received 2024-06-18T22:50:01.523356468Z [2024-06-18 22:50:01,523: INFO/ForkPoolWorker-2] [4498fe9b-1e5d-4db6-adcf-8b49aaf33a4a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T22:50:01.524342520Z [2024-06-18 22:50:01,524: INFO/ForkPoolWorker-3] [04ce48d9-c422-4206-8fa2-6fdaa91bdbb8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_d8ab743c-7a82-4d12-b942-27539d176b78', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T22:50:01.529775275Z [2024-06-18 22:50:01,529: INFO/ForkPoolWorker-5] [27125920-f951-49f8-aa71-cec11e6b1d43] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-18T22:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-18T22:50:01.530879848Z [2024-06-18 22:50:01,530: INFO/ForkPoolWorker-16] [93844fb5-4351-426d-8bcf-b1e26df345ac] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-18T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-18T22:50:01.537831329Z [2024-06-18 22:50:01,537: INFO/ForkPoolWorker-6] [2bbbf094-40dc-4b58-970c-9023651c64e4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T22:50:01.551599210Z [2024-06-18 22:50:01,551: INFO/ForkPoolWorker-4] [a4c35e7d-9262-472a-8d3e-031bad60f479] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_d8ab743c-7a82-4d12-b942-27539d176b78', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T22:50:02.022600472Z [2024-06-18 22:50:02,017: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T22:50:02.027320297Z [2024-06-18 22:50:02,004: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T22:50:02.136934965Z [2024-06-18 22:50:02,131: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T22:50:02.339366871Z [2024-06-18 22:50:02,334: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T22:50:02.388390482Z [2024-06-18 22:50:02,382: INFO/ForkPoolWorker-5] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-18T22:50:02.527505447Z [2024-06-18 22:50:02,522: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T22:50:02.745177689Z [2024-06-18 22:50:02,734: INFO/ForkPoolWorker-6] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T22:50:02.970020468Z [2024-06-18 22:50:02,942: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T22:50:03.178492924Z [2024-06-18 22:50:03,178: INFO/ForkPoolWorker-5] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:50:03.570338861Z [2024-06-18 22:50:03,569: INFO/ForkPoolWorker-2] Getting SDNC list 2024-06-18T22:50:03.578759233Z [2024-06-18 22:50:03,578: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:50:03.610407749Z [2024-06-18 22:50:03,610: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-18T22:50:03.611944073Z [2024-06-18 22:50:03,611: INFO/ForkPoolWorker-2] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T22:50:03.612088925Z [2024-06-18 22:50:03,611: INFO/ForkPoolWorker-2] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T22:50:03.612225092Z [2024-06-18 22:50:03,612: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-06-18T22:50:03.612522029Z [2024-06-18 22:50:03,612: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T22:50:03.831311670Z [2024-06-18 22:50:03,831: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:50:03.855868841Z [2024-06-18 22:50:03,855: INFO/ForkPoolWorker-5] Task airflow.executors.celery_executor.execute_command[27125920-f951-49f8-aa71-cec11e6b1d43] succeeded in 2.343616360999931s: None 2024-06-18T22:50:05.033453932Z [2024-06-18 22:50:05,033: INFO/ForkPoolWorker-4] Getting VIM list 2024-06-18T22:50:05.037082354Z [2024-06-18 22:50:05,036: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:50:05.050160839Z [2024-06-18 22:50:05,049: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[4498fe9b-1e5d-4db6-adcf-8b49aaf33a4a] succeeded in 3.5538882900000317s: None 2024-06-18T22:50:05.099666958Z [2024-06-18 22:50:05,099: INFO/ForkPoolWorker-4] Connected to database osm version 1.2 2024-06-18T22:50:05.103096332Z [2024-06-18 22:50:05,102: INFO/ForkPoolWorker-4] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:50:05.103112410Z [2024-06-18 22:50:05,103: INFO/ForkPoolWorker-4] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:50:05.103170766Z [2024-06-18 22:50:05,103: INFO/ForkPoolWorker-4] Read VIM d8ab743c-7a82-4d12-b942-27539d176b78 (basic_08_vim_test) 2024-06-18T22:50:05.103341040Z [2024-06-18 22:50:05,103: INFO/ForkPoolWorker-4] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'd8ab743c-7a82-4d12-b942-27539d176b78', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-06-18T22:50:05.103403560Z [2024-06-18 22:50:05,103: INFO/ForkPoolWorker-4] Getting VIM list OK 2024-06-18T22:50:05.103677778Z [2024-06-18 22:50:05,103: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for collecting VM status 2024-06-18T22:50:05.103845624Z [2024-06-18 22:50:05,103: INFO/ForkPoolWorker-4] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:50:05.108847162Z [2024-06-18 22:50:05,108: INFO/ForkPoolWorker-4] Creating DAG vm_status_vim_d8ab743c-7a82-4d12-b942-27539d176b78 2024-06-18T22:50:05.245592018Z [2024-06-18 22:50:05,245: INFO/ForkPoolWorker-4] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:50:05.283890160Z [2024-06-18 22:50:05,283: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-18T22:50:05.289606026Z [2024-06-18 22:50:05,289: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:50:05.359118934Z [2024-06-18 22:50:05,358: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T22:50:05.361883718Z [2024-06-18 22:50:05,361: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:50:05.362070454Z [2024-06-18 22:50:05,361: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:50:05.362229300Z [2024-06-18 22:50:05,362: INFO/ForkPoolWorker-1] Read VIM d8ab743c-7a82-4d12-b942-27539d176b78 (basic_08_vim_test) 2024-06-18T22:50:05.362413028Z [2024-06-18 22:50:05,362: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'd8ab743c-7a82-4d12-b942-27539d176b78', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-06-18T22:50:05.362471822Z [2024-06-18 22:50:05,362: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-18T22:50:05.362801160Z [2024-06-18 22:50:05,362: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T22:50:05.362813813Z [2024-06-18 22:50:05,362: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:50:05.368620043Z [2024-06-18 22:50:05,368: INFO/ForkPoolWorker-1] Creating DAG vim_status_d8ab743c-7a82-4d12-b942-27539d176b78 2024-06-18T22:50:05.373047313Z [2024-06-18 22:50:05,371: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-18T22:50:05.376889899Z [2024-06-18 22:50:05,376: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:50:05.408327374Z [2024-06-18 22:50:05,408: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T22:50:05.413185067Z [2024-06-18 22:50:05,412: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:50:05.413387430Z [2024-06-18 22:50:05,413: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:50:05.413529794Z [2024-06-18 22:50:05,413: INFO/ForkPoolWorker-16] Read VIM d8ab743c-7a82-4d12-b942-27539d176b78 (basic_08_vim_test) 2024-06-18T22:50:05.413806513Z [2024-06-18 22:50:05,413: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'd8ab743c-7a82-4d12-b942-27539d176b78', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-06-18T22:50:05.413999988Z [2024-06-18 22:50:05,413: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-18T22:50:05.414342782Z [2024-06-18 22:50:05,414: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T22:50:05.414492595Z [2024-06-18 22:50:05,414: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:50:05.421864284Z [2024-06-18 22:50:05,421: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_d8ab743c-7a82-4d12-b942-27539d176b78 2024-06-18T22:50:05.467318779Z [2024-06-18 22:50:05,466: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T22:50:05.481558359Z [2024-06-18 22:50:05,479: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:50:05.493658363Z [2024-06-18 22:50:05,493: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:50:05.527328337Z [2024-06-18 22:50:05,527: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:50:05.562461457Z [2024-06-18 22:50:05,562: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T22:50:05.564207603Z [2024-06-18 22:50:05,564: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:50:05.564409068Z [2024-06-18 22:50:05,564: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:50:05.564546153Z [2024-06-18 22:50:05,564: INFO/ForkPoolWorker-15] Read VIM d8ab743c-7a82-4d12-b942-27539d176b78 (basic_08_vim_test) 2024-06-18T22:50:05.564821639Z [2024-06-18 22:50:05,564: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'd8ab743c-7a82-4d12-b942-27539d176b78', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-06-18T22:50:05.564992798Z [2024-06-18 22:50:05,564: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T22:50:05.565370027Z [2024-06-18 22:50:05,565: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T22:50:05.565546375Z [2024-06-18 22:50:05,565: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:50:05.577068419Z [2024-06-18 22:50:05,576: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_d8ab743c-7a82-4d12-b942-27539d176b78 2024-06-18T22:50:05.731212586Z [2024-06-18 22:50:05,730: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:50:05.985363456Z [2024-06-18 22:50:05,984: INFO/ForkPoolWorker-3] Getting VIM list 2024-06-18T22:50:05.995368254Z [2024-06-18 22:50:05,994: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:50:06.070899045Z [2024-06-18 22:50:06,070: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-06-18T22:50:06.072570617Z [2024-06-18 22:50:06,072: INFO/ForkPoolWorker-3] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:50:06.072734138Z [2024-06-18 22:50:06,072: INFO/ForkPoolWorker-3] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:50:06.072914963Z [2024-06-18 22:50:06,072: INFO/ForkPoolWorker-3] Read VIM d8ab743c-7a82-4d12-b942-27539d176b78 (basic_08_vim_test) 2024-06-18T22:50:06.073118449Z [2024-06-18 22:50:06,072: INFO/ForkPoolWorker-3] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'd8ab743c-7a82-4d12-b942-27539d176b78', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-06-18T22:50:06.073259895Z [2024-06-18 22:50:06,073: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-06-18T22:50:06.073588419Z [2024-06-18 22:50:06,073: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T22:50:06.074001715Z [2024-06-18 22:50:06,073: INFO/ForkPoolWorker-3] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:50:06.079666414Z [2024-06-18 22:50:06,079: INFO/ForkPoolWorker-3] Creating DAG vim_status_d8ab743c-7a82-4d12-b942-27539d176b78 2024-06-18T22:50:06.208360305Z [2024-06-18 22:50:06,207: INFO/ForkPoolWorker-6] Getting VIM list 2024-06-18T22:50:06.222123046Z [2024-06-18 22:50:06,221: INFO/ForkPoolWorker-6] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:50:06.245910155Z [2024-06-18 22:50:06,245: INFO/ForkPoolWorker-6] Connected to database osm version 1.2 2024-06-18T22:50:06.247296107Z [2024-06-18 22:50:06,247: INFO/ForkPoolWorker-6] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:50:06.247307343Z [2024-06-18 22:50:06,247: INFO/ForkPoolWorker-6] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:50:06.247374397Z [2024-06-18 22:50:06,247: INFO/ForkPoolWorker-6] Read VIM d8ab743c-7a82-4d12-b942-27539d176b78 (basic_08_vim_test) 2024-06-18T22:50:06.247564756Z [2024-06-18 22:50:06,247: INFO/ForkPoolWorker-6] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'd8ab743c-7a82-4d12-b942-27539d176b78', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-06-18T22:50:06.247680664Z [2024-06-18 22:50:06,247: INFO/ForkPoolWorker-6] Getting VIM list OK 2024-06-18T22:50:06.247994626Z [2024-06-18 22:50:06,247: INFO/ForkPoolWorker-6] VIM type 'dummy' not supported for collecting VM status 2024-06-18T22:50:06.248318773Z [2024-06-18 22:50:06,247: INFO/ForkPoolWorker-6] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:50:06.254152838Z [2024-06-18 22:50:06,253: INFO/ForkPoolWorker-6] Creating DAG vm_status_vim_d8ab743c-7a82-4d12-b942-27539d176b78 2024-06-18T22:50:06.316339378Z [2024-06-18 22:50:06,316: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:50:06.391014690Z [2024-06-18 22:50:06,390: INFO/ForkPoolWorker-6] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:50:06.581809370Z [2024-06-18 22:50:06,581: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[273b7dc8-1cba-4df8-82c3-c6635a8b9f26] received 2024-06-18T22:50:06.597483662Z [2024-06-18 22:50:06,597: INFO/ForkPoolWorker-2] [273b7dc8-1cba-4df8-82c3-c6635a8b9f26] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'split_metrics', 'scheduled__2024-06-18T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-18T22:50:06.739063672Z [2024-06-18 22:50:06,738: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[93844fb5-4351-426d-8bcf-b1e26df345ac] succeeded in 5.2521779829999105s: None 2024-06-18T22:50:06.845100515Z [2024-06-18 22:50:06,844: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[372b2458-d017-4b77-9859-45553f0443ce] succeeded in 5.368877487000191s: None 2024-06-18T22:50:07.089700944Z [2024-06-18 22:50:07,089: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[71f88b88-fa5f-4bce-8b77-8dce35491fb9] received 2024-06-18T22:50:07.107642898Z [2024-06-18 22:50:07,107: INFO/ForkPoolWorker-15] [71f88b88-fa5f-4bce-8b77-8dce35491fb9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d8ab743c-7a82-4d12-b942-27539d176b78', 'split_metrics', 'scheduled__2024-06-18T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-18T22:50:07.245596787Z [2024-06-18 22:50:07,239: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T22:50:07.511257829Z [2024-06-18 22:50:07,510: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[af7c4f8a-d1dc-40c9-a617-21f7a370927d] succeeded in 6.018875394999668s: None 2024-06-18T22:50:07.601510137Z [2024-06-18 22:50:07,597: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T22:50:07.785522601Z [2024-06-18 22:50:07,785: INFO/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[a4c35e7d-9262-472a-8d3e-031bad60f479] succeeded in 6.273122843999772s: None 2024-06-18T22:50:08.269082309Z [2024-06-18 22:50:08,268: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[04ce48d9-c422-4206-8fa2-6fdaa91bdbb8] succeeded in 6.761525561999861s: None 2024-06-18T22:50:08.786940804Z [2024-06-18 22:50:08,786: INFO/ForkPoolWorker-6] Task airflow.executors.celery_executor.execute_command[2bbbf094-40dc-4b58-970c-9023651c64e4] succeeded in 7.2606235500002185s: None 2024-06-18T22:50:08.864297611Z [2024-06-18 22:50:08,863: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-18T22:50:08.868464618Z [2024-06-18 22:50:08,867: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:50:08.921139829Z [2024-06-18 22:50:08,920: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-18T22:50:08.924993330Z [2024-06-18 22:50:08,924: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:50:08.925097679Z [2024-06-18 22:50:08,924: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:50:08.925127234Z [2024-06-18 22:50:08,924: INFO/ForkPoolWorker-2] Read VIM d8ab743c-7a82-4d12-b942-27539d176b78 (basic_08_vim_test) 2024-06-18T22:50:08.925300814Z [2024-06-18 22:50:08,925: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'd8ab743c-7a82-4d12-b942-27539d176b78', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-06-18T22:50:08.925375956Z [2024-06-18 22:50:08,925: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-18T22:50:08.925548968Z [2024-06-18 22:50:08,925: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T22:50:08.925616582Z [2024-06-18 22:50:08,925: INFO/ForkPoolWorker-2] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:50:08.932507662Z [2024-06-18 22:50:08,932: INFO/ForkPoolWorker-2] Creating DAG vm_metrics_vim_d8ab743c-7a82-4d12-b942-27539d176b78 2024-06-18T22:50:09.059219665Z [2024-06-18 22:50:09,058: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:50:09.187030019Z [2024-06-18 22:50:09,186: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T22:50:09.190640283Z [2024-06-18 22:50:09,190: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:50:09.220459849Z [2024-06-18 22:50:09,220: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T22:50:09.221887737Z [2024-06-18 22:50:09,221: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:50:09.221915449Z [2024-06-18 22:50:09,221: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:50:09.221970677Z [2024-06-18 22:50:09,221: INFO/ForkPoolWorker-15] Read VIM d8ab743c-7a82-4d12-b942-27539d176b78 (basic_08_vim_test) 2024-06-18T22:50:09.222154367Z [2024-06-18 22:50:09,221: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'd8ab743c-7a82-4d12-b942-27539d176b78', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-06-18T22:50:09.222241428Z [2024-06-18 22:50:09,222: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T22:50:09.222499484Z [2024-06-18 22:50:09,222: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T22:50:09.222599133Z [2024-06-18 22:50:09,222: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:50:09.228513817Z [2024-06-18 22:50:09,228: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_d8ab743c-7a82-4d12-b942-27539d176b78 2024-06-18T22:50:09.331242042Z [2024-06-18 22:50:09,330: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:50:09.777188475Z [2024-06-18 22:50:09,775: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1013a627-e445-4026-8ba9-bdd9dfcee6a9] received 2024-06-18T22:50:09.801732986Z [2024-06-18 22:50:09,801: INFO/ForkPoolWorker-16] [1013a627-e445-4026-8ba9-bdd9dfcee6a9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'collect_metrics', 'scheduled__2024-06-18T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-18T22:50:09.821258449Z [2024-06-18 22:50:09,820: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[273b7dc8-1cba-4df8-82c3-c6635a8b9f26] succeeded in 3.2362185339998177s: None 2024-06-18T22:50:10.022760237Z [2024-06-18 22:50:10,022: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0c1a60db-13ef-4bfd-ad4d-2a4ac10539ba] received 2024-06-18T22:50:10.036629264Z [2024-06-18 22:50:10,036: INFO/ForkPoolWorker-1] [0c1a60db-13ef-4bfd-ad4d-2a4ac10539ba] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d8ab743c-7a82-4d12-b942-27539d176b78', 'collect_metrics', 'scheduled__2024-06-18T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-18T22:50:10.126514623Z [2024-06-18 22:50:10,125: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[71f88b88-fa5f-4bce-8b77-8dce35491fb9] succeeded in 3.0347340680000343s: None 2024-06-18T22:50:10.160080363Z [2024-06-18 22:50:10,156: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T22:50:10.361027078Z [2024-06-18 22:50:10,357: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T22:50:11.707488103Z [2024-06-18 22:50:11,707: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-18T22:50:11.723470077Z [2024-06-18 22:50:11,722: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:50:11.749363797Z [2024-06-18 22:50:11,748: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T22:50:11.751215795Z [2024-06-18 22:50:11,750: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:50:11.751350349Z [2024-06-18 22:50:11,751: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:50:11.751627127Z [2024-06-18 22:50:11,751: INFO/ForkPoolWorker-16] Read VIM d8ab743c-7a82-4d12-b942-27539d176b78 (basic_08_vim_test) 2024-06-18T22:50:11.752182589Z [2024-06-18 22:50:11,751: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'd8ab743c-7a82-4d12-b942-27539d176b78', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-06-18T22:50:11.752515351Z [2024-06-18 22:50:11,752: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-18T22:50:11.753280501Z [2024-06-18 22:50:11,752: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T22:50:11.753601991Z [2024-06-18 22:50:11,753: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:50:11.764153819Z [2024-06-18 22:50:11,763: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_d8ab743c-7a82-4d12-b942-27539d176b78 2024-06-18T22:50:11.827236122Z [2024-06-18 22:50:11,826: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-18T22:50:11.830827262Z [2024-06-18 22:50:11,830: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:50:11.861196560Z [2024-06-18 22:50:11,860: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T22:50:11.862943074Z [2024-06-18 22:50:11,862: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:50:11.863119343Z [2024-06-18 22:50:11,862: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:50:11.863447662Z [2024-06-18 22:50:11,863: INFO/ForkPoolWorker-1] Read VIM d8ab743c-7a82-4d12-b942-27539d176b78 (basic_08_vim_test) 2024-06-18T22:50:11.863663414Z [2024-06-18 22:50:11,863: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'd8ab743c-7a82-4d12-b942-27539d176b78', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-06-18T22:50:11.863769637Z [2024-06-18 22:50:11,863: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-18T22:50:11.863922779Z [2024-06-18 22:50:11,863: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T22:50:11.864086860Z [2024-06-18 22:50:11,863: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:50:11.866136832Z [2024-06-18 22:50:11,865: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:50:11.870714124Z [2024-06-18 22:50:11,870: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_d8ab743c-7a82-4d12-b942-27539d176b78 2024-06-18T22:50:11.958500152Z [2024-06-18 22:50:11,958: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:50:12.556509874Z [2024-06-18 22:50:12,556: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[97249e27-9128-4947-824e-e0e713ca3924] received 2024-06-18T22:50:12.565072144Z [2024-06-18 22:50:12,564: INFO/ForkPoolWorker-15] [97249e27-9128-4947-824e-e0e713ca3924] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'send_prometheus', 'scheduled__2024-06-18T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-18T22:50:12.623512339Z [2024-06-18 22:50:12,622: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1013a627-e445-4026-8ba9-bdd9dfcee6a9] succeeded in 2.8448188020001908s: None 2024-06-18T22:50:12.714707076Z [2024-06-18 22:50:12,714: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0c1a60db-13ef-4bfd-ad4d-2a4ac10539ba] succeeded in 2.689819983000234s: None 2024-06-18T22:50:12.745581584Z [2024-06-18 22:50:12,745: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9d79acc0-a10e-4c55-8314-437f56e75771] received 2024-06-18T22:50:12.758145528Z [2024-06-18 22:50:12,757: INFO/ForkPoolWorker-16] [9d79acc0-a10e-4c55-8314-437f56e75771] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_d8ab743c-7a82-4d12-b942-27539d176b78', 'send_prometheus', 'scheduled__2024-06-18T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-18T22:50:12.905291485Z [2024-06-18 22:50:12,901: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T22:50:13.233488381Z [2024-06-18 22:50:13,228: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T22:50:14.223615739Z [2024-06-18 22:50:14,223: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T22:50:14.227271535Z [2024-06-18 22:50:14,226: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:50:14.252966541Z [2024-06-18 22:50:14,252: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T22:50:14.254984319Z [2024-06-18 22:50:14,254: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:50:14.255163127Z [2024-06-18 22:50:14,254: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:50:14.255322093Z [2024-06-18 22:50:14,255: INFO/ForkPoolWorker-15] Read VIM d8ab743c-7a82-4d12-b942-27539d176b78 (basic_08_vim_test) 2024-06-18T22:50:14.255583320Z [2024-06-18 22:50:14,255: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'd8ab743c-7a82-4d12-b942-27539d176b78', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-06-18T22:50:14.255783003Z [2024-06-18 22:50:14,255: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T22:50:14.256302410Z [2024-06-18 22:50:14,256: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T22:50:14.256427810Z [2024-06-18 22:50:14,256: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:50:14.263295900Z [2024-06-18 22:50:14,263: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_d8ab743c-7a82-4d12-b942-27539d176b78 2024-06-18T22:50:14.384276695Z [2024-06-18 22:50:14,384: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:50:14.491199834Z [2024-06-18 22:50:14,489: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-18T22:50:14.496159556Z [2024-06-18 22:50:14,495: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:50:14.528579030Z [2024-06-18 22:50:14,528: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T22:50:14.530551687Z [2024-06-18 22:50:14,530: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:50:14.530721226Z [2024-06-18 22:50:14,530: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:50:14.530941027Z [2024-06-18 22:50:14,530: INFO/ForkPoolWorker-16] Read VIM d8ab743c-7a82-4d12-b942-27539d176b78 (basic_08_vim_test) 2024-06-18T22:50:14.531217597Z [2024-06-18 22:50:14,530: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'd8ab743c-7a82-4d12-b942-27539d176b78', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-06-18T22:50:14.531318645Z [2024-06-18 22:50:14,531: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-18T22:50:14.531709289Z [2024-06-18 22:50:14,531: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T22:50:14.532172609Z [2024-06-18 22:50:14,532: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:50:14.542548646Z [2024-06-18 22:50:14,542: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_d8ab743c-7a82-4d12-b942-27539d176b78 2024-06-18T22:50:14.659584788Z [2024-06-18 22:50:14,659: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:50:15.232062397Z [2024-06-18 22:50:15,229: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[97249e27-9128-4947-824e-e0e713ca3924] succeeded in 2.6714903010001763s: None 2024-06-18T22:50:15.286808830Z [2024-06-18 22:50:15,286: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9d79acc0-a10e-4c55-8314-437f56e75771] succeeded in 2.5370293089999905s: None 2024-06-18T22:51:00.701331246Z [2024-06-18 22:51:00,700: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4e09010d-b546-434c-85d7-7da823457626] received 2024-06-18T22:51:00.703489151Z [2024-06-18 22:51:00,703: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2d30f317-5820-4512-a5ed-e2de9fd0a679] received 2024-06-18T22:51:00.712713272Z [2024-06-18 22:51:00,712: INFO/ForkPoolWorker-16] [2d30f317-5820-4512-a5ed-e2de9fd0a679] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T22:51:00.718703385Z [2024-06-18 22:51:00,714: INFO/ForkPoolWorker-15] [4e09010d-b546-434c-85d7-7da823457626] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_d8ab743c-7a82-4d12-b942-27539d176b78', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T22:51:00.723467089Z [2024-06-18 22:51:00,723: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ef8788f6-83e1-45ce-82d4-f48837f1fb7d] received 2024-06-18T22:51:00.727808218Z [2024-06-18 22:51:00,727: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b4e5bdaf-ed93-4bbc-8ed5-4eeb76c823a7] received 2024-06-18T22:51:00.732243952Z [2024-06-18 22:51:00,732: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[42c848a4-3801-4724-834c-9fecc0527e58] received 2024-06-18T22:51:00.739794037Z [2024-06-18 22:51:00,739: INFO/ForkPoolWorker-1] [ef8788f6-83e1-45ce-82d4-f48837f1fb7d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T22:51:00.761575942Z [2024-06-18 22:51:00,761: INFO/ForkPoolWorker-3] [42c848a4-3801-4724-834c-9fecc0527e58] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_d8ab743c-7a82-4d12-b942-27539d176b78', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T22:51:00.762129890Z [2024-06-18 22:51:00,761: INFO/ForkPoolWorker-2] [b4e5bdaf-ed93-4bbc-8ed5-4eeb76c823a7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T22:51:01.082957801Z [2024-06-18 22:51:01,069: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T22:51:01.087529068Z [2024-06-18 22:51:01,084: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T22:51:01.157246175Z [2024-06-18 22:51:01,152: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T22:51:01.403899389Z [2024-06-18 22:51:01,399: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T22:51:01.462968995Z [2024-06-18 22:51:01,459: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T22:51:01.589806061Z [2024-06-18 22:51:01,589: INFO/ForkPoolWorker-16] Getting SDNC list 2024-06-18T22:51:01.593893163Z [2024-06-18 22:51:01,593: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:51:01.637009331Z [2024-06-18 22:51:01,636: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T22:51:01.642325212Z [2024-06-18 22:51:01,642: INFO/ForkPoolWorker-16] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T22:51:01.642424837Z [2024-06-18 22:51:01,642: INFO/ForkPoolWorker-16] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T22:51:01.642475287Z [2024-06-18 22:51:01,642: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-06-18T22:51:01.642700716Z [2024-06-18 22:51:01,642: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T22:51:01.735014348Z [2024-06-18 22:51:01,734: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:51:02.785273524Z [2024-06-18 22:51:02,784: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2d30f317-5820-4512-a5ed-e2de9fd0a679] succeeded in 2.0797521510003207s: None 2024-06-18T22:51:03.069095127Z [2024-06-18 22:51:03,068: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T22:51:03.072534395Z [2024-06-18 22:51:03,072: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:51:03.116677317Z [2024-06-18 22:51:03,116: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T22:51:03.120932362Z [2024-06-18 22:51:03,120: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:51:03.120950372Z [2024-06-18 22:51:03,120: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:51:03.120959265Z [2024-06-18 22:51:03,120: INFO/ForkPoolWorker-15] Read VIM d8ab743c-7a82-4d12-b942-27539d176b78 (basic_08_vim_test) 2024-06-18T22:51:03.121060903Z [2024-06-18 22:51:03,120: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'd8ab743c-7a82-4d12-b942-27539d176b78', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-06-18T22:51:03.121094441Z [2024-06-18 22:51:03,121: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T22:51:03.121367630Z [2024-06-18 22:51:03,121: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T22:51:03.121378789Z [2024-06-18 22:51:03,121: INFO/ForkPoolWorker-15] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:51:03.126510376Z [2024-06-18 22:51:03,126: INFO/ForkPoolWorker-15] Creating DAG vim_status_d8ab743c-7a82-4d12-b942-27539d176b78 2024-06-18T22:51:03.244202599Z [2024-06-18 22:51:03,243: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:51:03.278274925Z [2024-06-18 22:51:03,277: INFO/ForkPoolWorker-3] Getting VIM list 2024-06-18T22:51:03.282198340Z [2024-06-18 22:51:03,281: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:51:03.308614840Z [2024-06-18 22:51:03,308: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-06-18T22:51:03.309979597Z [2024-06-18 22:51:03,309: INFO/ForkPoolWorker-3] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:51:03.310043596Z [2024-06-18 22:51:03,309: INFO/ForkPoolWorker-3] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:51:03.310093191Z [2024-06-18 22:51:03,309: INFO/ForkPoolWorker-3] Read VIM d8ab743c-7a82-4d12-b942-27539d176b78 (basic_08_vim_test) 2024-06-18T22:51:03.310271502Z [2024-06-18 22:51:03,310: INFO/ForkPoolWorker-3] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'd8ab743c-7a82-4d12-b942-27539d176b78', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-06-18T22:51:03.310371102Z [2024-06-18 22:51:03,310: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-06-18T22:51:03.310659648Z [2024-06-18 22:51:03,310: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-06-18T22:51:03.310687521Z [2024-06-18 22:51:03,310: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:51:03.315095407Z [2024-06-18 22:51:03,314: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_d8ab743c-7a82-4d12-b942-27539d176b78 2024-06-18T22:51:03.359965185Z [2024-06-18 22:51:03,359: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-18T22:51:03.363640787Z [2024-06-18 22:51:03,363: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:51:03.394054263Z [2024-06-18 22:51:03,393: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:51:03.400203451Z [2024-06-18 22:51:03,399: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-18T22:51:03.400634081Z [2024-06-18 22:51:03,400: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:51:03.400722336Z [2024-06-18 22:51:03,400: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:51:03.400837135Z [2024-06-18 22:51:03,400: INFO/ForkPoolWorker-2] Read VIM d8ab743c-7a82-4d12-b942-27539d176b78 (basic_08_vim_test) 2024-06-18T22:51:03.400983717Z [2024-06-18 22:51:03,400: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'd8ab743c-7a82-4d12-b942-27539d176b78', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-06-18T22:51:03.401033298Z [2024-06-18 22:51:03,400: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-18T22:51:03.401298469Z [2024-06-18 22:51:03,401: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-06-18T22:51:03.401349738Z [2024-06-18 22:51:03,401: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:51:03.407669427Z [2024-06-18 22:51:03,407: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_d8ab743c-7a82-4d12-b942-27539d176b78 2024-06-18T22:51:03.478601195Z [2024-06-18 22:51:03,478: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-18T22:51:03.482395299Z [2024-06-18 22:51:03,481: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:51:03.513178770Z [2024-06-18 22:51:03,512: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T22:51:03.515894918Z [2024-06-18 22:51:03,515: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:51:03.516202072Z [2024-06-18 22:51:03,516: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:51:03.516366496Z [2024-06-18 22:51:03,516: INFO/ForkPoolWorker-1] Read VIM d8ab743c-7a82-4d12-b942-27539d176b78 (basic_08_vim_test) 2024-06-18T22:51:03.516610824Z [2024-06-18 22:51:03,516: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'd8ab743c-7a82-4d12-b942-27539d176b78', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-06-18T22:51:03.516760514Z [2024-06-18 22:51:03,516: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-18T22:51:03.517134395Z [2024-06-18 22:51:03,516: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T22:51:03.517320160Z [2024-06-18 22:51:03,517: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:51:03.531257220Z [2024-06-18 22:51:03,530: INFO/ForkPoolWorker-1] Creating DAG vim_status_d8ab743c-7a82-4d12-b942-27539d176b78 2024-06-18T22:51:03.535237789Z [2024-06-18 22:51:03,534: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:51:03.607117024Z [2024-06-18 22:51:03,606: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:51:05.041839194Z [2024-06-18 22:51:05,041: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4e09010d-b546-434c-85d7-7da823457626] succeeded in 4.336480170999948s: None 2024-06-18T22:51:05.389294547Z [2024-06-18 22:51:05,388: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ef8788f6-83e1-45ce-82d4-f48837f1fb7d] succeeded in 4.661840049000148s: None 2024-06-18T22:51:05.806884624Z [2024-06-18 22:51:05,806: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[42c848a4-3801-4724-834c-9fecc0527e58] succeeded in 5.0655094379999355s: None 2024-06-18T22:51:05.827594578Z [2024-06-18 22:51:05,827: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b4e5bdaf-ed93-4bbc-8ed5-4eeb76c823a7] succeeded in 5.095358975999716s: None 2024-06-18T22:52:00.641739074Z [2024-06-18 22:52:00,640: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[760c3568-59b8-4baf-81d5-cb93982cd24e] received 2024-06-18T22:52:00.647525820Z [2024-06-18 22:52:00,647: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[60018d3c-e2e6-4c2f-b125-b20fc626a164] received 2024-06-18T22:52:00.662553772Z [2024-06-18 22:52:00,662: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bc16de9e-be3e-4fe5-8030-82eb6311313f] received 2024-06-18T22:52:00.667087708Z [2024-06-18 22:52:00,666: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9a7f7e35-9e7d-45a6-875a-1aa8bceee3c2] received 2024-06-18T22:52:00.668085833Z [2024-06-18 22:52:00,667: INFO/ForkPoolWorker-15] [760c3568-59b8-4baf-81d5-cb93982cd24e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T22:52:00.668745170Z [2024-06-18 22:52:00,668: INFO/ForkPoolWorker-16] [60018d3c-e2e6-4c2f-b125-b20fc626a164] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_d8ab743c-7a82-4d12-b942-27539d176b78', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T22:52:00.675168202Z [2024-06-18 22:52:00,674: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c499ffe3-f96b-41f6-973f-3c57b8f660fa] received 2024-06-18T22:52:00.676621545Z [2024-06-18 22:52:00,676: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a41d036c-a53b-4da1-8d36-7dae23609f88] received 2024-06-18T22:52:00.687251516Z [2024-06-18 22:52:00,686: INFO/ForkPoolWorker-3] [c499ffe3-f96b-41f6-973f-3c57b8f660fa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T22:52:00.704793619Z [2024-06-18 22:52:00,704: INFO/ForkPoolWorker-2] [9a7f7e35-9e7d-45a6-875a-1aa8bceee3c2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_d8ab743c-7a82-4d12-b942-27539d176b78', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T22:52:00.706473853Z [2024-06-18 22:52:00,706: INFO/ForkPoolWorker-4] [a41d036c-a53b-4da1-8d36-7dae23609f88] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T22:52:00.707331461Z [2024-06-18 22:52:00,707: INFO/ForkPoolWorker-1] [bc16de9e-be3e-4fe5-8030-82eb6311313f] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-18T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-18T22:52:01.182232244Z [2024-06-18 22:52:01,168: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T22:52:01.221637288Z [2024-06-18 22:52:01,212: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-18T22:52:01.273555568Z [2024-06-18 22:52:01,269: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T22:52:01.277206372Z [2024-06-18 22:52:01,246: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T22:52:01.356717709Z [2024-06-18 22:52:01,356: INFO/ForkPoolWorker-15] Getting SDNC list 2024-06-18T22:52:01.361366611Z [2024-06-18 22:52:01,360: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:52:01.397967002Z [2024-06-18 22:52:01,391: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T22:52:01.409095404Z [2024-06-18 22:52:01,408: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T22:52:01.411466547Z [2024-06-18 22:52:01,411: INFO/ForkPoolWorker-15] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T22:52:01.411614763Z [2024-06-18 22:52:01,411: INFO/ForkPoolWorker-15] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T22:52:01.411747952Z [2024-06-18 22:52:01,411: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-06-18T22:52:01.412129360Z [2024-06-18 22:52:01,411: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T22:52:01.488129977Z [2024-06-18 22:52:01,468: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T22:52:01.704506365Z [2024-06-18 22:52:01,704: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:52:01.968758238Z [2024-06-18 22:52:01,968: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:52:02.701731266Z [2024-06-18 22:52:02,701: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[760c3568-59b8-4baf-81d5-cb93982cd24e] succeeded in 2.0475280689997817s: None 2024-06-18T22:52:02.916631871Z [2024-06-18 22:52:02,916: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[bc16de9e-be3e-4fe5-8030-82eb6311313f] succeeded in 2.2305496620001577s: None 2024-06-18T22:52:03.375070998Z [2024-06-18 22:52:03,374: INFO/ForkPoolWorker-4] Getting VIM list 2024-06-18T22:52:03.378814205Z [2024-06-18 22:52:03,378: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:52:03.427490509Z [2024-06-18 22:52:03,427: INFO/ForkPoolWorker-4] Connected to database osm version 1.2 2024-06-18T22:52:03.433110757Z [2024-06-18 22:52:03,432: INFO/ForkPoolWorker-4] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:52:03.433234878Z [2024-06-18 22:52:03,433: INFO/ForkPoolWorker-4] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:52:03.433435083Z [2024-06-18 22:52:03,433: INFO/ForkPoolWorker-4] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:52:03.433543812Z [2024-06-18 22:52:03,433: INFO/ForkPoolWorker-4] Getting VIM list OK 2024-06-18T22:52:03.433948265Z [2024-06-18 22:52:03,433: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for collecting VM status 2024-06-18T22:52:03.434051198Z [2024-06-18 22:52:03,433: INFO/ForkPoolWorker-4] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:52:03.532005844Z [2024-06-18 22:52:03,531: INFO/ForkPoolWorker-4] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:52:03.635077787Z [2024-06-18 22:52:03,634: INFO/ForkPoolWorker-3] Getting VIM list 2024-06-18T22:52:03.640741491Z [2024-06-18 22:52:03,640: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-18T22:52:03.642430063Z [2024-06-18 22:52:03,641: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:52:03.650653798Z [2024-06-18 22:52:03,649: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:52:03.703520881Z [2024-06-18 22:52:03,703: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-18T22:52:03.703748151Z [2024-06-18 22:52:03,703: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-06-18T22:52:03.705081624Z [2024-06-18 22:52:03,704: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:52:03.705160054Z [2024-06-18 22:52:03,704: INFO/ForkPoolWorker-3] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:52:03.705200097Z [2024-06-18 22:52:03,705: INFO/ForkPoolWorker-3] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:52:03.705279204Z [2024-06-18 22:52:03,705: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:52:03.705303584Z [2024-06-18 22:52:03,705: INFO/ForkPoolWorker-3] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:52:03.705389335Z [2024-06-18 22:52:03,705: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-06-18T22:52:03.705599350Z [2024-06-18 22:52:03,705: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:52:03.705637935Z [2024-06-18 22:52:03,705: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T22:52:03.705730603Z [2024-06-18 22:52:03,705: INFO/ForkPoolWorker-3] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:52:03.705801281Z [2024-06-18 22:52:03,705: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-18T22:52:03.706138789Z [2024-06-18 22:52:03,705: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T22:52:03.706269903Z [2024-06-18 22:52:03,706: INFO/ForkPoolWorker-2] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:52:03.713073216Z [2024-06-18 22:52:03,712: WARNING/ForkPoolWorker-2] Dag 'vim_status_d8ab743c-7a82-4d12-b942-27539d176b78' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T22:52:03.714217118Z [2024-06-18 22:52:03,713: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T22:52:03.716445516Z [2024-06-18 22:52:03,716: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-18T22:52:03.719393544Z [2024-06-18 22:52:03,719: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:52:03.734630198Z [2024-06-18 22:52:03,734: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-18T22:52:03.737148966Z [2024-06-18 22:52:03,736: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:52:03.737302732Z [2024-06-18 22:52:03,737: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:52:03.737581206Z [2024-06-18 22:52:03,737: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:52:03.737639873Z [2024-06-18 22:52:03,737: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-18T22:52:03.738066960Z [2024-06-18 22:52:03,737: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T22:52:03.738108600Z [2024-06-18 22:52:03,737: INFO/ForkPoolWorker-2] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:52:03.742343874Z [2024-06-18 22:52:03,741: ERROR/ForkPoolWorker-2] [9a7f7e35-9e7d-45a6-875a-1aa8bceee3c2] Failed to execute task Dag 'vim_status_d8ab743c-7a82-4d12-b942-27539d176b78' could not be found; either it does not exist or it failed to parse.. 2024-06-18T22:52:03.742371378Z Traceback (most recent call last): 2024-06-18T22:52:03.742382344Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-06-18T22:52:03.742392500Z args.func(args) 2024-06-18T22:52:03.742401927Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-06-18T22:52:03.742411588Z return func(*args, **kwargs) 2024-06-18T22:52:03.742419900Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-06-18T22:52:03.742428578Z return f(*args, **kwargs) 2024-06-18T22:52:03.742437419Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-06-18T22:52:03.742446033Z dag = get_dag(args.subdir, args.dag_id) 2024-06-18T22:52:03.742454484Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-06-18T22:52:03.742462891Z raise AirflowException( 2024-06-18T22:52:03.742472180Z airflow.exceptions.AirflowException: Dag 'vim_status_d8ab743c-7a82-4d12-b942-27539d176b78' could not be found; either it does not exist or it failed to parse. 2024-06-18T22:52:03.793634046Z [2024-06-18 22:52:03,793: ERROR/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[9a7f7e35-9e7d-45a6-875a-1aa8bceee3c2] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 9a7f7e35-9e7d-45a6-875a-1aa8bceee3c2') 2024-06-18T22:52:03.793663668Z Traceback (most recent call last): 2024-06-18T22:52:03.793671536Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-06-18T22:52:03.793676763Z R = retval = fun(*args, **kwargs) 2024-06-18T22:52:03.793681584Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-06-18T22:52:03.793686764Z return self.run(*args, **kwargs) 2024-06-18T22:52:03.793692336Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-06-18T22:52:03.793716227Z _execute_in_fork(command_to_exec, celery_task_id) 2024-06-18T22:52:03.793721194Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-06-18T22:52:03.793726514Z raise AirflowException(msg) 2024-06-18T22:52:03.793731955Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 9a7f7e35-9e7d-45a6-875a-1aa8bceee3c2 2024-06-18T22:52:03.843229913Z [2024-06-18 22:52:03,842: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-18T22:52:03.847008948Z [2024-06-18 22:52:03,846: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:52:03.851899410Z [2024-06-18 22:52:03,851: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:52:03.884479216Z [2024-06-18 22:52:03,884: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T22:52:03.886056702Z [2024-06-18 22:52:03,885: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:52:03.886690228Z [2024-06-18 22:52:03,886: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:52:03.886928608Z [2024-06-18 22:52:03,886: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:52:03.887026396Z [2024-06-18 22:52:03,886: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-18T22:52:03.887338922Z [2024-06-18 22:52:03,887: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-18T22:52:03.887441492Z [2024-06-18 22:52:03,887: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:52:03.897227367Z [2024-06-18 22:52:03,896: WARNING/ForkPoolWorker-16] Dag 'vm_status_vim_d8ab743c-7a82-4d12-b942-27539d176b78' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T22:52:03.903649997Z [2024-06-18 22:52:03,900: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T22:52:03.904707753Z [2024-06-18 22:52:03,904: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-18T22:52:03.907424339Z [2024-06-18 22:52:03,907: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:52:03.918461847Z [2024-06-18 22:52:03,918: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T22:52:03.919975792Z [2024-06-18 22:52:03,919: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:52:03.920184458Z [2024-06-18 22:52:03,920: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:52:03.920480335Z [2024-06-18 22:52:03,920: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:52:03.920690711Z [2024-06-18 22:52:03,920: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-18T22:52:03.921155942Z [2024-06-18 22:52:03,920: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-18T22:52:03.921393840Z [2024-06-18 22:52:03,921: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:52:03.926107578Z [2024-06-18 22:52:03,925: ERROR/ForkPoolWorker-16] [60018d3c-e2e6-4c2f-b125-b20fc626a164] Failed to execute task Dag 'vm_status_vim_d8ab743c-7a82-4d12-b942-27539d176b78' could not be found; either it does not exist or it failed to parse.. 2024-06-18T22:52:03.926121322Z Traceback (most recent call last): 2024-06-18T22:52:03.926125083Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-06-18T22:52:03.926128856Z args.func(args) 2024-06-18T22:52:03.926132349Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-06-18T22:52:03.926136273Z return func(*args, **kwargs) 2024-06-18T22:52:03.926139121Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-06-18T22:52:03.926142065Z return f(*args, **kwargs) 2024-06-18T22:52:03.926144900Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-06-18T22:52:03.926147612Z dag = get_dag(args.subdir, args.dag_id) 2024-06-18T22:52:03.926150386Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-06-18T22:52:03.926153313Z raise AirflowException( 2024-06-18T22:52:03.926156825Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_d8ab743c-7a82-4d12-b942-27539d176b78' could not be found; either it does not exist or it failed to parse. 2024-06-18T22:52:03.995750920Z [2024-06-18 22:52:03,995: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[60018d3c-e2e6-4c2f-b125-b20fc626a164] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 60018d3c-e2e6-4c2f-b125-b20fc626a164') 2024-06-18T22:52:03.995790455Z Traceback (most recent call last): 2024-06-18T22:52:03.995794852Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-06-18T22:52:03.995797871Z R = retval = fun(*args, **kwargs) 2024-06-18T22:52:03.995801346Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-06-18T22:52:03.995804137Z return self.run(*args, **kwargs) 2024-06-18T22:52:03.995808468Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-06-18T22:52:03.995812154Z _execute_in_fork(command_to_exec, celery_task_id) 2024-06-18T22:52:03.995815086Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-06-18T22:52:03.995819188Z raise AirflowException(msg) 2024-06-18T22:52:03.995823114Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 60018d3c-e2e6-4c2f-b125-b20fc626a164 2024-06-18T22:52:05.435400443Z [2024-06-18 22:52:05,434: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[c499ffe3-f96b-41f6-973f-3c57b8f660fa] succeeded in 4.757830517999992s: None 2024-06-18T22:52:05.567555625Z [2024-06-18 22:52:05,567: INFO/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[a41d036c-a53b-4da1-8d36-7dae23609f88] succeeded in 4.884124952000093s: None 2024-06-18T22:52:14.960740271Z [2024-06-18 22:52:14,960: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fc2c00ea-d579-445e-b5a1-2f2ceae1f881] received 2024-06-18T22:52:14.972412010Z [2024-06-18 22:52:14,972: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[de2175d1-cd06-4aff-987b-261683558d6e] received 2024-06-18T22:52:14.972936311Z [2024-06-18 22:52:14,972: INFO/ForkPoolWorker-15] [fc2c00ea-d579-445e-b5a1-2f2ceae1f881] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_d8ab743c-7a82-4d12-b942-27539d176b78', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T22:52:14.985110222Z [2024-06-18 22:52:14,983: INFO/ForkPoolWorker-16] [de2175d1-cd06-4aff-987b-261683558d6e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_d8ab743c-7a82-4d12-b942-27539d176b78', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T22:52:15.374773649Z [2024-06-18 22:52:15,368: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T22:52:15.414830141Z [2024-06-18 22:52:15,411: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T22:52:16.596805337Z [2024-06-18 22:52:16,596: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-18T22:52:16.600708661Z [2024-06-18 22:52:16,600: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:52:16.624248811Z [2024-06-18 22:52:16,623: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T22:52:16.625701644Z [2024-06-18 22:52:16,625: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:52:16.625789827Z [2024-06-18 22:52:16,625: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:52:16.626037774Z [2024-06-18 22:52:16,625: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:52:16.626060550Z [2024-06-18 22:52:16,625: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-18T22:52:16.626408818Z [2024-06-18 22:52:16,626: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-18T22:52:16.626426453Z [2024-06-18 22:52:16,626: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:52:16.634174593Z [2024-06-18 22:52:16,633: WARNING/ForkPoolWorker-16] Dag 'vm_status_vim_d8ab743c-7a82-4d12-b942-27539d176b78' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T22:52:16.635309779Z [2024-06-18 22:52:16,634: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T22:52:16.636603172Z [2024-06-18 22:52:16,636: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-18T22:52:16.639753538Z [2024-06-18 22:52:16,639: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:52:16.671213720Z [2024-06-18 22:52:16,670: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T22:52:16.672790954Z [2024-06-18 22:52:16,672: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:52:16.672801528Z [2024-06-18 22:52:16,672: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:52:16.673008650Z [2024-06-18 22:52:16,672: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:52:16.678322848Z [2024-06-18 22:52:16,672: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-18T22:52:16.678837032Z [2024-06-18 22:52:16,678: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-18T22:52:16.679096726Z [2024-06-18 22:52:16,678: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:52:16.681492196Z [2024-06-18 22:52:16,681: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T22:52:16.683196096Z [2024-06-18 22:52:16,682: ERROR/ForkPoolWorker-16] [de2175d1-cd06-4aff-987b-261683558d6e] Failed to execute task Dag 'vm_status_vim_d8ab743c-7a82-4d12-b942-27539d176b78' could not be found; either it does not exist or it failed to parse.. 2024-06-18T22:52:16.683217336Z Traceback (most recent call last): 2024-06-18T22:52:16.683225976Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-06-18T22:52:16.683234392Z args.func(args) 2024-06-18T22:52:16.683261898Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-06-18T22:52:16.683268673Z return func(*args, **kwargs) 2024-06-18T22:52:16.683274692Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-06-18T22:52:16.683281028Z return f(*args, **kwargs) 2024-06-18T22:52:16.683287288Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-06-18T22:52:16.683293505Z dag = get_dag(args.subdir, args.dag_id) 2024-06-18T22:52:16.683299701Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-06-18T22:52:16.683305828Z raise AirflowException( 2024-06-18T22:52:16.683312887Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_d8ab743c-7a82-4d12-b942-27539d176b78' could not be found; either it does not exist or it failed to parse. 2024-06-18T22:52:16.685062534Z [2024-06-18 22:52:16,684: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:52:16.704281417Z [2024-06-18 22:52:16,703: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T22:52:16.705875562Z [2024-06-18 22:52:16,705: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:52:16.706444350Z [2024-06-18 22:52:16,706: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:52:16.708573942Z [2024-06-18 22:52:16,706: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:52:16.708621848Z [2024-06-18 22:52:16,707: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T22:52:16.708628508Z [2024-06-18 22:52:16,707: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T22:52:16.708633549Z [2024-06-18 22:52:16,708: INFO/ForkPoolWorker-15] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:52:16.715245984Z [2024-06-18 22:52:16,714: WARNING/ForkPoolWorker-15] Dag 'vim_status_d8ab743c-7a82-4d12-b942-27539d176b78' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T22:52:16.716338140Z [2024-06-18 22:52:16,715: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T22:52:16.717300395Z [2024-06-18 22:52:16,717: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T22:52:16.720016497Z [2024-06-18 22:52:16,719: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:52:16.726477502Z [2024-06-18 22:52:16,725: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[de2175d1-cd06-4aff-987b-261683558d6e] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id de2175d1-cd06-4aff-987b-261683558d6e') 2024-06-18T22:52:16.726500473Z Traceback (most recent call last): 2024-06-18T22:52:16.726506312Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-06-18T22:52:16.726510779Z R = retval = fun(*args, **kwargs) 2024-06-18T22:52:16.726515005Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-06-18T22:52:16.726519246Z return self.run(*args, **kwargs) 2024-06-18T22:52:16.726524164Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-06-18T22:52:16.726529336Z _execute_in_fork(command_to_exec, celery_task_id) 2024-06-18T22:52:16.726533564Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-06-18T22:52:16.726539111Z raise AirflowException(msg) 2024-06-18T22:52:16.726544386Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id de2175d1-cd06-4aff-987b-261683558d6e 2024-06-18T22:52:16.737715859Z [2024-06-18 22:52:16,737: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T22:52:16.739859050Z [2024-06-18 22:52:16,739: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:52:16.740128014Z [2024-06-18 22:52:16,739: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:52:16.740395148Z [2024-06-18 22:52:16,740: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:52:16.740573775Z [2024-06-18 22:52:16,740: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T22:52:16.741223520Z [2024-06-18 22:52:16,740: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T22:52:16.741477036Z [2024-06-18 22:52:16,741: INFO/ForkPoolWorker-15] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:52:16.747791539Z [2024-06-18 22:52:16,746: ERROR/ForkPoolWorker-15] [fc2c00ea-d579-445e-b5a1-2f2ceae1f881] Failed to execute task Dag 'vim_status_d8ab743c-7a82-4d12-b942-27539d176b78' could not be found; either it does not exist or it failed to parse.. 2024-06-18T22:52:16.747805692Z Traceback (most recent call last): 2024-06-18T22:52:16.747810987Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-06-18T22:52:16.747816755Z args.func(args) 2024-06-18T22:52:16.747832524Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-06-18T22:52:16.747838367Z return func(*args, **kwargs) 2024-06-18T22:52:16.747842567Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-06-18T22:52:16.747847066Z return f(*args, **kwargs) 2024-06-18T22:52:16.747851538Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-06-18T22:52:16.747856113Z dag = get_dag(args.subdir, args.dag_id) 2024-06-18T22:52:16.747860111Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-06-18T22:52:16.747864060Z raise AirflowException( 2024-06-18T22:52:16.747869061Z airflow.exceptions.AirflowException: Dag 'vim_status_d8ab743c-7a82-4d12-b942-27539d176b78' could not be found; either it does not exist or it failed to parse. 2024-06-18T22:52:16.778637951Z [2024-06-18 22:52:16,778: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fc2c00ea-d579-445e-b5a1-2f2ceae1f881] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id fc2c00ea-d579-445e-b5a1-2f2ceae1f881') 2024-06-18T22:52:16.778655449Z Traceback (most recent call last): 2024-06-18T22:52:16.778659723Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-06-18T22:52:16.778662935Z R = retval = fun(*args, **kwargs) 2024-06-18T22:52:16.778665936Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-06-18T22:52:16.778669070Z return self.run(*args, **kwargs) 2024-06-18T22:52:16.778672812Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-06-18T22:52:16.778677066Z _execute_in_fork(command_to_exec, celery_task_id) 2024-06-18T22:52:16.778679966Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-06-18T22:52:16.778683336Z raise AirflowException(msg) 2024-06-18T22:52:16.778686947Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id fc2c00ea-d579-445e-b5a1-2f2ceae1f881 2024-06-18T22:53:00.627340977Z [2024-06-18 22:53:00,626: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[66652008-d72a-4694-8738-637a0fd06d4f] received 2024-06-18T22:53:00.629289165Z [2024-06-18 22:53:00,629: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1346376e-99bd-4f52-9d96-007ae474b3d6] received 2024-06-18T22:53:00.640252954Z [2024-06-18 22:53:00,639: INFO/ForkPoolWorker-15] [66652008-d72a-4694-8738-637a0fd06d4f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_d8ab743c-7a82-4d12-b942-27539d176b78', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T22:53:00.652182794Z [2024-06-18 22:53:00,651: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8f2ea731-b871-4ffd-9aeb-4cd5727edaf0] received 2024-06-18T22:53:00.652804886Z [2024-06-18 22:53:00,652: INFO/ForkPoolWorker-16] [1346376e-99bd-4f52-9d96-007ae474b3d6] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T22:53:00.655414668Z [2024-06-18 22:53:00,655: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[79f92c2b-11a1-4269-aeba-31fe7718758d] received 2024-06-18T22:53:00.657360076Z [2024-06-18 22:53:00,657: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[156f2dea-c524-4fee-9aee-05f15aeafe28] received 2024-06-18T22:53:00.670552805Z [2024-06-18 22:53:00,670: INFO/ForkPoolWorker-3] [156f2dea-c524-4fee-9aee-05f15aeafe28] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T22:53:00.681372256Z [2024-06-18 22:53:00,680: INFO/ForkPoolWorker-1] [8f2ea731-b871-4ffd-9aeb-4cd5727edaf0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T22:53:00.682064066Z [2024-06-18 22:53:00,681: INFO/ForkPoolWorker-2] [79f92c2b-11a1-4269-aeba-31fe7718758d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_d8ab743c-7a82-4d12-b942-27539d176b78', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T22:53:01.044306382Z [2024-06-18 22:53:01,040: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T22:53:01.089699120Z [2024-06-18 22:53:01,086: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T22:53:01.124266157Z [2024-06-18 22:53:01,113: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T22:53:01.159712094Z [2024-06-18 22:53:01,153: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T22:53:01.172107372Z [2024-06-18 22:53:01,168: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T22:53:01.581125981Z [2024-06-18 22:53:01,580: INFO/ForkPoolWorker-16] Getting SDNC list 2024-06-18T22:53:01.585374410Z [2024-06-18 22:53:01,584: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:53:01.642608353Z [2024-06-18 22:53:01,642: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T22:53:01.648248239Z [2024-06-18 22:53:01,647: INFO/ForkPoolWorker-16] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T22:53:01.648301237Z [2024-06-18 22:53:01,648: INFO/ForkPoolWorker-16] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T22:53:01.648351788Z [2024-06-18 22:53:01,648: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-06-18T22:53:01.648550535Z [2024-06-18 22:53:01,648: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T22:53:01.756299152Z [2024-06-18 22:53:01,756: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:53:02.538209963Z [2024-06-18 22:53:02,537: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T22:53:02.541738740Z [2024-06-18 22:53:02,541: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:53:02.582497524Z [2024-06-18 22:53:02,582: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1346376e-99bd-4f52-9d96-007ae474b3d6] succeeded in 1.9429706500000066s: None 2024-06-18T22:53:02.583500914Z [2024-06-18 22:53:02,583: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T22:53:02.586790044Z [2024-06-18 22:53:02,586: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:53:02.586915507Z [2024-06-18 22:53:02,586: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:53:02.587102860Z [2024-06-18 22:53:02,586: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:53:02.587271352Z [2024-06-18 22:53:02,587: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T22:53:02.587616724Z [2024-06-18 22:53:02,587: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T22:53:02.588551553Z [2024-06-18 22:53:02,588: INFO/ForkPoolWorker-15] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:53:02.594939586Z [2024-06-18 22:53:02,594: INFO/ForkPoolWorker-3] Getting VIM list 2024-06-18T22:53:02.598601380Z [2024-06-18 22:53:02,598: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:53:02.600210695Z [2024-06-18 22:53:02,600: WARNING/ForkPoolWorker-15] Dag 'vim_status_d8ab743c-7a82-4d12-b942-27539d176b78' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T22:53:02.601159241Z [2024-06-18 22:53:02,600: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T22:53:02.602253522Z [2024-06-18 22:53:02,601: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T22:53:02.606144974Z [2024-06-18 22:53:02,605: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:53:02.627369298Z [2024-06-18 22:53:02,627: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T22:53:02.628722674Z [2024-06-18 22:53:02,628: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:53:02.628964205Z [2024-06-18 22:53:02,628: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:53:02.629182046Z [2024-06-18 22:53:02,628: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:53:02.629341653Z [2024-06-18 22:53:02,629: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T22:53:02.629752499Z [2024-06-18 22:53:02,629: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T22:53:02.629902378Z [2024-06-18 22:53:02,629: INFO/ForkPoolWorker-15] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:53:02.633577261Z [2024-06-18 22:53:02,632: ERROR/ForkPoolWorker-15] [66652008-d72a-4694-8738-637a0fd06d4f] Failed to execute task Dag 'vim_status_d8ab743c-7a82-4d12-b942-27539d176b78' could not be found; either it does not exist or it failed to parse.. 2024-06-18T22:53:02.633595756Z Traceback (most recent call last): 2024-06-18T22:53:02.633599830Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-06-18T22:53:02.633610841Z args.func(args) 2024-06-18T22:53:02.633614404Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-06-18T22:53:02.633618246Z return func(*args, **kwargs) 2024-06-18T22:53:02.633621411Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-06-18T22:53:02.633624576Z return f(*args, **kwargs) 2024-06-18T22:53:02.633627714Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-06-18T22:53:02.633631300Z dag = get_dag(args.subdir, args.dag_id) 2024-06-18T22:53:02.633634345Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-06-18T22:53:02.633637963Z raise AirflowException( 2024-06-18T22:53:02.633641685Z airflow.exceptions.AirflowException: Dag 'vim_status_d8ab743c-7a82-4d12-b942-27539d176b78' could not be found; either it does not exist or it failed to parse. 2024-06-18T22:53:02.642827303Z [2024-06-18 22:53:02,642: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-06-18T22:53:02.646304287Z [2024-06-18 22:53:02,646: INFO/ForkPoolWorker-3] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:53:02.646325850Z [2024-06-18 22:53:02,646: INFO/ForkPoolWorker-3] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:53:02.646490999Z [2024-06-18 22:53:02,646: INFO/ForkPoolWorker-3] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:53:02.646567606Z [2024-06-18 22:53:02,646: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-06-18T22:53:02.646835872Z [2024-06-18 22:53:02,646: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T22:53:02.646872919Z [2024-06-18 22:53:02,646: INFO/ForkPoolWorker-3] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:53:02.683445804Z [2024-06-18 22:53:02,682: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[66652008-d72a-4694-8738-637a0fd06d4f] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 66652008-d72a-4694-8738-637a0fd06d4f') 2024-06-18T22:53:02.683467417Z Traceback (most recent call last): 2024-06-18T22:53:02.683471561Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-06-18T22:53:02.683491724Z R = retval = fun(*args, **kwargs) 2024-06-18T22:53:02.683494849Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-06-18T22:53:02.683497870Z return self.run(*args, **kwargs) 2024-06-18T22:53:02.683501423Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-06-18T22:53:02.683504915Z _execute_in_fork(command_to_exec, celery_task_id) 2024-06-18T22:53:02.683507839Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-06-18T22:53:02.683511636Z raise AirflowException(msg) 2024-06-18T22:53:02.683515110Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 66652008-d72a-4694-8738-637a0fd06d4f 2024-06-18T22:53:02.772386903Z [2024-06-18 22:53:02,772: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:53:02.816876180Z [2024-06-18 22:53:02,816: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-18T22:53:02.821181204Z [2024-06-18 22:53:02,820: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:53:02.842867085Z [2024-06-18 22:53:02,842: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T22:53:02.844442785Z [2024-06-18 22:53:02,844: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:53:02.844502089Z [2024-06-18 22:53:02,844: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:53:02.844531511Z [2024-06-18 22:53:02,844: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:53:02.844602991Z [2024-06-18 22:53:02,844: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-18T22:53:02.844830567Z [2024-06-18 22:53:02,844: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-06-18T22:53:02.844861107Z [2024-06-18 22:53:02,844: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:53:02.922229230Z [2024-06-18 22:53:02,921: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:53:03.199952268Z [2024-06-18 22:53:03,199: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-18T22:53:03.203592874Z [2024-06-18 22:53:03,203: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:53:03.222496313Z [2024-06-18 22:53:03,222: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-18T22:53:03.223930533Z [2024-06-18 22:53:03,223: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:53:03.224131474Z [2024-06-18 22:53:03,223: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:53:03.224193015Z [2024-06-18 22:53:03,223: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:53:03.224198186Z [2024-06-18 22:53:03,223: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-18T22:53:03.224220433Z [2024-06-18 22:53:03,224: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-06-18T22:53:03.224290536Z [2024-06-18 22:53:03,224: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:53:03.232379645Z [2024-06-18 22:53:03,232: WARNING/ForkPoolWorker-2] Dag 'vm_status_vim_d8ab743c-7a82-4d12-b942-27539d176b78' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T22:53:03.233402910Z [2024-06-18 22:53:03,232: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T22:53:03.234580270Z [2024-06-18 22:53:03,234: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-18T22:53:03.238530476Z [2024-06-18 22:53:03,238: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:53:03.273280557Z [2024-06-18 22:53:03,273: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-18T22:53:03.274611535Z [2024-06-18 22:53:03,274: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:53:03.274631154Z [2024-06-18 22:53:03,274: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:53:03.274752053Z [2024-06-18 22:53:03,274: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:53:03.274761625Z [2024-06-18 22:53:03,274: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-18T22:53:03.275030822Z [2024-06-18 22:53:03,274: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-06-18T22:53:03.275103751Z [2024-06-18 22:53:03,274: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:53:03.278540174Z [2024-06-18 22:53:03,277: ERROR/ForkPoolWorker-2] [79f92c2b-11a1-4269-aeba-31fe7718758d] Failed to execute task Dag 'vm_status_vim_d8ab743c-7a82-4d12-b942-27539d176b78' could not be found; either it does not exist or it failed to parse.. 2024-06-18T22:53:03.278579969Z Traceback (most recent call last): 2024-06-18T22:53:03.278584141Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-06-18T22:53:03.278587627Z args.func(args) 2024-06-18T22:53:03.278591758Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-06-18T22:53:03.278595382Z return func(*args, **kwargs) 2024-06-18T22:53:03.278598349Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-06-18T22:53:03.278601369Z return f(*args, **kwargs) 2024-06-18T22:53:03.278621786Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-06-18T22:53:03.278625020Z dag = get_dag(args.subdir, args.dag_id) 2024-06-18T22:53:03.278640024Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-06-18T22:53:03.278643081Z raise AirflowException( 2024-06-18T22:53:03.278658116Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_d8ab743c-7a82-4d12-b942-27539d176b78' could not be found; either it does not exist or it failed to parse. 2024-06-18T22:53:03.312068036Z [2024-06-18 22:53:03,311: ERROR/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[79f92c2b-11a1-4269-aeba-31fe7718758d] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 79f92c2b-11a1-4269-aeba-31fe7718758d') 2024-06-18T22:53:03.312086699Z Traceback (most recent call last): 2024-06-18T22:53:03.312090944Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-06-18T22:53:03.312094118Z R = retval = fun(*args, **kwargs) 2024-06-18T22:53:03.312097486Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-06-18T22:53:03.312100656Z return self.run(*args, **kwargs) 2024-06-18T22:53:03.312104989Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-06-18T22:53:03.312108635Z _execute_in_fork(command_to_exec, celery_task_id) 2024-06-18T22:53:03.312111826Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-06-18T22:53:03.312115409Z raise AirflowException(msg) 2024-06-18T22:53:03.312119144Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 79f92c2b-11a1-4269-aeba-31fe7718758d 2024-06-18T22:53:04.637304700Z [2024-06-18 22:53:04,636: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[156f2dea-c524-4fee-9aee-05f15aeafe28] succeeded in 3.976572304000001s: None 2024-06-18T22:53:05.241615972Z [2024-06-18 22:53:05,241: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8f2ea731-b871-4ffd-9aeb-4cd5727edaf0] succeeded in 4.586682517000099s: None 2024-06-18T22:53:13.720434019Z [2024-06-18 22:53:13,720: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[56df4be0-d294-452e-934d-fb1f5a4ff831] received 2024-06-18T22:53:13.727232358Z [2024-06-18 22:53:13,726: INFO/ForkPoolWorker-15] [56df4be0-d294-452e-934d-fb1f5a4ff831] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_d8ab743c-7a82-4d12-b942-27539d176b78', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T22:53:13.728719852Z [2024-06-18 22:53:13,728: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e5b4eb83-39c3-4223-ba36-eddc4cb9446e] received 2024-06-18T22:53:13.744714538Z [2024-06-18 22:53:13,744: INFO/ForkPoolWorker-16] [e5b4eb83-39c3-4223-ba36-eddc4cb9446e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_d8ab743c-7a82-4d12-b942-27539d176b78', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T22:53:14.047811483Z [2024-06-18 22:53:14,044: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T22:53:14.051624622Z [2024-06-18 22:53:14,048: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T22:53:15.263928205Z [2024-06-18 22:53:15,263: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T22:53:15.267354214Z [2024-06-18 22:53:15,266: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:53:15.288379381Z [2024-06-18 22:53:15,288: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T22:53:15.289700167Z [2024-06-18 22:53:15,289: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:53:15.289842256Z [2024-06-18 22:53:15,289: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:53:15.290049864Z [2024-06-18 22:53:15,289: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:53:15.290176996Z [2024-06-18 22:53:15,290: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T22:53:15.290487728Z [2024-06-18 22:53:15,290: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-06-18T22:53:15.290613069Z [2024-06-18 22:53:15,290: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:53:15.296679430Z [2024-06-18 22:53:15,296: WARNING/ForkPoolWorker-15] Dag 'vm_status_vim_d8ab743c-7a82-4d12-b942-27539d176b78' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T22:53:15.297689051Z [2024-06-18 22:53:15,296: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T22:53:15.298571775Z [2024-06-18 22:53:15,298: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T22:53:15.301143138Z [2024-06-18 22:53:15,300: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:53:15.321676069Z [2024-06-18 22:53:15,321: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T22:53:15.322790265Z [2024-06-18 22:53:15,322: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:53:15.322885969Z [2024-06-18 22:53:15,322: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:53:15.323040851Z [2024-06-18 22:53:15,322: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:53:15.323105901Z [2024-06-18 22:53:15,323: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T22:53:15.323381668Z [2024-06-18 22:53:15,323: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-06-18T22:53:15.323471717Z [2024-06-18 22:53:15,323: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:53:15.326652964Z [2024-06-18 22:53:15,326: ERROR/ForkPoolWorker-15] [56df4be0-d294-452e-934d-fb1f5a4ff831] Failed to execute task Dag 'vm_status_vim_d8ab743c-7a82-4d12-b942-27539d176b78' could not be found; either it does not exist or it failed to parse.. 2024-06-18T22:53:15.326699052Z Traceback (most recent call last): 2024-06-18T22:53:15.326707388Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-06-18T22:53:15.326732470Z args.func(args) 2024-06-18T22:53:15.326739338Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-06-18T22:53:15.326746678Z return func(*args, **kwargs) 2024-06-18T22:53:15.326752755Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-06-18T22:53:15.326758754Z return f(*args, **kwargs) 2024-06-18T22:53:15.326764960Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-06-18T22:53:15.326771071Z dag = get_dag(args.subdir, args.dag_id) 2024-06-18T22:53:15.326777647Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-06-18T22:53:15.326783722Z raise AirflowException( 2024-06-18T22:53:15.326791571Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_d8ab743c-7a82-4d12-b942-27539d176b78' could not be found; either it does not exist or it failed to parse. 2024-06-18T22:53:15.365296414Z [2024-06-18 22:53:15,364: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[56df4be0-d294-452e-934d-fb1f5a4ff831] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 56df4be0-d294-452e-934d-fb1f5a4ff831') 2024-06-18T22:53:15.365322124Z Traceback (most recent call last): 2024-06-18T22:53:15.365328260Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-06-18T22:53:15.365332810Z R = retval = fun(*args, **kwargs) 2024-06-18T22:53:15.365337640Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-06-18T22:53:15.365341983Z return self.run(*args, **kwargs) 2024-06-18T22:53:15.365346713Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-06-18T22:53:15.365353232Z _execute_in_fork(command_to_exec, celery_task_id) 2024-06-18T22:53:15.365358389Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-06-18T22:53:15.365365152Z raise AirflowException(msg) 2024-06-18T22:53:15.365370741Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 56df4be0-d294-452e-934d-fb1f5a4ff831 2024-06-18T22:53:15.369238489Z [2024-06-18 22:53:15,368: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-18T22:53:15.379804312Z [2024-06-18 22:53:15,378: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:53:15.407246794Z [2024-06-18 22:53:15,406: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T22:53:15.409958253Z [2024-06-18 22:53:15,409: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:53:15.410125307Z [2024-06-18 22:53:15,409: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:53:15.410367855Z [2024-06-18 22:53:15,410: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:53:15.410509905Z [2024-06-18 22:53:15,410: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-18T22:53:15.410984430Z [2024-06-18 22:53:15,410: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T22:53:15.410991840Z [2024-06-18 22:53:15,410: INFO/ForkPoolWorker-16] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:53:15.419215997Z [2024-06-18 22:53:15,418: WARNING/ForkPoolWorker-16] Dag 'vim_status_d8ab743c-7a82-4d12-b942-27539d176b78' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T22:53:15.420377523Z [2024-06-18 22:53:15,419: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T22:53:15.421457881Z [2024-06-18 22:53:15,421: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-18T22:53:15.424660361Z [2024-06-18 22:53:15,424: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:53:15.437180047Z [2024-06-18 22:53:15,436: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T22:53:15.438482642Z [2024-06-18 22:53:15,438: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:53:15.438500951Z [2024-06-18 22:53:15,438: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:53:15.438693327Z [2024-06-18 22:53:15,438: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:53:15.438707207Z [2024-06-18 22:53:15,438: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-18T22:53:15.439467575Z [2024-06-18 22:53:15,439: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T22:53:15.439486122Z [2024-06-18 22:53:15,439: INFO/ForkPoolWorker-16] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:53:15.442776658Z [2024-06-18 22:53:15,442: ERROR/ForkPoolWorker-16] [e5b4eb83-39c3-4223-ba36-eddc4cb9446e] Failed to execute task Dag 'vim_status_d8ab743c-7a82-4d12-b942-27539d176b78' could not be found; either it does not exist or it failed to parse.. 2024-06-18T22:53:15.442801611Z Traceback (most recent call last): 2024-06-18T22:53:15.442810662Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-06-18T22:53:15.442821627Z args.func(args) 2024-06-18T22:53:15.442828875Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-06-18T22:53:15.442835455Z return func(*args, **kwargs) 2024-06-18T22:53:15.442840142Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-06-18T22:53:15.442844921Z return f(*args, **kwargs) 2024-06-18T22:53:15.442849503Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-06-18T22:53:15.442854133Z dag = get_dag(args.subdir, args.dag_id) 2024-06-18T22:53:15.442859012Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-06-18T22:53:15.442863600Z raise AirflowException( 2024-06-18T22:53:15.442870430Z airflow.exceptions.AirflowException: Dag 'vim_status_d8ab743c-7a82-4d12-b942-27539d176b78' could not be found; either it does not exist or it failed to parse. 2024-06-18T22:53:15.477994366Z [2024-06-18 22:53:15,477: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e5b4eb83-39c3-4223-ba36-eddc4cb9446e] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id e5b4eb83-39c3-4223-ba36-eddc4cb9446e') 2024-06-18T22:53:15.478011678Z Traceback (most recent call last): 2024-06-18T22:53:15.478016360Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-06-18T22:53:15.478019527Z R = retval = fun(*args, **kwargs) 2024-06-18T22:53:15.478022945Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-06-18T22:53:15.478026153Z return self.run(*args, **kwargs) 2024-06-18T22:53:15.478029449Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-06-18T22:53:15.478032925Z _execute_in_fork(command_to_exec, celery_task_id) 2024-06-18T22:53:15.478035812Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-06-18T22:53:15.478039274Z raise AirflowException(msg) 2024-06-18T22:53:15.478042877Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id e5b4eb83-39c3-4223-ba36-eddc4cb9446e 2024-06-18T22:54:00.890456682Z [2024-06-18 22:54:00,890: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[68991912-21a0-40dd-8ef8-a7e726cc99c5] received 2024-06-18T22:54:00.898484144Z [2024-06-18 22:54:00,897: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f22b8988-533c-4c5d-b866-5a2e2ca7dafb] received 2024-06-18T22:54:00.902297695Z [2024-06-18 22:54:00,901: INFO/ForkPoolWorker-15] [68991912-21a0-40dd-8ef8-a7e726cc99c5] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-18T22:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-18T22:54:00.909487639Z [2024-06-18 22:54:00,909: INFO/ForkPoolWorker-16] [f22b8988-533c-4c5d-b866-5a2e2ca7dafb] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T22:54:00.914373107Z [2024-06-18 22:54:00,914: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dad63261-219e-4bce-bee2-ccc8e4dc38ee] received 2024-06-18T22:54:00.925207248Z [2024-06-18 22:54:00,924: INFO/ForkPoolWorker-1] [dad63261-219e-4bce-bee2-ccc8e4dc38ee] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T22:54:00.926373186Z [2024-06-18 22:54:00,926: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4ea76cdb-b0f4-42d8-88a2-6c8c2f6bd33b] received 2024-06-18T22:54:00.949231260Z [2024-06-18 22:54:00,948: INFO/ForkPoolWorker-2] [4ea76cdb-b0f4-42d8-88a2-6c8c2f6bd33b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T22:54:01.196054449Z [2024-06-18 22:54:01,192: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-18T22:54:01.225195065Z [2024-06-18 22:54:01,221: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T22:54:01.282814055Z [2024-06-18 22:54:01,279: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T22:54:01.327230009Z [2024-06-18 22:54:01,323: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T22:54:01.390343626Z [2024-06-18 22:54:01,389: INFO/ForkPoolWorker-16] Getting SDNC list 2024-06-18T22:54:01.394631575Z [2024-06-18 22:54:01,394: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:54:01.429980400Z [2024-06-18 22:54:01,429: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T22:54:01.436659312Z [2024-06-18 22:54:01,436: INFO/ForkPoolWorker-16] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T22:54:01.436834085Z [2024-06-18 22:54:01,436: INFO/ForkPoolWorker-16] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T22:54:01.436988734Z [2024-06-18 22:54:01,436: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-06-18T22:54:01.437282571Z [2024-06-18 22:54:01,437: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T22:54:01.439501437Z [2024-06-18 22:54:01,439: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:54:01.565238895Z [2024-06-18 22:54:01,564: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:54:01.996704802Z [2024-06-18 22:54:01,996: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[68991912-21a0-40dd-8ef8-a7e726cc99c5] succeeded in 1.102868970000145s: None 2024-06-18T22:54:02.214066058Z [2024-06-18 22:54:02,213: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f22b8988-533c-4c5d-b866-5a2e2ca7dafb] succeeded in 1.3114307840000947s: None 2024-06-18T22:54:02.669062862Z [2024-06-18 22:54:02,668: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-18T22:54:02.672284202Z [2024-06-18 22:54:02,671: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:54:02.702337742Z [2024-06-18 22:54:02,702: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T22:54:02.704074079Z [2024-06-18 22:54:02,703: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:54:02.704309125Z [2024-06-18 22:54:02,704: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:54:02.704600168Z [2024-06-18 22:54:02,704: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:54:02.704827775Z [2024-06-18 22:54:02,704: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-18T22:54:02.705118876Z [2024-06-18 22:54:02,704: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-18T22:54:02.705471431Z [2024-06-18 22:54:02,705: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T22:54:02.705727892Z [2024-06-18 22:54:02,705: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:54:02.708437467Z [2024-06-18 22:54:02,708: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:54:02.724065062Z [2024-06-18 22:54:02,723: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-18T22:54:02.725184957Z [2024-06-18 22:54:02,724: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:54:02.725313930Z [2024-06-18 22:54:02,725: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:54:02.725472505Z [2024-06-18 22:54:02,725: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:54:02.725556751Z [2024-06-18 22:54:02,725: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-18T22:54:02.725914554Z [2024-06-18 22:54:02,725: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-06-18T22:54:02.725989107Z [2024-06-18 22:54:02,725: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:54:02.802326264Z [2024-06-18 22:54:02,802: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:54:02.802990484Z [2024-06-18 22:54:02,802: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:54:04.696964723Z [2024-06-18 22:54:04,696: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[dad63261-219e-4bce-bee2-ccc8e4dc38ee] succeeded in 3.7802365620000273s: None 2024-06-18T22:54:05.674587344Z [2024-06-18 22:54:05,674: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[4ea76cdb-b0f4-42d8-88a2-6c8c2f6bd33b] succeeded in 4.7334188700001505s: None 2024-06-18T22:55:00.801657058Z [2024-06-18 22:55:00,801: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[269692b1-9860-4dad-a6ef-16403f5cf9e0] received 2024-06-18T22:55:00.805727401Z [2024-06-18 22:55:00,805: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d1f76983-1249-4893-84cf-394ed451d7d7] received 2024-06-18T22:55:00.825792004Z [2024-06-18 22:55:00,825: INFO/ForkPoolWorker-16] [d1f76983-1249-4893-84cf-394ed451d7d7] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T22:55:00.829809494Z [2024-06-18 22:55:00,829: INFO/ForkPoolWorker-15] [269692b1-9860-4dad-a6ef-16403f5cf9e0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-18T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-18T22:55:00.832887834Z [2024-06-18 22:55:00,832: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9c3623b5-f5e1-4f0f-81dc-696f298fa54c] received 2024-06-18T22:55:00.840426917Z [2024-06-18 22:55:00,840: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[20d5de99-8289-489a-8a7b-e29d726c42ef] received 2024-06-18T22:55:00.844916692Z [2024-06-18 22:55:00,844: INFO/ForkPoolWorker-1] [9c3623b5-f5e1-4f0f-81dc-696f298fa54c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T22:55:00.861454725Z [2024-06-18 22:55:00,861: INFO/ForkPoolWorker-2] [20d5de99-8289-489a-8a7b-e29d726c42ef] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T22:55:01.235783094Z [2024-06-18 22:55:01,231: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T22:55:01.309786683Z [2024-06-18 22:55:01,305: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T22:55:01.403820176Z [2024-06-18 22:55:01,399: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T22:55:01.503024194Z [2024-06-18 22:55:01,502: INFO/ForkPoolWorker-16] Getting SDNC list 2024-06-18T22:55:01.507610932Z [2024-06-18 22:55:01,507: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:55:01.538587558Z [2024-06-18 22:55:01,538: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T22:55:01.542785795Z [2024-06-18 22:55:01,542: INFO/ForkPoolWorker-16] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T22:55:01.542812171Z [2024-06-18 22:55:01,542: INFO/ForkPoolWorker-16] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T22:55:01.542880825Z [2024-06-18 22:55:01,542: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-06-18T22:55:01.543059389Z [2024-06-18 22:55:01,542: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T22:55:01.704813404Z [2024-06-18 22:55:01,704: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:55:01.791395294Z [2024-06-18 22:55:01,788: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T22:55:02.705805580Z [2024-06-18 22:55:02,705: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d1f76983-1249-4893-84cf-394ed451d7d7] succeeded in 1.8982116730003327s: None 2024-06-18T22:55:03.234997893Z [2024-06-18 22:55:03,234: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T22:55:03.238730197Z [2024-06-18 22:55:03,238: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:55:03.282222654Z [2024-06-18 22:55:03,281: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T22:55:03.285513687Z [2024-06-18 22:55:03,285: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:55:03.285916657Z [2024-06-18 22:55:03,285: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:55:03.286361024Z [2024-06-18 22:55:03,286: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:55:03.286631236Z [2024-06-18 22:55:03,286: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T22:55:03.287155511Z [2024-06-18 22:55:03,286: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T22:55:03.288005317Z [2024-06-18 22:55:03,287: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:55:03.329056598Z [2024-06-18 22:55:03,328: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-18T22:55:03.333024950Z [2024-06-18 22:55:03,332: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:55:03.373403880Z [2024-06-18 22:55:03,373: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T22:55:03.375956355Z [2024-06-18 22:55:03,375: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:55:03.377726841Z [2024-06-18 22:55:03,377: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:55:03.378091796Z [2024-06-18 22:55:03,377: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:55:03.378341675Z [2024-06-18 22:55:03,378: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-18T22:55:03.379007200Z [2024-06-18 22:55:03,378: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-06-18T22:55:03.379245181Z [2024-06-18 22:55:03,379: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:55:03.399226072Z [2024-06-18 22:55:03,398: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:55:03.509581776Z [2024-06-18 22:55:03,509: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:55:03.560523608Z [2024-06-18 22:55:03,560: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-18T22:55:03.564019821Z [2024-06-18 22:55:03,563: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:55:03.593250759Z [2024-06-18 22:55:03,592: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-18T22:55:03.594885226Z [2024-06-18 22:55:03,594: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:55:03.594897776Z [2024-06-18 22:55:03,594: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:55:03.595064588Z [2024-06-18 22:55:03,594: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:55:03.595120843Z [2024-06-18 22:55:03,595: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-18T22:55:03.595410403Z [2024-06-18 22:55:03,595: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T22:55:03.595441980Z [2024-06-18 22:55:03,595: INFO/ForkPoolWorker-2] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:55:03.712079470Z [2024-06-18 22:55:03,711: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:55:04.222030290Z [2024-06-18 22:55:04,221: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[269692b1-9860-4dad-a6ef-16403f5cf9e0] succeeded in 3.4151777639999636s: None 2024-06-18T22:55:05.132003533Z [2024-06-18 22:55:05,131: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[858e9012-e253-400b-91bf-cd684d5225b7] received 2024-06-18T22:55:05.147579116Z [2024-06-18 22:55:05,147: INFO/ForkPoolWorker-15] [858e9012-e253-400b-91bf-cd684d5225b7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'split_metrics', 'scheduled__2024-06-18T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-18T22:55:05.319147222Z [2024-06-18 22:55:05,318: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[20d5de99-8289-489a-8a7b-e29d726c42ef] succeeded in 4.476365237999744s: None 2024-06-18T22:55:05.414495517Z [2024-06-18 22:55:05,413: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9c3623b5-f5e1-4f0f-81dc-696f298fa54c] succeeded in 4.579226634999941s: None 2024-06-18T22:55:05.485954951Z [2024-06-18 22:55:05,482: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T22:55:06.596603569Z [2024-06-18 22:55:06,596: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T22:55:06.600181135Z [2024-06-18 22:55:06,599: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:55:06.629472626Z [2024-06-18 22:55:06,629: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T22:55:06.631130612Z [2024-06-18 22:55:06,630: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:55:06.631390841Z [2024-06-18 22:55:06,631: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:55:06.631880505Z [2024-06-18 22:55:06,631: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:55:06.632105002Z [2024-06-18 22:55:06,631: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T22:55:06.632458145Z [2024-06-18 22:55:06,632: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T22:55:06.632665252Z [2024-06-18 22:55:06,632: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:55:06.758371445Z [2024-06-18 22:55:06,757: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:55:07.581326470Z [2024-06-18 22:55:07,580: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[858e9012-e253-400b-91bf-cd684d5225b7] succeeded in 2.4460457560003306s: None 2024-06-18T22:55:07.584272448Z [2024-06-18 22:55:07,584: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3c71a2d4-a786-485a-9bd8-0d8a31554a8e] received 2024-06-18T22:55:07.597318346Z [2024-06-18 22:55:07,597: INFO/ForkPoolWorker-15] [3c71a2d4-a786-485a-9bd8-0d8a31554a8e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'collect_metrics', 'scheduled__2024-06-18T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-18T22:55:07.923419999Z [2024-06-18 22:55:07,919: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T22:55:09.266109049Z [2024-06-18 22:55:09,265: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T22:55:09.270716840Z [2024-06-18 22:55:09,270: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:55:09.300416617Z [2024-06-18 22:55:09,300: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T22:55:09.302349569Z [2024-06-18 22:55:09,302: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:55:09.302464188Z [2024-06-18 22:55:09,302: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:55:09.302772488Z [2024-06-18 22:55:09,302: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:55:09.302996299Z [2024-06-18 22:55:09,302: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T22:55:09.303394959Z [2024-06-18 22:55:09,303: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T22:55:09.303604319Z [2024-06-18 22:55:09,303: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:55:09.418900257Z [2024-06-18 22:55:09,418: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:55:10.121478582Z [2024-06-18 22:55:10,120: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3c71a2d4-a786-485a-9bd8-0d8a31554a8e] succeeded in 2.5353973480000604s: None 2024-06-18T22:55:10.973465432Z [2024-06-18 22:55:10,972: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dea93d55-61be-4dd6-ae9d-2e5586d36df1] received 2024-06-18T22:55:10.983906881Z [2024-06-18 22:55:10,983: INFO/ForkPoolWorker-15] [dea93d55-61be-4dd6-ae9d-2e5586d36df1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'send_prometheus', 'scheduled__2024-06-18T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-18T22:55:11.268567826Z [2024-06-18 22:55:11,264: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T22:55:12.476441411Z [2024-06-18 22:55:12,475: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T22:55:12.480347056Z [2024-06-18 22:55:12,479: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:55:12.506219786Z [2024-06-18 22:55:12,505: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T22:55:12.507796845Z [2024-06-18 22:55:12,507: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:55:12.507817820Z [2024-06-18 22:55:12,507: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:55:12.507985006Z [2024-06-18 22:55:12,507: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:55:12.507998692Z [2024-06-18 22:55:12,507: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T22:55:12.508262719Z [2024-06-18 22:55:12,508: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T22:55:12.508274948Z [2024-06-18 22:55:12,508: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:55:12.638748961Z [2024-06-18 22:55:12,638: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:55:13.380711941Z [2024-06-18 22:55:13,380: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[dea93d55-61be-4dd6-ae9d-2e5586d36df1] succeeded in 2.403677233000053s: None 2024-06-18T22:56:00.592551781Z [2024-06-18 22:56:00,591: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ebc4e46b-35df-4ead-8c7a-54a13c83b378] received 2024-06-18T22:56:00.603665288Z [2024-06-18 22:56:00,603: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6c030b46-64a9-43ab-b4be-5949a969c9f9] received 2024-06-18T22:56:00.613435386Z [2024-06-18 22:56:00,612: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[741211c7-a561-46ca-b2de-f5ccb39dc085] received 2024-06-18T22:56:00.614209878Z [2024-06-18 22:56:00,613: INFO/ForkPoolWorker-16] [6c030b46-64a9-43ab-b4be-5949a969c9f9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T22:56:00.623248295Z [2024-06-18 22:56:00,622: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ba43e078-5fc7-4b6a-ae62-cbe1d97c1a56] received 2024-06-18T22:56:00.629540627Z [2024-06-18 22:56:00,629: INFO/ForkPoolWorker-1] [741211c7-a561-46ca-b2de-f5ccb39dc085] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-18T22:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-18T22:56:00.631018418Z [2024-06-18 22:56:00,630: INFO/ForkPoolWorker-15] [ebc4e46b-35df-4ead-8c7a-54a13c83b378] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T22:56:00.634222196Z [2024-06-18 22:56:00,633: INFO/ForkPoolWorker-2] [ba43e078-5fc7-4b6a-ae62-cbe1d97c1a56] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T22:56:00.992420724Z [2024-06-18 22:56:00,986: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T22:56:00.993670647Z [2024-06-18 22:56:00,988: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T22:56:01.014672233Z [2024-06-18 22:56:01,010: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T22:56:01.112525584Z [2024-06-18 22:56:01,108: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-18T22:56:01.161721707Z [2024-06-18 22:56:01,161: INFO/ForkPoolWorker-2] Getting SDNC list 2024-06-18T22:56:01.167676532Z [2024-06-18 22:56:01,167: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:56:01.199862132Z [2024-06-18 22:56:01,199: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-18T22:56:01.207835296Z [2024-06-18 22:56:01,204: INFO/ForkPoolWorker-2] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T22:56:01.207971932Z [2024-06-18 22:56:01,204: INFO/ForkPoolWorker-2] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T22:56:01.207975989Z [2024-06-18 22:56:01,204: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-06-18T22:56:01.207979510Z [2024-06-18 22:56:01,205: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T22:56:01.311304475Z [2024-06-18 22:56:01,311: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:56:01.399879308Z [2024-06-18 22:56:01,399: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:56:02.049777749Z [2024-06-18 22:56:02,049: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[ba43e078-5fc7-4b6a-ae62-cbe1d97c1a56] succeeded in 1.424165548000019s: None 2024-06-18T22:56:02.104407158Z [2024-06-18 22:56:02,104: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[741211c7-a561-46ca-b2de-f5ccb39dc085] succeeded in 1.4877321210001355s: None 2024-06-18T22:56:02.485649009Z [2024-06-18 22:56:02,485: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-18T22:56:02.492094361Z [2024-06-18 22:56:02,491: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:56:02.502518592Z [2024-06-18 22:56:02,502: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T22:56:02.505937543Z [2024-06-18 22:56:02,505: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:56:02.516386021Z [2024-06-18 22:56:02,516: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T22:56:02.518243390Z [2024-06-18 22:56:02,518: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:56:02.518900750Z [2024-06-18 22:56:02,518: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:56:02.519702930Z [2024-06-18 22:56:02,518: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:56:02.519732091Z [2024-06-18 22:56:02,519: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-18T22:56:02.520124852Z [2024-06-18 22:56:02,519: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-18T22:56:02.520135496Z [2024-06-18 22:56:02,520: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:56:02.540753792Z [2024-06-18 22:56:02,540: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T22:56:02.541996292Z [2024-06-18 22:56:02,541: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:56:02.542046002Z [2024-06-18 22:56:02,541: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:56:02.542196112Z [2024-06-18 22:56:02,542: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:56:02.542270315Z [2024-06-18 22:56:02,542: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T22:56:02.542531812Z [2024-06-18 22:56:02,542: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T22:56:02.542650338Z [2024-06-18 22:56:02,542: INFO/ForkPoolWorker-15] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:56:02.620190470Z [2024-06-18 22:56:02,619: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:56:02.642849272Z [2024-06-18 22:56:02,642: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:56:04.372359187Z [2024-06-18 22:56:04,371: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ebc4e46b-35df-4ead-8c7a-54a13c83b378] succeeded in 3.764106229999925s: None 2024-06-18T22:56:04.933775843Z [2024-06-18 22:56:04,933: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6c030b46-64a9-43ab-b4be-5949a969c9f9] succeeded in 4.3272686850000355s: None 2024-06-18T22:57:00.605776490Z [2024-06-18 22:57:00,605: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[13143b8e-38bb-4a0c-bc50-4472403904d9] received 2024-06-18T22:57:00.619872294Z [2024-06-18 22:57:00,616: INFO/ForkPoolWorker-15] [13143b8e-38bb-4a0c-bc50-4472403904d9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T22:57:00.631811412Z [2024-06-18 22:57:00,629: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8448ddae-565d-43a6-ad57-106b6ec91b08] received 2024-06-18T22:57:00.635816453Z [2024-06-18 22:57:00,634: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c931f142-b3e9-4dbd-bed3-de53810f6a29] received 2024-06-18T22:57:00.669772893Z [2024-06-18 22:57:00,669: INFO/ForkPoolWorker-1] [c931f142-b3e9-4dbd-bed3-de53810f6a29] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T22:57:00.670577754Z [2024-06-18 22:57:00,670: INFO/ForkPoolWorker-16] [8448ddae-565d-43a6-ad57-106b6ec91b08] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T22:57:00.985738788Z [2024-06-18 22:57:00,981: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T22:57:01.016743719Z [2024-06-18 22:57:01,012: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T22:57:01.032174175Z [2024-06-18 22:57:01,009: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T22:57:01.241981004Z [2024-06-18 22:57:01,241: INFO/ForkPoolWorker-15] Getting SDNC list 2024-06-18T22:57:01.246620758Z [2024-06-18 22:57:01,246: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:57:01.282287434Z [2024-06-18 22:57:01,282: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T22:57:01.284629009Z [2024-06-18 22:57:01,284: INFO/ForkPoolWorker-15] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T22:57:01.284812579Z [2024-06-18 22:57:01,284: INFO/ForkPoolWorker-15] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T22:57:01.284973669Z [2024-06-18 22:57:01,284: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-06-18T22:57:01.285450279Z [2024-06-18 22:57:01,285: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T22:57:01.381591263Z [2024-06-18 22:57:01,381: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:57:02.051210277Z [2024-06-18 22:57:02,050: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[13143b8e-38bb-4a0c-bc50-4472403904d9] succeeded in 1.4437697370003661s: None 2024-06-18T22:57:02.309183004Z [2024-06-18 22:57:02,307: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-18T22:57:02.311733823Z [2024-06-18 22:57:02,311: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:57:02.361165755Z [2024-06-18 22:57:02,360: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-18T22:57:02.364567066Z [2024-06-18 22:57:02,364: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:57:02.385305273Z [2024-06-18 22:57:02,385: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T22:57:02.385983735Z [2024-06-18 22:57:02,385: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T22:57:02.387179335Z [2024-06-18 22:57:02,386: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:57:02.387325509Z [2024-06-18 22:57:02,387: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:57:02.387506564Z [2024-06-18 22:57:02,387: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:57:02.387621947Z [2024-06-18 22:57:02,387: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-18T22:57:02.388086519Z [2024-06-18 22:57:02,387: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T22:57:02.388274319Z [2024-06-18 22:57:02,388: INFO/ForkPoolWorker-16] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:57:02.397594460Z [2024-06-18 22:57:02,397: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:57:02.397620070Z [2024-06-18 22:57:02,397: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:57:02.397628059Z [2024-06-18 22:57:02,397: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:57:02.397632120Z [2024-06-18 22:57:02,397: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-18T22:57:02.397691393Z [2024-06-18 22:57:02,397: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-06-18T22:57:02.397728038Z [2024-06-18 22:57:02,397: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:57:02.491759957Z [2024-06-18 22:57:02,491: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:57:02.496655520Z [2024-06-18 22:57:02,496: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:57:04.209207807Z [2024-06-18 22:57:04,208: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8448ddae-565d-43a6-ad57-106b6ec91b08] succeeded in 3.569722150999951s: None 2024-06-18T22:57:04.832843369Z [2024-06-18 22:57:04,832: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c931f142-b3e9-4dbd-bed3-de53810f6a29] succeeded in 4.19091162299992s: None 2024-06-18T22:58:00.449673127Z [2024-06-18 22:58:00,448: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ea976401-9613-46d3-acec-30f33db0a0b9] received 2024-06-18T22:58:00.454249858Z [2024-06-18 22:58:00,453: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[57bc5823-fd73-4761-9044-4a035f01c507] received 2024-06-18T22:58:00.458432175Z [2024-06-18 22:58:00,458: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[76c2ef78-3a84-4a53-b574-e5d54af08eab] received 2024-06-18T22:58:00.460653092Z [2024-06-18 22:58:00,459: INFO/ForkPoolWorker-15] [ea976401-9613-46d3-acec-30f33db0a0b9] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-18T22:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-18T22:58:00.464884743Z [2024-06-18 22:58:00,464: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a2655c71-2bbe-4dfb-afc9-7252d84c4733] received 2024-06-18T22:58:00.479397783Z [2024-06-18 22:58:00,479: INFO/ForkPoolWorker-16] [57bc5823-fd73-4761-9044-4a035f01c507] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T22:58:00.482395590Z [2024-06-18 22:58:00,482: INFO/ForkPoolWorker-1] [76c2ef78-3a84-4a53-b574-e5d54af08eab] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T22:58:00.491297320Z [2024-06-18 22:58:00,490: INFO/ForkPoolWorker-2] [a2655c71-2bbe-4dfb-afc9-7252d84c4733] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T22:58:00.795787906Z [2024-06-18 22:58:00,791: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-18T22:58:00.802379847Z [2024-06-18 22:58:00,798: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T22:58:00.896949251Z [2024-06-18 22:58:00,893: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T22:58:00.908671016Z [2024-06-18 22:58:00,904: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T22:58:00.975307433Z [2024-06-18 22:58:00,974: INFO/ForkPoolWorker-16] Getting SDNC list 2024-06-18T22:58:00.979973026Z [2024-06-18 22:58:00,979: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:58:01.003398959Z [2024-06-18 22:58:01,003: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T22:58:01.004893922Z [2024-06-18 22:58:01,004: INFO/ForkPoolWorker-16] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T22:58:01.005025202Z [2024-06-18 22:58:01,004: INFO/ForkPoolWorker-16] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T22:58:01.005132970Z [2024-06-18 22:58:01,005: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-06-18T22:58:01.005377851Z [2024-06-18 22:58:01,005: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T22:58:01.068489596Z [2024-06-18 22:58:01,068: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:58:01.099247467Z [2024-06-18 22:58:01,099: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:58:01.587109008Z [2024-06-18 22:58:01,583: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ea976401-9613-46d3-acec-30f33db0a0b9] succeeded in 1.13050628100018s: None 2024-06-18T22:58:01.706491606Z [2024-06-18 22:58:01,706: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[57bc5823-fd73-4761-9044-4a035f01c507] succeeded in 1.2494360059999963s: None 2024-06-18T22:58:02.252638344Z [2024-06-18 22:58:02,252: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-18T22:58:02.263788243Z [2024-06-18 22:58:02,260: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:58:02.298173970Z [2024-06-18 22:58:02,297: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-18T22:58:02.301473736Z [2024-06-18 22:58:02,301: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:58:02.368087196Z [2024-06-18 22:58:02,367: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-18T22:58:02.369076228Z [2024-06-18 22:58:02,368: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T22:58:02.370585663Z [2024-06-18 22:58:02,370: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:58:02.370762977Z [2024-06-18 22:58:02,370: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:58:02.372008240Z [2024-06-18 22:58:02,370: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:58:02.375425225Z [2024-06-18 22:58:02,372: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-18T22:58:02.376080398Z [2024-06-18 22:58:02,375: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:58:02.376216125Z [2024-06-18 22:58:02,376: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:58:02.376367154Z [2024-06-18 22:58:02,376: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:58:02.376450405Z [2024-06-18 22:58:02,376: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-18T22:58:02.377260116Z [2024-06-18 22:58:02,376: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-06-18T22:58:02.377366338Z [2024-06-18 22:58:02,377: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:58:02.379192141Z [2024-06-18 22:58:02,378: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T22:58:02.379936766Z [2024-06-18 22:58:02,379: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:58:02.476226049Z [2024-06-18 22:58:02,475: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:58:02.512710905Z [2024-06-18 22:58:02,512: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:58:04.090104654Z [2024-06-18 22:58:04,089: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[76c2ef78-3a84-4a53-b574-e5d54af08eab] succeeded in 3.62405601699993s: None 2024-06-18T22:58:04.389537708Z [2024-06-18 22:58:04,389: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a2655c71-2bbe-4dfb-afc9-7252d84c4733] succeeded in 3.9204942179999307s: None 2024-06-18T22:59:00.356450980Z [2024-06-18 22:59:00,355: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[31b97667-9bfb-44f6-99fd-eef8cf05c2ed] received 2024-06-18T22:59:00.360766306Z [2024-06-18 22:59:00,360: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e5a2b454-8bac-4ae2-a632-e3863ffb9aa2] received 2024-06-18T22:59:00.370075249Z [2024-06-18 22:59:00,369: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a740068d-7006-47ce-8ab7-1b9529098cd9] received 2024-06-18T22:59:00.375468815Z [2024-06-18 22:59:00,375: INFO/ForkPoolWorker-15] [31b97667-9bfb-44f6-99fd-eef8cf05c2ed] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T22:59:00.376615505Z [2024-06-18 22:59:00,376: INFO/ForkPoolWorker-16] [e5a2b454-8bac-4ae2-a632-e3863ffb9aa2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T22:59:00.390325168Z [2024-06-18 22:59:00,389: INFO/ForkPoolWorker-1] [a740068d-7006-47ce-8ab7-1b9529098cd9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T22:59:00.649207775Z [2024-06-18 22:59:00,641: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T22:59:00.664377469Z [2024-06-18 22:59:00,659: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T22:59:00.726850152Z [2024-06-18 22:59:00,721: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T22:59:00.905789367Z [2024-06-18 22:59:00,905: INFO/ForkPoolWorker-16] Getting SDNC list 2024-06-18T22:59:00.909743840Z [2024-06-18 22:59:00,909: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:59:00.932630342Z [2024-06-18 22:59:00,932: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T22:59:00.933640541Z [2024-06-18 22:59:00,933: INFO/ForkPoolWorker-16] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T22:59:00.933685522Z [2024-06-18 22:59:00,933: INFO/ForkPoolWorker-16] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T22:59:00.933734898Z [2024-06-18 22:59:00,933: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-06-18T22:59:00.933918908Z [2024-06-18 22:59:00,933: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T22:59:01.038542120Z [2024-06-18 22:59:01,038: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:59:01.683933326Z [2024-06-18 22:59:01,683: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e5a2b454-8bac-4ae2-a632-e3863ffb9aa2] succeeded in 1.3179342579996955s: None 2024-06-18T22:59:01.846487205Z [2024-06-18 22:59:01,846: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T22:59:01.849893992Z [2024-06-18 22:59:01,849: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:59:01.857946047Z [2024-06-18 22:59:01,857: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-18T22:59:01.861478354Z [2024-06-18 22:59:01,860: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T22:59:01.874856238Z [2024-06-18 22:59:01,874: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T22:59:01.876630926Z [2024-06-18 22:59:01,876: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:59:01.876815504Z [2024-06-18 22:59:01,876: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:59:01.877097352Z [2024-06-18 22:59:01,876: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:59:01.877268586Z [2024-06-18 22:59:01,877: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T22:59:01.878041140Z [2024-06-18 22:59:01,877: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-06-18T22:59:01.878261970Z [2024-06-18 22:59:01,878: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:59:01.884818722Z [2024-06-18 22:59:01,884: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T22:59:01.886641056Z [2024-06-18 22:59:01,886: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T22:59:01.886683289Z [2024-06-18 22:59:01,886: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T22:59:01.886878962Z [2024-06-18 22:59:01,886: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T22:59:01.886954196Z [2024-06-18 22:59:01,886: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-18T22:59:01.887247050Z [2024-06-18 22:59:01,887: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T22:59:01.887349188Z [2024-06-18 22:59:01,887: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T22:59:01.972080390Z [2024-06-18 22:59:01,971: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:59:01.982731516Z [2024-06-18 22:59:01,982: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T22:59:03.452795647Z [2024-06-18 22:59:03,452: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a740068d-7006-47ce-8ab7-1b9529098cd9] succeeded in 3.0790488610000466s: None 2024-06-18T22:59:03.857441334Z [2024-06-18 22:59:03,856: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[31b97667-9bfb-44f6-99fd-eef8cf05c2ed] succeeded in 3.495607770999868s: None 2024-06-18T23:00:00.730343240Z [2024-06-18 23:00:00,729: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[99a4a646-f2b8-465e-959e-b1fbdc26e402] received 2024-06-18T23:00:00.733222653Z [2024-06-18 23:00:00,732: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[887c8e1e-4bc5-4041-878c-d574d7fb57dd] received 2024-06-18T23:00:00.734685328Z [2024-06-18 23:00:00,734: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c0c4a565-66f8-4ca5-ae8b-7f7b3b831646] received 2024-06-18T23:00:00.752522046Z [2024-06-18 23:00:00,752: INFO/ForkPoolWorker-15] [99a4a646-f2b8-465e-959e-b1fbdc26e402] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T23:00:00.811840439Z [2024-06-18 23:00:00,811: INFO/ForkPoolWorker-16] [887c8e1e-4bc5-4041-878c-d574d7fb57dd] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T23:00:00.812202389Z [2024-06-18 23:00:00,811: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ebadb745-2c37-4f54-a354-03d5123f1e34] received 2024-06-18T23:00:00.834985624Z [2024-06-18 23:00:00,829: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bf9e8567-4310-4abb-9822-ce8b1621f31c] received 2024-06-18T23:00:00.838294112Z [2024-06-18 23:00:00,836: INFO/ForkPoolWorker-1] [c0c4a565-66f8-4ca5-ae8b-7f7b3b831646] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T22:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T23:00:00.856392826Z [2024-06-18 23:00:00,855: INFO/ForkPoolWorker-2] [ebadb745-2c37-4f54-a354-03d5123f1e34] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-18T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-18T23:00:00.902542169Z [2024-06-18 23:00:00,902: INFO/ForkPoolWorker-3] [bf9e8567-4310-4abb-9822-ce8b1621f31c] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-18T22:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-18T23:00:01.670880615Z [2024-06-18 23:00:01,655: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T23:00:01.939570716Z [2024-06-18 23:00:01,916: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T23:00:02.723975079Z [2024-06-18 23:00:02,611: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T23:00:02.760178776Z [2024-06-18 23:00:02,706: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-18T23:00:02.878517425Z [2024-06-18 23:00:02,870: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T23:00:03.439186989Z [2024-06-18 23:00:03,438: INFO/ForkPoolWorker-16] Getting SDNC list 2024-06-18T23:00:03.443322395Z [2024-06-18 23:00:03,442: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:00:03.481888050Z [2024-06-18 23:00:03,481: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T23:00:03.483458657Z [2024-06-18 23:00:03,483: INFO/ForkPoolWorker-16] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T23:00:03.483562609Z [2024-06-18 23:00:03,483: INFO/ForkPoolWorker-16] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T23:00:03.483646501Z [2024-06-18 23:00:03,483: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-06-18T23:00:03.484178214Z [2024-06-18 23:00:03,483: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T23:00:03.978253897Z [2024-06-18 23:00:03,978: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:00:04.473382067Z [2024-06-18 23:00:04,473: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:00:06.204807594Z [2024-06-18 23:00:06,204: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[887c8e1e-4bc5-4041-878c-d574d7fb57dd] succeeded in 5.429536808999728s: None 2024-06-18T23:00:06.396805314Z [2024-06-18 23:00:06,396: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[bf9e8567-4310-4abb-9822-ce8b1621f31c] succeeded in 5.534932233999825s: None 2024-06-18T23:00:06.631848934Z [2024-06-18 23:00:06,623: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-18T23:00:06.631875783Z [2024-06-18 23:00:06,627: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:00:06.758436966Z [2024-06-18 23:00:06,758: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-18T23:00:06.774633132Z [2024-06-18 23:00:06,774: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:00:06.776106275Z [2024-06-18 23:00:06,775: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:00:06.776298334Z [2024-06-18 23:00:06,776: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:00:06.777567345Z [2024-06-18 23:00:06,777: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-18T23:00:06.777886422Z [2024-06-18 23:00:06,777: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T23:00:06.784132859Z [2024-06-18 23:00:06,783: INFO/ForkPoolWorker-2] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:00:06.920610641Z [2024-06-18 23:00:06,920: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T23:00:06.924689919Z [2024-06-18 23:00:06,923: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:00:06.991871323Z [2024-06-18 23:00:06,986: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:00:07.161436844Z [2024-06-18 23:00:07,161: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T23:00:07.170764314Z [2024-06-18 23:00:07,170: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:00:07.179440579Z [2024-06-18 23:00:07,170: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:00:07.179769539Z [2024-06-18 23:00:07,179: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:00:07.199203799Z [2024-06-18 23:00:07,179: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T23:00:07.199229673Z [2024-06-18 23:00:07,196: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-06-18T23:00:07.199234503Z [2024-06-18 23:00:07,196: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:00:07.418856968Z [2024-06-18 23:00:07,418: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:00:08.043520777Z [2024-06-18 23:00:08,037: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-18T23:00:08.043550034Z [2024-06-18 23:00:08,042: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:00:08.081518949Z [2024-06-18 23:00:08,079: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T23:00:08.081843218Z [2024-06-18 23:00:08,081: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:00:08.081989367Z [2024-06-18 23:00:08,081: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:00:08.082163449Z [2024-06-18 23:00:08,082: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:00:08.084149093Z [2024-06-18 23:00:08,082: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-18T23:00:08.084157461Z [2024-06-18 23:00:08,082: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T23:00:08.084160642Z [2024-06-18 23:00:08,082: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:00:08.250514268Z [2024-06-18 23:00:08,250: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:00:08.707501079Z [2024-06-18 23:00:08,707: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[ebadb745-2c37-4f54-a354-03d5123f1e34] succeeded in 7.892622471999857s: None 2024-06-18T23:00:09.104234779Z [2024-06-18 23:00:09,103: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4a9c5d4e-f622-4e00-8f35-00127c3cd52a] received 2024-06-18T23:00:09.111337997Z [2024-06-18 23:00:09,111: INFO/ForkPoolWorker-16] [4a9c5d4e-f622-4e00-8f35-00127c3cd52a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'split_metrics', 'scheduled__2024-06-18T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-18T23:00:09.508715585Z [2024-06-18 23:00:09,503: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T23:00:10.255852081Z [2024-06-18 23:00:10,252: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c0c4a565-66f8-4ca5-ae8b-7f7b3b831646] succeeded in 9.501328543999989s: None 2024-06-18T23:00:10.325381529Z [2024-06-18 23:00:10,324: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[99a4a646-f2b8-465e-959e-b1fbdc26e402] succeeded in 9.590221675000066s: None 2024-06-18T23:00:11.043134009Z [2024-06-18 23:00:11,042: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-18T23:00:11.046614940Z [2024-06-18 23:00:11,046: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:00:11.092379330Z [2024-06-18 23:00:11,092: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T23:00:11.096465006Z [2024-06-18 23:00:11,096: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:00:11.096588406Z [2024-06-18 23:00:11,096: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:00:11.096775704Z [2024-06-18 23:00:11,096: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:00:11.096876689Z [2024-06-18 23:00:11,096: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-18T23:00:11.097277704Z [2024-06-18 23:00:11,097: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T23:00:11.097453152Z [2024-06-18 23:00:11,097: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:00:11.188752870Z [2024-06-18 23:00:11,188: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:00:11.990414902Z [2024-06-18 23:00:11,989: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4a9c5d4e-f622-4e00-8f35-00127c3cd52a] succeeded in 2.883273009000277s: None 2024-06-18T23:00:12.197347571Z [2024-06-18 23:00:12,196: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[52ce4976-5316-4991-b9b9-a1dc384fc0b2] received 2024-06-18T23:00:12.254619999Z [2024-06-18 23:00:12,253: INFO/ForkPoolWorker-15] [52ce4976-5316-4991-b9b9-a1dc384fc0b2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'collect_metrics', 'scheduled__2024-06-18T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-18T23:00:13.245852421Z [2024-06-18 23:00:13,236: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T23:00:14.815227018Z [2024-06-18 23:00:14,814: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T23:00:14.820215765Z [2024-06-18 23:00:14,819: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:00:14.907902568Z [2024-06-18 23:00:14,907: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T23:00:14.922613558Z [2024-06-18 23:00:14,922: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:00:14.922740173Z [2024-06-18 23:00:14,922: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:00:14.923091831Z [2024-06-18 23:00:14,922: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:00:14.923271967Z [2024-06-18 23:00:14,923: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T23:00:14.923979001Z [2024-06-18 23:00:14,923: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T23:00:14.924790070Z [2024-06-18 23:00:14,924: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:00:15.129686701Z [2024-06-18 23:00:15,129: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:00:16.185425604Z [2024-06-18 23:00:16,184: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[52ce4976-5316-4991-b9b9-a1dc384fc0b2] succeeded in 3.985067061999871s: None 2024-06-18T23:00:16.648307249Z [2024-06-18 23:00:16,648: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[85081d18-4d18-4ae3-bc57-c75a4fac3943] received 2024-06-18T23:00:16.674033416Z [2024-06-18 23:00:16,673: INFO/ForkPoolWorker-15] [85081d18-4d18-4ae3-bc57-c75a4fac3943] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'send_prometheus', 'scheduled__2024-06-18T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-18T23:00:17.131069323Z [2024-06-18 23:00:17,125: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T23:00:18.710923534Z [2024-06-18 23:00:18,710: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T23:00:18.719745085Z [2024-06-18 23:00:18,719: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:00:18.781228977Z [2024-06-18 23:00:18,780: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T23:00:18.784460147Z [2024-06-18 23:00:18,784: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:00:18.784613029Z [2024-06-18 23:00:18,784: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:00:18.784836265Z [2024-06-18 23:00:18,784: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:00:18.785025343Z [2024-06-18 23:00:18,784: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T23:00:18.785870274Z [2024-06-18 23:00:18,785: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T23:00:18.786249864Z [2024-06-18 23:00:18,785: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:00:18.900092142Z [2024-06-18 23:00:18,899: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:00:19.574061725Z [2024-06-18 23:00:19,573: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[85081d18-4d18-4ae3-bc57-c75a4fac3943] succeeded in 2.9203371190001235s: None 2024-06-18T23:01:00.814760202Z [2024-06-18 23:01:00,814: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[27ac1774-fd77-4c06-91ca-0412e4a16a80] received 2024-06-18T23:01:00.817716729Z [2024-06-18 23:01:00,817: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7992ccf1-c342-4f3f-b465-8214ce58cce8] received 2024-06-18T23:01:00.820113742Z [2024-06-18 23:01:00,819: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[41c657db-99b6-4c50-ae7a-6f78a1546094] received 2024-06-18T23:01:00.825972280Z [2024-06-18 23:01:00,825: INFO/ForkPoolWorker-15] [27ac1774-fd77-4c06-91ca-0412e4a16a80] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T23:01:00.836394858Z [2024-06-18 23:01:00,835: INFO/ForkPoolWorker-16] [7992ccf1-c342-4f3f-b465-8214ce58cce8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T23:01:00.836434999Z [2024-06-18 23:01:00,836: INFO/ForkPoolWorker-1] [41c657db-99b6-4c50-ae7a-6f78a1546094] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T23:01:01.199618814Z [2024-06-18 23:01:01,195: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T23:01:01.214189653Z [2024-06-18 23:01:01,210: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T23:01:01.275303704Z [2024-06-18 23:01:01,271: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T23:01:01.420083708Z [2024-06-18 23:01:01,419: INFO/ForkPoolWorker-15] Getting SDNC list 2024-06-18T23:01:01.430073709Z [2024-06-18 23:01:01,429: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:01:01.459317569Z [2024-06-18 23:01:01,459: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T23:01:01.460347528Z [2024-06-18 23:01:01,460: INFO/ForkPoolWorker-15] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T23:01:01.460428756Z [2024-06-18 23:01:01,460: INFO/ForkPoolWorker-15] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T23:01:01.460477327Z [2024-06-18 23:01:01,460: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-06-18T23:01:01.460654807Z [2024-06-18 23:01:01,460: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T23:01:01.587230228Z [2024-06-18 23:01:01,586: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:01:02.425515375Z [2024-06-18 23:01:02,425: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[27ac1774-fd77-4c06-91ca-0412e4a16a80] succeeded in 1.6086436829996273s: None 2024-06-18T23:01:02.514608029Z [2024-06-18 23:01:02,514: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-18T23:01:02.517993724Z [2024-06-18 23:01:02,517: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:01:02.545776991Z [2024-06-18 23:01:02,545: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T23:01:02.547378353Z [2024-06-18 23:01:02,547: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:01:02.547464446Z [2024-06-18 23:01:02,547: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:01:02.547682935Z [2024-06-18 23:01:02,547: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:01:02.547820803Z [2024-06-18 23:01:02,547: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-18T23:01:02.548150462Z [2024-06-18 23:01:02,547: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-18T23:01:02.548237066Z [2024-06-18 23:01:02,548: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:01:02.650877269Z [2024-06-18 23:01:02,650: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-18T23:01:02.654267562Z [2024-06-18 23:01:02,653: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:01:02.662604334Z [2024-06-18 23:01:02,662: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:01:02.678177512Z [2024-06-18 23:01:02,677: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T23:01:02.679378310Z [2024-06-18 23:01:02,679: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:01:02.679393397Z [2024-06-18 23:01:02,679: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:01:02.679563621Z [2024-06-18 23:01:02,679: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:01:02.679574196Z [2024-06-18 23:01:02,679: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-18T23:01:02.679920943Z [2024-06-18 23:01:02,679: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T23:01:02.679951144Z [2024-06-18 23:01:02,679: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:01:02.801062465Z [2024-06-18 23:01:02,800: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:01:04.397700885Z [2024-06-18 23:01:04,396: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[41c657db-99b6-4c50-ae7a-6f78a1546094] succeeded in 3.5709906090000914s: None 2024-06-18T23:01:04.940936656Z [2024-06-18 23:01:04,940: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7992ccf1-c342-4f3f-b465-8214ce58cce8] succeeded in 4.119061295999927s: None 2024-06-18T23:02:01.276554438Z [2024-06-18 23:02:01,275: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d54e6825-f42f-4a31-bb0b-99b16cc05de7] received 2024-06-18T23:02:01.297511275Z [2024-06-18 23:02:01,297: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dbc8b1ed-b5d4-4133-8378-e0558896bb38] received 2024-06-18T23:02:01.304184174Z [2024-06-18 23:02:01,303: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7defb796-05d5-497b-8ddb-d2c5a80ab93b] received 2024-06-18T23:02:01.306538319Z [2024-06-18 23:02:01,306: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bd4aab06-652e-4641-9b57-62030692d6e8] received 2024-06-18T23:02:01.326718089Z [2024-06-18 23:02:01,326: INFO/ForkPoolWorker-16] [dbc8b1ed-b5d4-4133-8378-e0558896bb38] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T23:02:01.326743039Z [2024-06-18 23:02:01,325: INFO/ForkPoolWorker-1] [7defb796-05d5-497b-8ddb-d2c5a80ab93b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T23:02:01.334934790Z [2024-06-18 23:02:01,334: INFO/ForkPoolWorker-15] [d54e6825-f42f-4a31-bb0b-99b16cc05de7] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-18T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-18T23:02:01.336201388Z [2024-06-18 23:02:01,335: INFO/ForkPoolWorker-2] [bd4aab06-652e-4641-9b57-62030692d6e8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T23:02:01.908768740Z [2024-06-18 23:02:01,903: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T23:02:01.924035475Z [2024-06-18 23:02:01,917: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-18T23:02:01.951405827Z [2024-06-18 23:02:01,947: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T23:02:01.966436728Z [2024-06-18 23:02:01,962: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T23:02:02.178786920Z [2024-06-18 23:02:02,178: INFO/ForkPoolWorker-16] Getting SDNC list 2024-06-18T23:02:02.190228551Z [2024-06-18 23:02:02,189: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:02:02.276382615Z [2024-06-18 23:02:02,264: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T23:02:02.276405791Z [2024-06-18 23:02:02,265: INFO/ForkPoolWorker-16] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T23:02:02.276410227Z [2024-06-18 23:02:02,265: INFO/ForkPoolWorker-16] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T23:02:02.276414062Z [2024-06-18 23:02:02,265: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-06-18T23:02:02.276417155Z [2024-06-18 23:02:02,265: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T23:02:02.311209510Z [2024-06-18 23:02:02,310: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:02:02.440381156Z [2024-06-18 23:02:02,440: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:02:02.948541497Z [2024-06-18 23:02:02,948: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d54e6825-f42f-4a31-bb0b-99b16cc05de7] succeeded in 1.6658436220000112s: None 2024-06-18T23:02:03.124887190Z [2024-06-18 23:02:03,124: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[dbc8b1ed-b5d4-4133-8378-e0558896bb38] succeeded in 1.8208350290001363s: None 2024-06-18T23:02:03.401721911Z [2024-06-18 23:02:03,401: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-18T23:02:03.405330172Z [2024-06-18 23:02:03,404: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:02:03.427338703Z [2024-06-18 23:02:03,427: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-18T23:02:03.428733506Z [2024-06-18 23:02:03,428: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:02:03.428981510Z [2024-06-18 23:02:03,428: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:02:03.429160290Z [2024-06-18 23:02:03,428: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:02:03.429435282Z [2024-06-18 23:02:03,429: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-18T23:02:03.429854962Z [2024-06-18 23:02:03,429: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T23:02:03.429928170Z [2024-06-18 23:02:03,429: INFO/ForkPoolWorker-2] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:02:03.522820261Z [2024-06-18 23:02:03,522: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:02:03.578962048Z [2024-06-18 23:02:03,578: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-18T23:02:03.582433893Z [2024-06-18 23:02:03,582: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:02:03.608799855Z [2024-06-18 23:02:03,608: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T23:02:03.611659001Z [2024-06-18 23:02:03,611: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:02:03.611872020Z [2024-06-18 23:02:03,611: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:02:03.611959492Z [2024-06-18 23:02:03,611: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:02:03.612031266Z [2024-06-18 23:02:03,611: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-18T23:02:03.612694709Z [2024-06-18 23:02:03,612: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-06-18T23:02:03.612719234Z [2024-06-18 23:02:03,612: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:02:03.730350322Z [2024-06-18 23:02:03,729: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:02:05.510160507Z [2024-06-18 23:02:05,509: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[bd4aab06-652e-4641-9b57-62030692d6e8] succeeded in 4.198955584000032s: None 2024-06-18T23:02:05.875129677Z [2024-06-18 23:02:05,874: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7defb796-05d5-497b-8ddb-d2c5a80ab93b] succeeded in 4.566774022000118s: None 2024-06-18T23:03:01.182525632Z [2024-06-18 23:03:01,182: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2960ff62-fc37-48d7-92bd-141798167e02] received 2024-06-18T23:03:01.188269651Z [2024-06-18 23:03:01,187: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4215bd35-0846-4626-b604-b31cff8fb6d5] received 2024-06-18T23:03:01.192449804Z [2024-06-18 23:03:01,191: INFO/ForkPoolWorker-15] [2960ff62-fc37-48d7-92bd-141798167e02] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T23:03:01.200890743Z [2024-06-18 23:03:01,200: INFO/ForkPoolWorker-16] [4215bd35-0846-4626-b604-b31cff8fb6d5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T23:03:01.203209383Z [2024-06-18 23:03:01,202: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fa18e39e-c7b5-4152-89c8-9feba9e92262] received 2024-06-18T23:03:01.215409961Z [2024-06-18 23:03:01,214: INFO/ForkPoolWorker-1] [fa18e39e-c7b5-4152-89c8-9feba9e92262] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T23:03:01.540535222Z [2024-06-18 23:03:01,536: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T23:03:01.559102790Z [2024-06-18 23:03:01,554: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T23:03:01.578146796Z [2024-06-18 23:03:01,574: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T23:03:01.718611981Z [2024-06-18 23:03:01,718: INFO/ForkPoolWorker-1] Getting SDNC list 2024-06-18T23:03:01.723403961Z [2024-06-18 23:03:01,722: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:03:01.757906118Z [2024-06-18 23:03:01,757: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T23:03:01.759379396Z [2024-06-18 23:03:01,759: INFO/ForkPoolWorker-1] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T23:03:01.759521419Z [2024-06-18 23:03:01,759: INFO/ForkPoolWorker-1] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T23:03:01.759578650Z [2024-06-18 23:03:01,759: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-06-18T23:03:01.760017640Z [2024-06-18 23:03:01,759: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T23:03:01.874041455Z [2024-06-18 23:03:01,873: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:03:02.547930762Z [2024-06-18 23:03:02,547: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[fa18e39e-c7b5-4152-89c8-9feba9e92262] succeeded in 1.342679097999735s: None 2024-06-18T23:03:02.868655643Z [2024-06-18 23:03:02,868: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-18T23:03:02.875217309Z [2024-06-18 23:03:02,874: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:03:02.908360158Z [2024-06-18 23:03:02,908: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T23:03:02.910937908Z [2024-06-18 23:03:02,910: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:03:02.911149578Z [2024-06-18 23:03:02,910: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:03:02.911427110Z [2024-06-18 23:03:02,911: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:03:02.911634765Z [2024-06-18 23:03:02,911: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-18T23:03:02.912138880Z [2024-06-18 23:03:02,911: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T23:03:02.912400038Z [2024-06-18 23:03:02,912: INFO/ForkPoolWorker-16] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:03:03.017195607Z [2024-06-18 23:03:03,016: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T23:03:03.017573885Z [2024-06-18 23:03:03,017: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:03:03.020789402Z [2024-06-18 23:03:03,020: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:03:03.045145294Z [2024-06-18 23:03:03,044: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T23:03:03.046431456Z [2024-06-18 23:03:03,046: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:03:03.046514002Z [2024-06-18 23:03:03,046: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:03:03.046606476Z [2024-06-18 23:03:03,046: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:03:03.046681693Z [2024-06-18 23:03:03,046: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T23:03:03.047084827Z [2024-06-18 23:03:03,046: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-06-18T23:03:03.047093309Z [2024-06-18 23:03:03,046: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:03:03.142757178Z [2024-06-18 23:03:03,142: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:03:04.822713241Z [2024-06-18 23:03:04,821: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4215bd35-0846-4626-b604-b31cff8fb6d5] succeeded in 3.6318072610001764s: None 2024-06-18T23:03:05.592080412Z [2024-06-18 23:03:05,591: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2960ff62-fc37-48d7-92bd-141798167e02] succeeded in 4.406220496999595s: None 2024-06-18T23:04:00.984698858Z [2024-06-18 23:04:00,984: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1d82e8e8-f3a6-4505-86c1-1ebbf220bdde] received 2024-06-18T23:04:00.988649790Z [2024-06-18 23:04:00,988: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7dfc0a5a-ec40-4967-b21e-25c21aeea641] received 2024-06-18T23:04:00.994103346Z [2024-06-18 23:04:00,993: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[49e43c69-42b1-4502-8235-750fda7b99cc] received 2024-06-18T23:04:00.997594894Z [2024-06-18 23:04:00,997: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6baa58f0-252f-4ea6-b228-d72506e13637] received 2024-06-18T23:04:01.010717294Z [2024-06-18 23:04:01,010: INFO/ForkPoolWorker-15] [1d82e8e8-f3a6-4505-86c1-1ebbf220bdde] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-18T23:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-18T23:04:01.012503444Z [2024-06-18 23:04:01,012: INFO/ForkPoolWorker-16] [7dfc0a5a-ec40-4967-b21e-25c21aeea641] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T23:04:01.017296074Z [2024-06-18 23:04:01,016: INFO/ForkPoolWorker-1] [49e43c69-42b1-4502-8235-750fda7b99cc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T23:04:01.019476837Z [2024-06-18 23:04:01,019: INFO/ForkPoolWorker-2] [6baa58f0-252f-4ea6-b228-d72506e13637] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T23:04:01.376336335Z [2024-06-18 23:04:01,370: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T23:04:01.390191377Z [2024-06-18 23:04:01,386: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T23:04:01.428217526Z [2024-06-18 23:04:01,424: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-18T23:04:01.446537212Z [2024-06-18 23:04:01,442: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T23:04:01.630194543Z [2024-06-18 23:04:01,629: INFO/ForkPoolWorker-16] Getting SDNC list 2024-06-18T23:04:01.634504795Z [2024-06-18 23:04:01,633: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:04:01.675664440Z [2024-06-18 23:04:01,675: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T23:04:01.677820013Z [2024-06-18 23:04:01,677: INFO/ForkPoolWorker-16] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T23:04:01.678179884Z [2024-06-18 23:04:01,677: INFO/ForkPoolWorker-16] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T23:04:01.678861981Z [2024-06-18 23:04:01,678: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-06-18T23:04:01.679220198Z [2024-06-18 23:04:01,679: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T23:04:01.702363379Z [2024-06-18 23:04:01,702: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:04:01.815417528Z [2024-06-18 23:04:01,815: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:04:02.499372817Z [2024-06-18 23:04:02,498: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1d82e8e8-f3a6-4505-86c1-1ebbf220bdde] succeeded in 1.5058360630000607s: None 2024-06-18T23:04:02.543945226Z [2024-06-18 23:04:02,543: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7dfc0a5a-ec40-4967-b21e-25c21aeea641] succeeded in 1.5526172519998909s: None 2024-06-18T23:04:02.900533671Z [2024-06-18 23:04:02,900: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-18T23:04:02.903908263Z [2024-06-18 23:04:02,903: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:04:02.928988917Z [2024-06-18 23:04:02,928: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T23:04:02.930548522Z [2024-06-18 23:04:02,930: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:04:02.930746895Z [2024-06-18 23:04:02,930: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:04:02.930987344Z [2024-06-18 23:04:02,930: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:04:02.931150712Z [2024-06-18 23:04:02,930: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-18T23:04:02.931611877Z [2024-06-18 23:04:02,931: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T23:04:02.931880342Z [2024-06-18 23:04:02,931: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:04:02.987275546Z [2024-06-18 23:04:02,986: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-18T23:04:02.991752415Z [2024-06-18 23:04:02,991: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:04:03.034376514Z [2024-06-18 23:04:03,034: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-18T23:04:03.040558365Z [2024-06-18 23:04:03,040: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:04:03.040879963Z [2024-06-18 23:04:03,040: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:04:03.041100403Z [2024-06-18 23:04:03,040: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:04:03.041199339Z [2024-06-18 23:04:03,041: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-18T23:04:03.041564016Z [2024-06-18 23:04:03,041: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-06-18T23:04:03.041677861Z [2024-06-18 23:04:03,041: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:04:03.103649765Z [2024-06-18 23:04:03,103: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:04:03.143654189Z [2024-06-18 23:04:03,143: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:04:04.928118793Z [2024-06-18 23:04:04,927: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[49e43c69-42b1-4502-8235-750fda7b99cc] succeeded in 3.931216920999759s: None 2024-06-18T23:04:05.540064677Z [2024-06-18 23:04:05,539: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[6baa58f0-252f-4ea6-b228-d72506e13637] succeeded in 4.533899493999797s: None 2024-06-18T23:05:00.349955532Z [2024-06-18 23:05:00,349: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0a855357-8bca-4c95-9de3-447534901102] received 2024-06-18T23:05:00.355154702Z [2024-06-18 23:05:00,354: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7a1fd571-b575-4bf2-80e5-2b9f59477522] received 2024-06-18T23:05:00.362014018Z [2024-06-18 23:05:00,361: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7cb4b471-3bbf-4eab-aaf0-12c41e3210c6] received 2024-06-18T23:05:00.367577341Z [2024-06-18 23:05:00,366: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4879a03a-e20e-42b4-b7d4-f9a28f8dc1ab] received 2024-06-18T23:05:00.367775930Z [2024-06-18 23:05:00,367: INFO/ForkPoolWorker-16] [7a1fd571-b575-4bf2-80e5-2b9f59477522] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T23:05:00.370059761Z [2024-06-18 23:05:00,369: INFO/ForkPoolWorker-15] [0a855357-8bca-4c95-9de3-447534901102] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-18T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-18T23:05:00.374570996Z [2024-06-18 23:05:00,374: INFO/ForkPoolWorker-1] [7cb4b471-3bbf-4eab-aaf0-12c41e3210c6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T23:05:00.377522153Z [2024-06-18 23:05:00,377: INFO/ForkPoolWorker-2] [4879a03a-e20e-42b4-b7d4-f9a28f8dc1ab] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T23:05:00.668596918Z [2024-06-18 23:05:00,664: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T23:05:00.693515082Z [2024-06-18 23:05:00,690: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T23:05:00.697919294Z [2024-06-18 23:05:00,693: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T23:05:00.801570136Z [2024-06-18 23:05:00,796: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T23:05:00.915586028Z [2024-06-18 23:05:00,915: INFO/ForkPoolWorker-2] Getting SDNC list 2024-06-18T23:05:00.926213918Z [2024-06-18 23:05:00,925: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:05:00.964807962Z [2024-06-18 23:05:00,964: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-18T23:05:00.966951904Z [2024-06-18 23:05:00,966: INFO/ForkPoolWorker-2] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T23:05:00.967306292Z [2024-06-18 23:05:00,966: INFO/ForkPoolWorker-2] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T23:05:00.967365324Z [2024-06-18 23:05:00,967: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-06-18T23:05:00.967640248Z [2024-06-18 23:05:00,967: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T23:05:01.112848566Z [2024-06-18 23:05:01,112: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:05:01.979213936Z [2024-06-18 23:05:01,978: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[4879a03a-e20e-42b4-b7d4-f9a28f8dc1ab] succeeded in 1.6096229229997334s: None 2024-06-18T23:05:02.594126744Z [2024-06-18 23:05:02,593: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-18T23:05:02.598239862Z [2024-06-18 23:05:02,597: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:05:02.638347486Z [2024-06-18 23:05:02,638: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T23:05:02.639847636Z [2024-06-18 23:05:02,639: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:05:02.639860715Z [2024-06-18 23:05:02,639: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:05:02.639963216Z [2024-06-18 23:05:02,639: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:05:02.639988815Z [2024-06-18 23:05:02,639: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-18T23:05:02.640230032Z [2024-06-18 23:05:02,640: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T23:05:02.640256198Z [2024-06-18 23:05:02,640: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:05:02.649787392Z [2024-06-18 23:05:02,649: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-18T23:05:02.651548032Z [2024-06-18 23:05:02,651: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T23:05:02.655076748Z [2024-06-18 23:05:02,654: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:05:02.655613015Z [2024-06-18 23:05:02,655: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:05:02.687667086Z [2024-06-18 23:05:02,687: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T23:05:02.689180684Z [2024-06-18 23:05:02,688: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:05:02.689367660Z [2024-06-18 23:05:02,689: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:05:02.689587374Z [2024-06-18 23:05:02,689: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:05:02.689690906Z [2024-06-18 23:05:02,689: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-18T23:05:02.690019053Z [2024-06-18 23:05:02,689: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-18T23:05:02.690475615Z [2024-06-18 23:05:02,689: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:05:02.704816515Z [2024-06-18 23:05:02,704: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T23:05:02.707243058Z [2024-06-18 23:05:02,706: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:05:02.707604137Z [2024-06-18 23:05:02,707: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:05:02.708071407Z [2024-06-18 23:05:02,707: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:05:02.708389791Z [2024-06-18 23:05:02,708: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T23:05:02.708960327Z [2024-06-18 23:05:02,708: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T23:05:02.709822631Z [2024-06-18 23:05:02,709: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:05:02.752474454Z [2024-06-18 23:05:02,752: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:05:02.789119438Z [2024-06-18 23:05:02,788: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:05:02.856537298Z [2024-06-18 23:05:02,856: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:05:03.500945575Z [2024-06-18 23:05:03,500: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0a855357-8bca-4c95-9de3-447534901102] succeeded in 3.143748219000372s: None 2024-06-18T23:05:03.573731978Z [2024-06-18 23:05:03,573: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4c8802dd-193e-4aa4-a8a6-e655b9d2f714] received 2024-06-18T23:05:03.585141331Z [2024-06-18 23:05:03,584: INFO/ForkPoolWorker-15] [4c8802dd-193e-4aa4-a8a6-e655b9d2f714] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'split_metrics', 'scheduled__2024-06-18T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-18T23:05:03.940777651Z [2024-06-18 23:05:03,936: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T23:05:04.405119946Z [2024-06-18 23:05:04,404: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7cb4b471-3bbf-4eab-aaf0-12c41e3210c6] succeeded in 4.03996620099997s: None 2024-06-18T23:05:04.701485037Z [2024-06-18 23:05:04,700: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7a1fd571-b575-4bf2-80e5-2b9f59477522] succeeded in 4.344198384000265s: None 2024-06-18T23:05:05.227491038Z [2024-06-18 23:05:05,227: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T23:05:05.231045112Z [2024-06-18 23:05:05,230: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:05:05.261448123Z [2024-06-18 23:05:05,261: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T23:05:05.262673814Z [2024-06-18 23:05:05,262: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:05:05.262772782Z [2024-06-18 23:05:05,262: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:05:05.262939621Z [2024-06-18 23:05:05,262: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:05:05.262980760Z [2024-06-18 23:05:05,262: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T23:05:05.263242481Z [2024-06-18 23:05:05,263: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T23:05:05.263316725Z [2024-06-18 23:05:05,263: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:05:05.374350116Z [2024-06-18 23:05:05,373: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:05:06.123489198Z [2024-06-18 23:05:06,122: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4c8802dd-193e-4aa4-a8a6-e655b9d2f714] succeeded in 2.5453857410002456s: None 2024-06-18T23:05:07.119733733Z [2024-06-18 23:05:07,119: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eb89ab00-0eaa-4be1-84c1-3595eb506ddc] received 2024-06-18T23:05:07.143380681Z [2024-06-18 23:05:07,143: INFO/ForkPoolWorker-15] [eb89ab00-0eaa-4be1-84c1-3595eb506ddc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'collect_metrics', 'scheduled__2024-06-18T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-18T23:05:07.462337619Z [2024-06-18 23:05:07,458: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T23:05:08.697854965Z [2024-06-18 23:05:08,697: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T23:05:08.701241011Z [2024-06-18 23:05:08,700: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:05:08.722240511Z [2024-06-18 23:05:08,722: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T23:05:08.723450317Z [2024-06-18 23:05:08,723: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:05:08.723572787Z [2024-06-18 23:05:08,723: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:05:08.723852981Z [2024-06-18 23:05:08,723: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:05:08.724060324Z [2024-06-18 23:05:08,723: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T23:05:08.724328828Z [2024-06-18 23:05:08,724: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T23:05:08.724409750Z [2024-06-18 23:05:08,724: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:05:08.821232706Z [2024-06-18 23:05:08,820: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:05:09.413966128Z [2024-06-18 23:05:09,413: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[eb89ab00-0eaa-4be1-84c1-3595eb506ddc] succeeded in 2.2919587629999114s: None 2024-06-18T23:05:09.699126497Z [2024-06-18 23:05:09,698: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f92a0549-377b-4cff-b431-646747b7ca36] received 2024-06-18T23:05:09.712143247Z [2024-06-18 23:05:09,711: INFO/ForkPoolWorker-15] [f92a0549-377b-4cff-b431-646747b7ca36] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'send_prometheus', 'scheduled__2024-06-18T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-18T23:05:10.038655325Z [2024-06-18 23:05:10,035: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T23:05:11.164844804Z [2024-06-18 23:05:11,164: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T23:05:11.168485326Z [2024-06-18 23:05:11,167: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:05:11.195095777Z [2024-06-18 23:05:11,194: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T23:05:11.196301368Z [2024-06-18 23:05:11,196: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:05:11.196415675Z [2024-06-18 23:05:11,196: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:05:11.196545386Z [2024-06-18 23:05:11,196: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:05:11.196552958Z [2024-06-18 23:05:11,196: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T23:05:11.197177321Z [2024-06-18 23:05:11,196: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T23:05:11.197235841Z [2024-06-18 23:05:11,197: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:05:11.315785599Z [2024-06-18 23:05:11,315: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:05:11.938029802Z [2024-06-18 23:05:11,937: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f92a0549-377b-4cff-b431-646747b7ca36] succeeded in 2.2342368239997086s: None 2024-06-18T23:06:00.588633486Z [2024-06-18 23:06:00,588: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[08575bec-ef65-41db-a77a-2b4a44adaa74] received 2024-06-18T23:06:00.595752012Z [2024-06-18 23:06:00,595: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[19ddb454-aef5-4f18-929d-bfdc29de9b1e] received 2024-06-18T23:06:00.602453350Z [2024-06-18 23:06:00,602: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c6ed666f-b348-410d-9a48-11d0f1d82f53] received 2024-06-18T23:06:00.611866111Z [2024-06-18 23:06:00,611: INFO/ForkPoolWorker-16] [19ddb454-aef5-4f18-929d-bfdc29de9b1e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-18T23:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-18T23:06:00.613341106Z [2024-06-18 23:06:00,613: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[740786b8-a43a-4d03-a7f4-0a738c361583] received 2024-06-18T23:06:00.624370868Z [2024-06-18 23:06:00,623: INFO/ForkPoolWorker-15] [08575bec-ef65-41db-a77a-2b4a44adaa74] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T23:06:00.627347481Z [2024-06-18 23:06:00,626: INFO/ForkPoolWorker-2] [740786b8-a43a-4d03-a7f4-0a738c361583] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T23:06:00.634337596Z [2024-06-18 23:06:00,629: INFO/ForkPoolWorker-1] [c6ed666f-b348-410d-9a48-11d0f1d82f53] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T23:06:01.014036391Z [2024-06-18 23:06:01,009: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T23:06:01.082272461Z [2024-06-18 23:06:01,074: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T23:06:01.095527700Z [2024-06-18 23:06:01,090: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-18T23:06:01.176087815Z [2024-06-18 23:06:01,156: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T23:06:01.187442380Z [2024-06-18 23:06:01,186: INFO/ForkPoolWorker-2] Getting SDNC list 2024-06-18T23:06:01.191840761Z [2024-06-18 23:06:01,191: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:06:01.247898488Z [2024-06-18 23:06:01,247: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-18T23:06:01.256224954Z [2024-06-18 23:06:01,255: INFO/ForkPoolWorker-2] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T23:06:01.256993425Z [2024-06-18 23:06:01,256: INFO/ForkPoolWorker-2] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T23:06:01.257345820Z [2024-06-18 23:06:01,256: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-06-18T23:06:01.257747991Z [2024-06-18 23:06:01,257: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T23:06:01.398614275Z [2024-06-18 23:06:01,398: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:06:01.407602377Z [2024-06-18 23:06:01,407: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:06:02.127958071Z [2024-06-18 23:06:02,127: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[740786b8-a43a-4d03-a7f4-0a738c361583] succeeded in 1.5116852520000066s: None 2024-06-18T23:06:02.343248142Z [2024-06-18 23:06:02,342: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[19ddb454-aef5-4f18-929d-bfdc29de9b1e] succeeded in 1.7440097569997306s: None 2024-06-18T23:06:02.447357473Z [2024-06-18 23:06:02,447: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T23:06:02.451054642Z [2024-06-18 23:06:02,450: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:06:02.484892186Z [2024-06-18 23:06:02,484: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T23:06:02.488474526Z [2024-06-18 23:06:02,488: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:06:02.488623067Z [2024-06-18 23:06:02,488: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:06:02.488840269Z [2024-06-18 23:06:02,488: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:06:02.488962025Z [2024-06-18 23:06:02,488: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T23:06:02.489559333Z [2024-06-18 23:06:02,489: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T23:06:02.489695230Z [2024-06-18 23:06:02,489: INFO/ForkPoolWorker-15] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:06:02.603108001Z [2024-06-18 23:06:02,602: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:06:03.125787321Z [2024-06-18 23:06:03,125: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-18T23:06:03.129266232Z [2024-06-18 23:06:03,128: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:06:03.159766551Z [2024-06-18 23:06:03,159: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T23:06:03.161177698Z [2024-06-18 23:06:03,160: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:06:03.161194241Z [2024-06-18 23:06:03,161: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:06:03.161271936Z [2024-06-18 23:06:03,161: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:06:03.161463287Z [2024-06-18 23:06:03,161: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-18T23:06:03.161719208Z [2024-06-18 23:06:03,161: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-06-18T23:06:03.161863175Z [2024-06-18 23:06:03,161: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:06:03.286256866Z [2024-06-18 23:06:03,285: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:06:04.245667939Z [2024-06-18 23:06:04,245: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[08575bec-ef65-41db-a77a-2b4a44adaa74] succeeded in 3.65449181699978s: None 2024-06-18T23:06:05.476196778Z [2024-06-18 23:06:05,475: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c6ed666f-b348-410d-9a48-11d0f1d82f53] succeeded in 4.869432226999834s: None 2024-06-18T23:07:00.440170771Z [2024-06-18 23:07:00,439: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f6a7c4d4-6412-4852-aef9-8cf71b962085] received 2024-06-18T23:07:00.443581916Z [2024-06-18 23:07:00,443: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d382a69d-ed4f-4c9f-82c4-9c6d9d9b5d1d] received 2024-06-18T23:07:00.448680979Z [2024-06-18 23:07:00,448: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f1e2af37-3ed0-4a09-9fe8-898592f105a3] received 2024-06-18T23:07:00.450848833Z [2024-06-18 23:07:00,450: INFO/ForkPoolWorker-15] [f6a7c4d4-6412-4852-aef9-8cf71b962085] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T23:07:00.470676544Z [2024-06-18 23:07:00,470: INFO/ForkPoolWorker-16] [d382a69d-ed4f-4c9f-82c4-9c6d9d9b5d1d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T23:07:00.488007172Z [2024-06-18 23:07:00,486: INFO/ForkPoolWorker-1] [f1e2af37-3ed0-4a09-9fe8-898592f105a3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T23:07:00.774177128Z [2024-06-18 23:07:00,770: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T23:07:00.816045622Z [2024-06-18 23:07:00,811: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T23:07:00.819945482Z [2024-06-18 23:07:00,813: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T23:07:00.985738902Z [2024-06-18 23:07:00,985: INFO/ForkPoolWorker-16] Getting SDNC list 2024-06-18T23:07:00.990245025Z [2024-06-18 23:07:00,989: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:07:01.022850437Z [2024-06-18 23:07:01,022: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T23:07:01.026789788Z [2024-06-18 23:07:01,026: INFO/ForkPoolWorker-16] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T23:07:01.027435672Z [2024-06-18 23:07:01,026: INFO/ForkPoolWorker-16] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T23:07:01.027815739Z [2024-06-18 23:07:01,027: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-06-18T23:07:01.029492375Z [2024-06-18 23:07:01,029: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T23:07:01.148917144Z [2024-06-18 23:07:01,148: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:07:01.882827427Z [2024-06-18 23:07:01,881: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d382a69d-ed4f-4c9f-82c4-9c6d9d9b5d1d] succeeded in 1.4341025359999549s: None 2024-06-18T23:07:02.038088890Z [2024-06-18 23:07:02,037: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T23:07:02.041733594Z [2024-06-18 23:07:02,041: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:07:02.062026681Z [2024-06-18 23:07:02,061: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T23:07:02.063353997Z [2024-06-18 23:07:02,063: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:07:02.063527894Z [2024-06-18 23:07:02,063: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:07:02.063800249Z [2024-06-18 23:07:02,063: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:07:02.063927125Z [2024-06-18 23:07:02,063: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T23:07:02.064302935Z [2024-06-18 23:07:02,064: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-06-18T23:07:02.064438847Z [2024-06-18 23:07:02,064: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:07:02.164568026Z [2024-06-18 23:07:02,164: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:07:02.315343332Z [2024-06-18 23:07:02,314: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-18T23:07:02.319156524Z [2024-06-18 23:07:02,318: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:07:02.362664829Z [2024-06-18 23:07:02,362: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T23:07:02.369442162Z [2024-06-18 23:07:02,369: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:07:02.369597624Z [2024-06-18 23:07:02,369: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:07:02.369858717Z [2024-06-18 23:07:02,369: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:07:02.370255562Z [2024-06-18 23:07:02,369: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-18T23:07:02.371618201Z [2024-06-18 23:07:02,371: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T23:07:02.371845121Z [2024-06-18 23:07:02,371: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:07:02.493935952Z [2024-06-18 23:07:02,493: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:07:04.155851098Z [2024-06-18 23:07:04,145: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f1e2af37-3ed0-4a09-9fe8-898592f105a3] succeeded in 3.6919716239999616s: None 2024-06-18T23:07:04.155883967Z [2024-06-18 23:07:04,149: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f6a7c4d4-6412-4852-aef9-8cf71b962085] succeeded in 3.707938544999706s: None 2024-06-18T23:08:00.304302347Z [2024-06-18 23:08:00,303: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a4fa5a10-f268-48f1-b55d-08c64d525346] received 2024-06-18T23:08:00.313113451Z [2024-06-18 23:08:00,312: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c2e2f56f-0c1d-40f9-b001-8690997aa4d4] received 2024-06-18T23:08:00.313350053Z [2024-06-18 23:08:00,313: INFO/ForkPoolWorker-15] [a4fa5a10-f268-48f1-b55d-08c64d525346] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-18T23:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-18T23:08:00.317514495Z [2024-06-18 23:08:00,316: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[336e92d6-44b6-48d1-ad56-e40dc45221b7] received 2024-06-18T23:08:00.323209175Z [2024-06-18 23:08:00,322: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e317cd7c-2320-421a-879d-6b18e4bea100] received 2024-06-18T23:08:00.330494926Z [2024-06-18 23:08:00,330: INFO/ForkPoolWorker-1] [336e92d6-44b6-48d1-ad56-e40dc45221b7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T23:08:00.343796117Z [2024-06-18 23:08:00,343: INFO/ForkPoolWorker-16] [c2e2f56f-0c1d-40f9-b001-8690997aa4d4] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T23:08:00.345251143Z [2024-06-18 23:08:00,344: INFO/ForkPoolWorker-2] [e317cd7c-2320-421a-879d-6b18e4bea100] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T23:08:00.696886240Z [2024-06-18 23:08:00,692: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-18T23:08:00.698928524Z [2024-06-18 23:08:00,694: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T23:08:00.701286294Z [2024-06-18 23:08:00,697: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T23:08:00.791113240Z [2024-06-18 23:08:00,787: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T23:08:00.870237618Z [2024-06-18 23:08:00,869: INFO/ForkPoolWorker-16] Getting SDNC list 2024-06-18T23:08:00.874641950Z [2024-06-18 23:08:00,874: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:08:00.912115056Z [2024-06-18 23:08:00,911: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T23:08:00.913194916Z [2024-06-18 23:08:00,912: INFO/ForkPoolWorker-16] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T23:08:00.913386637Z [2024-06-18 23:08:00,913: INFO/ForkPoolWorker-16] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T23:08:00.913451394Z [2024-06-18 23:08:00,913: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-06-18T23:08:00.913713461Z [2024-06-18 23:08:00,913: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T23:08:00.974655930Z [2024-06-18 23:08:00,974: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:08:01.020619840Z [2024-06-18 23:08:01,020: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:08:01.604127813Z [2024-06-18 23:08:01,603: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a4fa5a10-f268-48f1-b55d-08c64d525346] succeeded in 1.297508346000086s: None 2024-06-18T23:08:01.675089278Z [2024-06-18 23:08:01,674: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c2e2f56f-0c1d-40f9-b001-8690997aa4d4] succeeded in 1.3564356120000411s: None 2024-06-18T23:08:02.042572089Z [2024-06-18 23:08:02,042: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-18T23:08:02.045927938Z [2024-06-18 23:08:02,045: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:08:02.076787118Z [2024-06-18 23:08:02,076: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T23:08:02.079024920Z [2024-06-18 23:08:02,078: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:08:02.079264115Z [2024-06-18 23:08:02,079: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:08:02.079575698Z [2024-06-18 23:08:02,079: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:08:02.079812823Z [2024-06-18 23:08:02,079: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-18T23:08:02.080456177Z [2024-06-18 23:08:02,080: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T23:08:02.080743994Z [2024-06-18 23:08:02,080: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:08:02.202810435Z [2024-06-18 23:08:02,202: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-18T23:08:02.206262241Z [2024-06-18 23:08:02,205: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:08:02.216302082Z [2024-06-18 23:08:02,216: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:08:02.234986436Z [2024-06-18 23:08:02,228: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-18T23:08:02.235010458Z [2024-06-18 23:08:02,229: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:08:02.235013998Z [2024-06-18 23:08:02,229: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:08:02.235018095Z [2024-06-18 23:08:02,229: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:08:02.235022724Z [2024-06-18 23:08:02,229: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-18T23:08:02.235026040Z [2024-06-18 23:08:02,229: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-06-18T23:08:02.235040458Z [2024-06-18 23:08:02,229: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:08:02.383134465Z [2024-06-18 23:08:02,382: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:08:03.774429200Z [2024-06-18 23:08:03,773: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[336e92d6-44b6-48d1-ad56-e40dc45221b7] succeeded in 3.4506623110000874s: None 2024-06-18T23:08:04.232330753Z [2024-06-18 23:08:04,231: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[e317cd7c-2320-421a-879d-6b18e4bea100] succeeded in 3.9002725909999754s: None 2024-06-18T23:09:01.029570034Z [2024-06-18 23:09:01,028: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b6f79a43-7b6a-4867-b9b0-1aa5e5ac3786] received 2024-06-18T23:09:01.032497542Z [2024-06-18 23:09:01,032: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9e4d57b1-8eb5-4525-bb8a-9c6c2e0c7010] received 2024-06-18T23:09:01.040182555Z [2024-06-18 23:09:01,039: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[54170aa6-ae8f-4768-bb7c-250aff205af4] received 2024-06-18T23:09:01.046094833Z [2024-06-18 23:09:01,045: INFO/ForkPoolWorker-15] [b6f79a43-7b6a-4867-b9b0-1aa5e5ac3786] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T23:09:01.066046198Z [2024-06-18 23:09:01,065: INFO/ForkPoolWorker-16] [9e4d57b1-8eb5-4525-bb8a-9c6c2e0c7010] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T23:09:01.067371556Z [2024-06-18 23:09:01,066: INFO/ForkPoolWorker-1] [54170aa6-ae8f-4768-bb7c-250aff205af4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T23:09:01.427528416Z [2024-06-18 23:09:01,422: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T23:09:01.443774219Z [2024-06-18 23:09:01,440: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T23:09:01.444932417Z [2024-06-18 23:09:01,440: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T23:09:01.609392156Z [2024-06-18 23:09:01,608: INFO/ForkPoolWorker-15] Getting SDNC list 2024-06-18T23:09:01.613611659Z [2024-06-18 23:09:01,613: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:09:01.644381174Z [2024-06-18 23:09:01,644: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T23:09:01.646156344Z [2024-06-18 23:09:01,645: INFO/ForkPoolWorker-15] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T23:09:01.646402362Z [2024-06-18 23:09:01,646: INFO/ForkPoolWorker-15] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T23:09:01.646541344Z [2024-06-18 23:09:01,646: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-06-18T23:09:01.646892795Z [2024-06-18 23:09:01,646: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T23:09:01.746186896Z [2024-06-18 23:09:01,745: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:09:02.493175553Z [2024-06-18 23:09:02,492: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b6f79a43-7b6a-4867-b9b0-1aa5e5ac3786] succeeded in 1.4607678950001173s: None 2024-06-18T23:09:02.919884769Z [2024-06-18 23:09:02,919: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-18T23:09:02.923591016Z [2024-06-18 23:09:02,923: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:09:02.950243749Z [2024-06-18 23:09:02,949: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T23:09:02.952938060Z [2024-06-18 23:09:02,952: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:09:02.953046079Z [2024-06-18 23:09:02,952: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:09:02.953264116Z [2024-06-18 23:09:02,953: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:09:02.953326751Z [2024-06-18 23:09:02,953: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-18T23:09:02.953674886Z [2024-06-18 23:09:02,953: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T23:09:02.954109292Z [2024-06-18 23:09:02,953: INFO/ForkPoolWorker-16] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:09:03.008953139Z [2024-06-18 23:09:03,008: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-18T23:09:03.012303227Z [2024-06-18 23:09:03,011: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:09:03.032944141Z [2024-06-18 23:09:03,032: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T23:09:03.034580524Z [2024-06-18 23:09:03,034: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:09:03.035100289Z [2024-06-18 23:09:03,034: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:09:03.035246624Z [2024-06-18 23:09:03,035: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:09:03.035329441Z [2024-06-18 23:09:03,035: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-18T23:09:03.035797634Z [2024-06-18 23:09:03,035: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-06-18T23:09:03.035959207Z [2024-06-18 23:09:03,035: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:09:03.046347165Z [2024-06-18 23:09:03,046: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:09:03.138241042Z [2024-06-18 23:09:03,137: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:09:04.730600286Z [2024-06-18 23:09:04,730: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9e4d57b1-8eb5-4525-bb8a-9c6c2e0c7010] succeeded in 3.694649873000344s: None 2024-06-18T23:09:05.245962591Z [2024-06-18 23:09:05,244: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[54170aa6-ae8f-4768-bb7c-250aff205af4] succeeded in 4.200669599999856s: None 2024-06-18T23:10:01.075991136Z [2024-06-18 23:10:01,075: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c817acf2-0cf3-47d8-a680-8f21ca68d2d3] received 2024-06-18T23:10:01.081584452Z [2024-06-18 23:10:01,081: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2546f153-f35c-4dc6-b621-6ba00ca6d1a0] received 2024-06-18T23:10:01.088513899Z [2024-06-18 23:10:01,088: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3d5591d0-fd9c-4ff1-b24d-37396eece37f] received 2024-06-18T23:10:01.091887303Z [2024-06-18 23:10:01,091: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[320652f2-566e-43f3-a582-52b235dcfd5f] received 2024-06-18T23:10:01.096599250Z [2024-06-18 23:10:01,096: INFO/ForkPoolWorker-15] [c817acf2-0cf3-47d8-a680-8f21ca68d2d3] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T23:10:01.105852804Z [2024-06-18 23:10:01,105: INFO/ForkPoolWorker-1] [3d5591d0-fd9c-4ff1-b24d-37396eece37f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-18T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-18T23:10:01.111570244Z [2024-06-18 23:10:01,111: INFO/ForkPoolWorker-2] [320652f2-566e-43f3-a582-52b235dcfd5f] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-18T23:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-18T23:10:01.113980758Z [2024-06-18 23:10:01,113: INFO/ForkPoolWorker-16] [2546f153-f35c-4dc6-b621-6ba00ca6d1a0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T23:10:01.138435028Z [2024-06-18 23:10:01,138: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[edd8d561-3f10-4d3b-b7e8-b61f1860c62d] received 2024-06-18T23:10:01.165129762Z [2024-06-18 23:10:01,164: INFO/ForkPoolWorker-3] [edd8d561-3f10-4d3b-b7e8-b61f1860c62d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T23:10:01.464561556Z [2024-06-18 23:10:01,460: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T23:10:01.538262294Z [2024-06-18 23:10:01,534: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T23:10:01.660230104Z [2024-06-18 23:10:01,659: INFO/ForkPoolWorker-15] Getting SDNC list 2024-06-18T23:10:01.664722052Z [2024-06-18 23:10:01,664: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:10:01.684842697Z [2024-06-18 23:10:01,679: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T23:10:01.711099815Z [2024-06-18 23:10:01,710: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T23:10:01.712505867Z [2024-06-18 23:10:01,712: INFO/ForkPoolWorker-15] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T23:10:01.712794937Z [2024-06-18 23:10:01,712: INFO/ForkPoolWorker-15] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T23:10:01.713382861Z [2024-06-18 23:10:01,713: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-06-18T23:10:01.718372736Z [2024-06-18 23:10:01,718: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T23:10:01.791137902Z [2024-06-18 23:10:01,786: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-18T23:10:01.845785032Z [2024-06-18 23:10:01,833: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T23:10:01.876064560Z [2024-06-18 23:10:01,875: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:10:02.424980495Z [2024-06-18 23:10:02,424: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:10:02.918026816Z [2024-06-18 23:10:02,917: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c817acf2-0cf3-47d8-a680-8f21ca68d2d3] succeeded in 1.8369266090003293s: None 2024-06-18T23:10:03.214493358Z [2024-06-18 23:10:03,213: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[320652f2-566e-43f3-a582-52b235dcfd5f] succeeded in 2.1190478930002428s: None 2024-06-18T23:10:03.354405088Z [2024-06-18 23:10:03,353: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-18T23:10:03.357819328Z [2024-06-18 23:10:03,357: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:10:03.363194805Z [2024-06-18 23:10:03,362: INFO/ForkPoolWorker-3] Getting VIM list 2024-06-18T23:10:03.368965811Z [2024-06-18 23:10:03,368: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:10:03.398532673Z [2024-06-18 23:10:03,398: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T23:10:03.399379832Z [2024-06-18 23:10:03,399: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-06-18T23:10:03.400133853Z [2024-06-18 23:10:03,399: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:10:03.400163057Z [2024-06-18 23:10:03,400: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:10:03.400399058Z [2024-06-18 23:10:03,400: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:10:03.400431027Z [2024-06-18 23:10:03,400: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-18T23:10:03.400701940Z [2024-06-18 23:10:03,400: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T23:10:03.400727311Z [2024-06-18 23:10:03,400: INFO/ForkPoolWorker-16] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:10:03.400991495Z [2024-06-18 23:10:03,400: INFO/ForkPoolWorker-3] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:10:03.401147583Z [2024-06-18 23:10:03,401: INFO/ForkPoolWorker-3] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:10:03.401348938Z [2024-06-18 23:10:03,401: INFO/ForkPoolWorker-3] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:10:03.401536612Z [2024-06-18 23:10:03,401: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-06-18T23:10:03.401939932Z [2024-06-18 23:10:03,401: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-06-18T23:10:03.402099646Z [2024-06-18 23:10:03,401: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:10:03.497027612Z [2024-06-18 23:10:03,496: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:10:03.516891467Z [2024-06-18 23:10:03,516: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:10:03.653127072Z [2024-06-18 23:10:03,652: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-18T23:10:03.656732633Z [2024-06-18 23:10:03,656: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:10:03.679482532Z [2024-06-18 23:10:03,679: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T23:10:03.681633641Z [2024-06-18 23:10:03,681: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:10:03.681777576Z [2024-06-18 23:10:03,681: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:10:03.682022270Z [2024-06-18 23:10:03,681: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:10:03.682121211Z [2024-06-18 23:10:03,682: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-18T23:10:03.682419784Z [2024-06-18 23:10:03,682: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T23:10:03.682870153Z [2024-06-18 23:10:03,682: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:10:03.774910066Z [2024-06-18 23:10:03,774: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:10:04.458813741Z [2024-06-18 23:10:04,458: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[334206ca-d1bd-42af-9e59-64c7b5f135ff] received 2024-06-18T23:10:04.465566364Z [2024-06-18 23:10:04,465: INFO/ForkPoolWorker-15] [334206ca-d1bd-42af-9e59-64c7b5f135ff] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'split_metrics', 'scheduled__2024-06-18T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-18T23:10:04.524354393Z [2024-06-18 23:10:04,523: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3d5591d0-fd9c-4ff1-b24d-37396eece37f] succeeded in 3.434159696000279s: None 2024-06-18T23:10:04.764510298Z [2024-06-18 23:10:04,761: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T23:10:05.402319558Z [2024-06-18 23:10:05,401: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2546f153-f35c-4dc6-b621-6ba00ca6d1a0] succeeded in 4.3134456979996685s: None 2024-06-18T23:10:05.496834630Z [2024-06-18 23:10:05,496: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[edd8d561-3f10-4d3b-b7e8-b61f1860c62d] succeeded in 4.354032180000104s: None 2024-06-18T23:10:05.981506868Z [2024-06-18 23:10:05,980: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T23:10:05.984796307Z [2024-06-18 23:10:05,984: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:10:06.014068536Z [2024-06-18 23:10:06,013: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T23:10:06.016124608Z [2024-06-18 23:10:06,015: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:10:06.016153753Z [2024-06-18 23:10:06,016: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:10:06.016387575Z [2024-06-18 23:10:06,016: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:10:06.016402569Z [2024-06-18 23:10:06,016: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T23:10:06.016800886Z [2024-06-18 23:10:06,016: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T23:10:06.016817850Z [2024-06-18 23:10:06,016: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:10:06.122997605Z [2024-06-18 23:10:06,122: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:10:06.916288495Z [2024-06-18 23:10:06,915: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5c6409d7-3fac-4692-8492-ec2765286f01] received 2024-06-18T23:10:06.926183129Z [2024-06-18 23:10:06,925: INFO/ForkPoolWorker-16] [5c6409d7-3fac-4692-8492-ec2765286f01] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'collect_metrics', 'scheduled__2024-06-18T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-18T23:10:06.970978579Z [2024-06-18 23:10:06,967: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[334206ca-d1bd-42af-9e59-64c7b5f135ff] succeeded in 2.507091812999988s: None 2024-06-18T23:10:07.268429665Z [2024-06-18 23:10:07,265: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T23:10:08.405424703Z [2024-06-18 23:10:08,404: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-18T23:10:08.408693640Z [2024-06-18 23:10:08,408: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:10:08.432150547Z [2024-06-18 23:10:08,431: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T23:10:08.433730306Z [2024-06-18 23:10:08,433: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:10:08.433891733Z [2024-06-18 23:10:08,433: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:10:08.434124255Z [2024-06-18 23:10:08,433: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:10:08.434276838Z [2024-06-18 23:10:08,434: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-18T23:10:08.434664348Z [2024-06-18 23:10:08,434: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T23:10:08.434820735Z [2024-06-18 23:10:08,434: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:10:08.544944490Z [2024-06-18 23:10:08,544: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:10:09.137978621Z [2024-06-18 23:10:09,137: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b857c48c-b7d0-43f9-af15-f301c92d0121] received 2024-06-18T23:10:09.156132081Z [2024-06-18 23:10:09,155: INFO/ForkPoolWorker-15] [b857c48c-b7d0-43f9-af15-f301c92d0121] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'send_prometheus', 'scheduled__2024-06-18T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-18T23:10:09.234380261Z [2024-06-18 23:10:09,233: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5c6409d7-3fac-4692-8492-ec2765286f01] succeeded in 2.3155695800001013s: None 2024-06-18T23:10:09.470641220Z [2024-06-18 23:10:09,467: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T23:10:10.734474027Z [2024-06-18 23:10:10,734: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T23:10:10.738621728Z [2024-06-18 23:10:10,737: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:10:10.769246820Z [2024-06-18 23:10:10,768: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T23:10:10.771503208Z [2024-06-18 23:10:10,771: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:10:10.771558376Z [2024-06-18 23:10:10,771: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:10:10.772250650Z [2024-06-18 23:10:10,771: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:10:10.772312725Z [2024-06-18 23:10:10,772: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T23:10:10.772780748Z [2024-06-18 23:10:10,772: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T23:10:10.772843594Z [2024-06-18 23:10:10,772: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:10:10.885648403Z [2024-06-18 23:10:10,885: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:10:11.645634442Z [2024-06-18 23:10:11,643: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b857c48c-b7d0-43f9-af15-f301c92d0121] succeeded in 2.4964599830000225s: None 2024-06-18T23:11:01.176883021Z [2024-06-18 23:11:01,176: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eb6fb4d4-4230-4cb6-88b3-74f3ba09d084] received 2024-06-18T23:11:01.178419918Z [2024-06-18 23:11:01,178: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[379f7c97-2a69-487d-8910-1401096551c5] received 2024-06-18T23:11:01.183589638Z [2024-06-18 23:11:01,183: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[77dfa849-bc62-42db-87a3-211f700cefdb] received 2024-06-18T23:11:01.191204396Z [2024-06-18 23:11:01,188: INFO/ForkPoolWorker-16] [379f7c97-2a69-487d-8910-1401096551c5] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T23:11:01.192561439Z [2024-06-18 23:11:01,191: INFO/ForkPoolWorker-15] [eb6fb4d4-4230-4cb6-88b3-74f3ba09d084] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T23:11:01.197926485Z [2024-06-18 23:11:01,197: INFO/ForkPoolWorker-1] [77dfa849-bc62-42db-87a3-211f700cefdb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T23:11:01.582856772Z [2024-06-18 23:11:01,578: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T23:11:01.618611094Z [2024-06-18 23:11:01,614: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T23:11:01.618715232Z [2024-06-18 23:11:01,614: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T23:11:01.832690640Z [2024-06-18 23:11:01,832: INFO/ForkPoolWorker-16] Getting SDNC list 2024-06-18T23:11:01.837057690Z [2024-06-18 23:11:01,836: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:11:01.879370657Z [2024-06-18 23:11:01,879: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T23:11:01.895099870Z [2024-06-18 23:11:01,894: INFO/ForkPoolWorker-16] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T23:11:01.895460553Z [2024-06-18 23:11:01,895: INFO/ForkPoolWorker-16] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T23:11:01.895709467Z [2024-06-18 23:11:01,895: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-06-18T23:11:01.896249143Z [2024-06-18 23:11:01,896: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T23:11:02.123690868Z [2024-06-18 23:11:02,123: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:11:02.870471355Z [2024-06-18 23:11:02,870: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[379f7c97-2a69-487d-8910-1401096551c5] succeeded in 1.689994483999726s: None 2024-06-18T23:11:03.099165287Z [2024-06-18 23:11:03,098: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T23:11:03.102264763Z [2024-06-18 23:11:03,101: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:11:03.126860281Z [2024-06-18 23:11:03,126: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T23:11:03.128429645Z [2024-06-18 23:11:03,128: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:11:03.128461871Z [2024-06-18 23:11:03,128: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:11:03.128668451Z [2024-06-18 23:11:03,128: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:11:03.128737845Z [2024-06-18 23:11:03,128: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T23:11:03.128960803Z [2024-06-18 23:11:03,128: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T23:11:03.128974580Z [2024-06-18 23:11:03,128: INFO/ForkPoolWorker-15] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:11:03.203505361Z [2024-06-18 23:11:03,202: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-18T23:11:03.206599874Z [2024-06-18 23:11:03,206: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:11:03.233727477Z [2024-06-18 23:11:03,233: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T23:11:03.235105705Z [2024-06-18 23:11:03,234: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:11:03.235117700Z [2024-06-18 23:11:03,235: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:11:03.235254188Z [2024-06-18 23:11:03,235: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:11:03.235276392Z [2024-06-18 23:11:03,235: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-18T23:11:03.235492960Z [2024-06-18 23:11:03,235: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-06-18T23:11:03.235498592Z [2024-06-18 23:11:03,235: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:11:03.255943721Z [2024-06-18 23:11:03,255: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:11:03.330075461Z [2024-06-18 23:11:03,329: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:11:05.180060770Z [2024-06-18 23:11:05,179: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[eb6fb4d4-4230-4cb6-88b3-74f3ba09d084] succeeded in 3.99903028000017s: None 2024-06-18T23:11:06.037167709Z [2024-06-18 23:11:06,036: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[77dfa849-bc62-42db-87a3-211f700cefdb] succeeded in 4.850808632999815s: None 2024-06-18T23:12:01.140387675Z [2024-06-18 23:12:01,140: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[45803d18-1659-4466-b24c-47a23660b635] received 2024-06-18T23:12:01.143820040Z [2024-06-18 23:12:01,143: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7b91d0bb-f4eb-487a-bce3-29dc10aa04b8] received 2024-06-18T23:12:01.148569804Z [2024-06-18 23:12:01,148: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ea813b9c-2e1f-489d-9dd6-978e5043bbaa] received 2024-06-18T23:12:01.152663017Z [2024-06-18 23:12:01,152: INFO/ForkPoolWorker-15] [45803d18-1659-4466-b24c-47a23660b635] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T23:12:01.153125184Z [2024-06-18 23:12:01,152: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0a2de19f-824a-4a92-8ca9-11e9ae210c9a] received 2024-06-18T23:12:01.161558972Z [2024-06-18 23:12:01,161: INFO/ForkPoolWorker-16] [7b91d0bb-f4eb-487a-bce3-29dc10aa04b8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T23:12:01.163565249Z [2024-06-18 23:12:01,163: INFO/ForkPoolWorker-1] [ea813b9c-2e1f-489d-9dd6-978e5043bbaa] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-18T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-18T23:12:01.175390996Z [2024-06-18 23:12:01,174: INFO/ForkPoolWorker-2] [0a2de19f-824a-4a92-8ca9-11e9ae210c9a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T23:12:01.520993150Z [2024-06-18 23:12:01,515: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T23:12:01.549762461Z [2024-06-18 23:12:01,545: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T23:12:01.735634758Z [2024-06-18 23:12:01,732: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-18T23:12:01.753150538Z [2024-06-18 23:12:01,752: INFO/ForkPoolWorker-2] Getting SDNC list 2024-06-18T23:12:01.757650997Z [2024-06-18 23:12:01,757: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:12:01.790761380Z [2024-06-18 23:12:01,790: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-18T23:12:01.791797249Z [2024-06-18 23:12:01,791: INFO/ForkPoolWorker-2] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T23:12:01.791814413Z [2024-06-18 23:12:01,791: INFO/ForkPoolWorker-2] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T23:12:01.791864089Z [2024-06-18 23:12:01,791: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-06-18T23:12:01.792036992Z [2024-06-18 23:12:01,791: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T23:12:01.803283773Z [2024-06-18 23:12:01,799: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T23:12:01.932349760Z [2024-06-18 23:12:01,932: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:12:02.063562023Z [2024-06-18 23:12:02,063: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:12:02.604123919Z [2024-06-18 23:12:02,603: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[0a2de19f-824a-4a92-8ca9-11e9ae210c9a] succeeded in 1.4456665980001162s: None 2024-06-18T23:12:02.801833116Z [2024-06-18 23:12:02,801: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ea813b9c-2e1f-489d-9dd6-978e5043bbaa] succeeded in 1.6488412690000587s: None 2024-06-18T23:12:03.184995733Z [2024-06-18 23:12:03,184: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-18T23:12:03.194285807Z [2024-06-18 23:12:03,193: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:12:03.221789933Z [2024-06-18 23:12:03,221: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T23:12:03.223437080Z [2024-06-18 23:12:03,223: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:12:03.223566913Z [2024-06-18 23:12:03,223: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:12:03.223829836Z [2024-06-18 23:12:03,223: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:12:03.223929241Z [2024-06-18 23:12:03,223: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-18T23:12:03.224391281Z [2024-06-18 23:12:03,224: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-18T23:12:03.224509689Z [2024-06-18 23:12:03,224: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:12:03.310272769Z [2024-06-18 23:12:03,310: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:12:03.326315271Z [2024-06-18 23:12:03,325: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T23:12:03.331102857Z [2024-06-18 23:12:03,330: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:12:03.368167405Z [2024-06-18 23:12:03,367: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T23:12:03.369681997Z [2024-06-18 23:12:03,369: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:12:03.369707378Z [2024-06-18 23:12:03,369: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:12:03.371359113Z [2024-06-18 23:12:03,369: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:12:03.371525217Z [2024-06-18 23:12:03,371: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T23:12:03.371928348Z [2024-06-18 23:12:03,371: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T23:12:03.372047465Z [2024-06-18 23:12:03,371: INFO/ForkPoolWorker-15] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:12:03.458923758Z [2024-06-18 23:12:03,458: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:12:05.051050743Z [2024-06-18 23:12:05,050: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[45803d18-1659-4466-b24c-47a23660b635] succeeded in 3.905107802999737s: None 2024-06-18T23:12:05.289566761Z [2024-06-18 23:12:05,289: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7b91d0bb-f4eb-487a-bce3-29dc10aa04b8] succeeded in 4.143966373000239s: None 2024-06-18T23:13:00.250987771Z [2024-06-18 23:13:00,250: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2624b46b-cb98-4b0e-9f06-8893cca413d2] received 2024-06-18T23:13:00.253219176Z [2024-06-18 23:13:00,253: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[06bf127a-98ee-436c-8d80-bd9034600c5b] received 2024-06-18T23:13:00.254657242Z [2024-06-18 23:13:00,254: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8587571b-36b8-4033-8160-847b9d2527c8] received 2024-06-18T23:13:00.267979001Z [2024-06-18 23:13:00,266: INFO/ForkPoolWorker-15] [2624b46b-cb98-4b0e-9f06-8893cca413d2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T23:13:00.272558603Z [2024-06-18 23:13:00,272: INFO/ForkPoolWorker-1] [8587571b-36b8-4033-8160-847b9d2527c8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T23:13:00.284205598Z [2024-06-18 23:13:00,283: INFO/ForkPoolWorker-16] [06bf127a-98ee-436c-8d80-bd9034600c5b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T23:13:00.627484844Z [2024-06-18 23:13:00,623: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T23:13:00.636097990Z [2024-06-18 23:13:00,631: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T23:13:00.703179506Z [2024-06-18 23:13:00,698: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T23:13:00.947326532Z [2024-06-18 23:13:00,946: INFO/ForkPoolWorker-16] Getting SDNC list 2024-06-18T23:13:00.951643739Z [2024-06-18 23:13:00,951: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:13:01.003842740Z [2024-06-18 23:13:00,999: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T23:13:01.005511372Z [2024-06-18 23:13:01,005: INFO/ForkPoolWorker-16] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T23:13:01.005698903Z [2024-06-18 23:13:01,005: INFO/ForkPoolWorker-16] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T23:13:01.005841413Z [2024-06-18 23:13:01,005: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-06-18T23:13:01.006166843Z [2024-06-18 23:13:01,005: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T23:13:01.154730779Z [2024-06-18 23:13:01,154: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:13:01.884141226Z [2024-06-18 23:13:01,883: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[06bf127a-98ee-436c-8d80-bd9034600c5b] succeeded in 1.6275189769999088s: None 2024-06-18T23:13:02.070007765Z [2024-06-18 23:13:02,069: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T23:13:02.073452788Z [2024-06-18 23:13:02,072: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:13:02.088091609Z [2024-06-18 23:13:02,087: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-18T23:13:02.091590731Z [2024-06-18 23:13:02,091: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:13:02.096016377Z [2024-06-18 23:13:02,095: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T23:13:02.097390327Z [2024-06-18 23:13:02,097: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:13:02.097415362Z [2024-06-18 23:13:02,097: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:13:02.097613792Z [2024-06-18 23:13:02,097: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:13:02.097670428Z [2024-06-18 23:13:02,097: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T23:13:02.098039685Z [2024-06-18 23:13:02,097: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-06-18T23:13:02.098181706Z [2024-06-18 23:13:02,097: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:13:02.118368119Z [2024-06-18 23:13:02,118: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T23:13:02.120204811Z [2024-06-18 23:13:02,119: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:13:02.120311822Z [2024-06-18 23:13:02,120: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:13:02.120539110Z [2024-06-18 23:13:02,120: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:13:02.120666251Z [2024-06-18 23:13:02,120: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-18T23:13:02.121047754Z [2024-06-18 23:13:02,120: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T23:13:02.121175938Z [2024-06-18 23:13:02,121: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:13:02.181068873Z [2024-06-18 23:13:02,180: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:13:02.288015671Z [2024-06-18 23:13:02,287: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:13:05.598600076Z [2024-06-18 23:13:05,598: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8587571b-36b8-4033-8160-847b9d2527c8] succeeded in 5.339305471999978s: None 2024-06-18T23:13:06.347222437Z [2024-06-18 23:13:06,346: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2624b46b-cb98-4b0e-9f06-8893cca413d2] succeeded in 6.0915017699999225s: None 2024-06-18T23:14:00.267387492Z [2024-06-18 23:14:00,266: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[08eee091-9bd5-4f40-98c4-711a4b8559f2] received 2024-06-18T23:14:00.271584140Z [2024-06-18 23:14:00,271: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fc2cfc40-7b22-4390-baec-b53ff3da85cc] received 2024-06-18T23:14:00.276787117Z [2024-06-18 23:14:00,276: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fc2ac8ea-15df-40f6-8e9e-3df514e4ac10] received 2024-06-18T23:14:00.280061844Z [2024-06-18 23:14:00,279: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0c913eee-3fe8-40d2-b6a7-142d6d71d89a] received 2024-06-18T23:14:00.295192124Z [2024-06-18 23:14:00,294: INFO/ForkPoolWorker-15] [08eee091-9bd5-4f40-98c4-711a4b8559f2] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-18T23:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-18T23:14:00.296057767Z [2024-06-18 23:14:00,295: INFO/ForkPoolWorker-16] [fc2cfc40-7b22-4390-baec-b53ff3da85cc] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T23:14:00.303275067Z [2024-06-18 23:14:00,302: INFO/ForkPoolWorker-2] [0c913eee-3fe8-40d2-b6a7-142d6d71d89a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T23:14:00.305414593Z [2024-06-18 23:14:00,304: INFO/ForkPoolWorker-1] [fc2ac8ea-15df-40f6-8e9e-3df514e4ac10] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T23:14:00.592533346Z [2024-06-18 23:14:00,588: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-18T23:14:00.652095329Z [2024-06-18 23:14:00,641: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T23:14:00.704655968Z [2024-06-18 23:14:00,700: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T23:14:00.792081399Z [2024-06-18 23:14:00,786: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T23:14:00.846933266Z [2024-06-18 23:14:00,846: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:14:00.891343822Z [2024-06-18 23:14:00,890: INFO/ForkPoolWorker-16] Getting SDNC list 2024-06-18T23:14:00.895900047Z [2024-06-18 23:14:00,895: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:14:00.933565959Z [2024-06-18 23:14:00,933: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T23:14:00.936922189Z [2024-06-18 23:14:00,936: INFO/ForkPoolWorker-16] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T23:14:00.937262454Z [2024-06-18 23:14:00,937: INFO/ForkPoolWorker-16] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T23:14:00.937300499Z [2024-06-18 23:14:00,937: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-06-18T23:14:00.937559858Z [2024-06-18 23:14:00,937: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T23:14:01.045840326Z [2024-06-18 23:14:01,045: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:14:01.564293672Z [2024-06-18 23:14:01,563: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[08eee091-9bd5-4f40-98c4-711a4b8559f2] succeeded in 1.2942885900001784s: None 2024-06-18T23:14:01.667230613Z [2024-06-18 23:14:01,666: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[fc2cfc40-7b22-4390-baec-b53ff3da85cc] succeeded in 1.3931136480000532s: None 2024-06-18T23:14:02.194905195Z [2024-06-18 23:14:02,194: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-18T23:14:02.199810174Z [2024-06-18 23:14:02,197: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-18T23:14:02.199848484Z [2024-06-18 23:14:02,198: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:14:02.203811140Z [2024-06-18 23:14:02,201: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:14:02.244264056Z [2024-06-18 23:14:02,239: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T23:14:02.244278140Z [2024-06-18 23:14:02,241: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:14:02.244281445Z [2024-06-18 23:14:02,241: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:14:02.244285800Z [2024-06-18 23:14:02,241: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:14:02.244289958Z [2024-06-18 23:14:02,242: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-18T23:14:02.244292941Z [2024-06-18 23:14:02,242: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T23:14:02.244296074Z [2024-06-18 23:14:02,242: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:14:02.256088378Z [2024-06-18 23:14:02,255: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-18T23:14:02.257668947Z [2024-06-18 23:14:02,257: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:14:02.257710419Z [2024-06-18 23:14:02,257: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:14:02.257817107Z [2024-06-18 23:14:02,257: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:14:02.257857674Z [2024-06-18 23:14:02,257: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-18T23:14:02.258076311Z [2024-06-18 23:14:02,257: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-06-18T23:14:02.258178885Z [2024-06-18 23:14:02,258: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:14:02.348713467Z [2024-06-18 23:14:02,348: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:14:02.379849510Z [2024-06-18 23:14:02,379: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:14:05.435125933Z [2024-06-18 23:14:05,434: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[fc2ac8ea-15df-40f6-8e9e-3df514e4ac10] succeeded in 5.153458697000133s: None 2024-06-18T23:14:05.795068627Z [2024-06-18 23:14:05,794: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[0c913eee-3fe8-40d2-b6a7-142d6d71d89a] succeeded in 5.5101062779999666s: None 2024-06-18T23:15:00.488900128Z [2024-06-18 23:15:00,488: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4ac8f835-d233-4d52-8bbd-cbf262dbbad0] received 2024-06-18T23:15:00.492457440Z [2024-06-18 23:15:00,492: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[31a9a736-1abb-47a4-b748-8c6a46ea8bf4] received 2024-06-18T23:15:00.493920854Z [2024-06-18 23:15:00,493: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7deba7f9-a54b-40a5-8364-225e326e7968] received 2024-06-18T23:15:00.502965676Z [2024-06-18 23:15:00,502: INFO/ForkPoolWorker-1] [7deba7f9-a54b-40a5-8364-225e326e7968] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-18T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-18T23:15:00.506306023Z [2024-06-18 23:15:00,505: INFO/ForkPoolWorker-15] [4ac8f835-d233-4d52-8bbd-cbf262dbbad0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T23:15:00.509426543Z [2024-06-18 23:15:00,509: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[27d42da0-da25-495c-a900-58f930f9806a] received 2024-06-18T23:15:00.520573852Z [2024-06-18 23:15:00,520: INFO/ForkPoolWorker-2] [27d42da0-da25-495c-a900-58f930f9806a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T23:15:00.524619786Z [2024-06-18 23:15:00,524: INFO/ForkPoolWorker-16] [31a9a736-1abb-47a4-b748-8c6a46ea8bf4] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T23:15:00.875180604Z [2024-06-18 23:15:00,871: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T23:15:00.898093047Z [2024-06-18 23:15:00,893: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T23:15:01.076248014Z [2024-06-18 23:15:01,071: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T23:15:01.094358049Z [2024-06-18 23:15:01,085: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T23:15:01.278308833Z [2024-06-18 23:15:01,277: INFO/ForkPoolWorker-16] Getting SDNC list 2024-06-18T23:15:01.283587966Z [2024-06-18 23:15:01,283: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:15:01.310498569Z [2024-06-18 23:15:01,310: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T23:15:01.311569168Z [2024-06-18 23:15:01,311: INFO/ForkPoolWorker-16] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T23:15:01.311724388Z [2024-06-18 23:15:01,311: INFO/ForkPoolWorker-16] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T23:15:01.311869463Z [2024-06-18 23:15:01,311: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-06-18T23:15:01.312126230Z [2024-06-18 23:15:01,311: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T23:15:01.408773586Z [2024-06-18 23:15:01,408: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:15:02.115680949Z [2024-06-18 23:15:02,115: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[31a9a736-1abb-47a4-b748-8c6a46ea8bf4] succeeded in 1.6183848149998994s: None 2024-06-18T23:15:02.271839797Z [2024-06-18 23:15:02,262: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-18T23:15:02.271872436Z [2024-06-18 23:15:02,266: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:15:02.318749911Z [2024-06-18 23:15:02,318: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T23:15:02.322371376Z [2024-06-18 23:15:02,321: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:15:02.340062348Z [2024-06-18 23:15:02,339: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T23:15:02.342066881Z [2024-06-18 23:15:02,341: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:15:02.342078007Z [2024-06-18 23:15:02,341: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:15:02.342623382Z [2024-06-18 23:15:02,342: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:15:02.342784471Z [2024-06-18 23:15:02,342: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-18T23:15:02.343217354Z [2024-06-18 23:15:02,342: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T23:15:02.343340789Z [2024-06-18 23:15:02,343: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:15:02.352834671Z [2024-06-18 23:15:02,352: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T23:15:02.354387240Z [2024-06-18 23:15:02,354: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:15:02.354461763Z [2024-06-18 23:15:02,354: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:15:02.354610123Z [2024-06-18 23:15:02,354: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:15:02.354708349Z [2024-06-18 23:15:02,354: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T23:15:02.355034883Z [2024-06-18 23:15:02,354: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-06-18T23:15:02.355454663Z [2024-06-18 23:15:02,355: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:15:02.468568823Z [2024-06-18 23:15:02,468: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:15:02.485858029Z [2024-06-18 23:15:02,485: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:15:02.546801167Z [2024-06-18 23:15:02,546: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-18T23:15:02.550128743Z [2024-06-18 23:15:02,549: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:15:02.575782158Z [2024-06-18 23:15:02,575: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-18T23:15:02.578700595Z [2024-06-18 23:15:02,578: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:15:02.578725680Z [2024-06-18 23:15:02,578: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:15:02.579030237Z [2024-06-18 23:15:02,578: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:15:02.579089253Z [2024-06-18 23:15:02,578: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-18T23:15:02.579433721Z [2024-06-18 23:15:02,579: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T23:15:02.579458544Z [2024-06-18 23:15:02,579: INFO/ForkPoolWorker-2] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:15:02.669742496Z [2024-06-18 23:15:02,669: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:15:03.141076797Z [2024-06-18 23:15:03,140: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7deba7f9-a54b-40a5-8364-225e326e7968] succeeded in 2.645384995999848s: None 2024-06-18T23:15:03.243159831Z [2024-06-18 23:15:03,242: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[72501a03-7f4e-4350-b7ac-7fc58e70eb0a] received 2024-06-18T23:15:03.252626829Z [2024-06-18 23:15:03,252: INFO/ForkPoolWorker-16] [72501a03-7f4e-4350-b7ac-7fc58e70eb0a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'split_metrics', 'scheduled__2024-06-18T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-18T23:15:03.601721893Z [2024-06-18 23:15:03,598: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T23:15:04.268396477Z [2024-06-18 23:15:04,267: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[27d42da0-da25-495c-a900-58f930f9806a] succeeded in 3.757033228000182s: None 2024-06-18T23:15:04.400738506Z [2024-06-18 23:15:04,400: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4ac8f835-d233-4d52-8bbd-cbf262dbbad0] succeeded in 3.9048817479997524s: None 2024-06-18T23:15:04.849291878Z [2024-06-18 23:15:04,848: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-18T23:15:04.852520361Z [2024-06-18 23:15:04,851: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:15:04.877402177Z [2024-06-18 23:15:04,877: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T23:15:04.879505897Z [2024-06-18 23:15:04,879: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:15:04.879577690Z [2024-06-18 23:15:04,879: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:15:04.879819658Z [2024-06-18 23:15:04,879: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:15:04.879943934Z [2024-06-18 23:15:04,879: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-18T23:15:04.880759406Z [2024-06-18 23:15:04,880: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T23:15:04.880902937Z [2024-06-18 23:15:04,880: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:15:04.991266504Z [2024-06-18 23:15:04,990: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:15:05.746655825Z [2024-06-18 23:15:05,745: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[72501a03-7f4e-4350-b7ac-7fc58e70eb0a] succeeded in 2.5002382950001447s: None 2024-06-18T23:15:06.773602035Z [2024-06-18 23:15:06,773: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b789b616-79b7-4bdf-aa72-a7fa439b0ee1] received 2024-06-18T23:15:06.783480838Z [2024-06-18 23:15:06,783: INFO/ForkPoolWorker-15] [b789b616-79b7-4bdf-aa72-a7fa439b0ee1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'collect_metrics', 'scheduled__2024-06-18T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-18T23:15:07.098622007Z [2024-06-18 23:15:07,095: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T23:15:08.212430501Z [2024-06-18 23:15:08,211: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T23:15:08.215853659Z [2024-06-18 23:15:08,215: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:15:08.250727487Z [2024-06-18 23:15:08,250: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T23:15:08.252627668Z [2024-06-18 23:15:08,252: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:15:08.252849448Z [2024-06-18 23:15:08,252: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:15:08.252888384Z [2024-06-18 23:15:08,252: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:15:08.252899972Z [2024-06-18 23:15:08,252: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T23:15:08.253150921Z [2024-06-18 23:15:08,252: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T23:15:08.253168382Z [2024-06-18 23:15:08,253: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:15:08.361110631Z [2024-06-18 23:15:08,360: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:15:11.029470624Z [2024-06-18 23:15:11,028: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b789b616-79b7-4bdf-aa72-a7fa439b0ee1] succeeded in 4.2537310469997465s: None 2024-06-18T23:15:11.483676369Z [2024-06-18 23:15:11,483: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[292c0cfa-c5e1-4202-866f-4ab7344a1273] received 2024-06-18T23:15:11.498339299Z [2024-06-18 23:15:11,497: INFO/ForkPoolWorker-15] [292c0cfa-c5e1-4202-866f-4ab7344a1273] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'send_prometheus', 'scheduled__2024-06-18T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-18T23:15:11.774913234Z [2024-06-18 23:15:11,771: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T23:15:13.032482924Z [2024-06-18 23:15:13,032: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T23:15:13.036027165Z [2024-06-18 23:15:13,035: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:15:13.055544917Z [2024-06-18 23:15:13,055: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T23:15:13.056823863Z [2024-06-18 23:15:13,056: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:15:13.056884492Z [2024-06-18 23:15:13,056: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:15:13.057075138Z [2024-06-18 23:15:13,056: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:15:13.057117868Z [2024-06-18 23:15:13,057: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T23:15:13.057436786Z [2024-06-18 23:15:13,057: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T23:15:13.057534419Z [2024-06-18 23:15:13,057: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:15:13.179891685Z [2024-06-18 23:15:13,179: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:15:13.880878159Z [2024-06-18 23:15:13,880: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[292c0cfa-c5e1-4202-866f-4ab7344a1273] succeeded in 2.393666360000225s: None 2024-06-18T23:16:00.668508774Z [2024-06-18 23:16:00,667: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0ca439a6-2706-4e47-bf61-04aab8ccd5fb] received 2024-06-18T23:16:00.671382855Z [2024-06-18 23:16:00,671: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[36987a63-cdb5-41aa-836f-27c65f7332d5] received 2024-06-18T23:16:00.684706663Z [2024-06-18 23:16:00,684: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d8744fba-5d5d-49e5-9d5d-fd9559591de3] received 2024-06-18T23:16:00.685259842Z [2024-06-18 23:16:00,684: INFO/ForkPoolWorker-15] [0ca439a6-2706-4e47-bf61-04aab8ccd5fb] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-18T23:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-18T23:16:00.688260274Z [2024-06-18 23:16:00,687: INFO/ForkPoolWorker-16] [36987a63-cdb5-41aa-836f-27c65f7332d5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T23:16:00.697955138Z [2024-06-18 23:16:00,697: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[201c44b0-58fb-4226-be9b-bf06fc92fe08] received 2024-06-18T23:16:00.708416747Z [2024-06-18 23:16:00,707: INFO/ForkPoolWorker-1] [d8744fba-5d5d-49e5-9d5d-fd9559591de3] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T23:16:00.719242951Z [2024-06-18 23:16:00,718: INFO/ForkPoolWorker-2] [201c44b0-58fb-4226-be9b-bf06fc92fe08] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T23:16:01.079797906Z [2024-06-18 23:16:01,076: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T23:16:01.106889054Z [2024-06-18 23:16:01,101: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-18T23:16:01.158003103Z [2024-06-18 23:16:01,153: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T23:16:01.187405394Z [2024-06-18 23:16:01,183: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T23:16:01.342355549Z [2024-06-18 23:16:01,341: INFO/ForkPoolWorker-1] Getting SDNC list 2024-06-18T23:16:01.347074921Z [2024-06-18 23:16:01,346: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:16:01.382693855Z [2024-06-18 23:16:01,382: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T23:16:01.384166032Z [2024-06-18 23:16:01,383: INFO/ForkPoolWorker-1] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T23:16:01.384404969Z [2024-06-18 23:16:01,384: INFO/ForkPoolWorker-1] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T23:16:01.384536954Z [2024-06-18 23:16:01,384: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-06-18T23:16:01.384972919Z [2024-06-18 23:16:01,384: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T23:16:01.424227083Z [2024-06-18 23:16:01,423: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:16:01.546670508Z [2024-06-18 23:16:01,546: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:16:02.329796910Z [2024-06-18 23:16:02,329: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0ca439a6-2706-4e47-bf61-04aab8ccd5fb] succeeded in 1.6561190200000055s: None 2024-06-18T23:16:02.515922562Z [2024-06-18 23:16:02,515: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d8744fba-5d5d-49e5-9d5d-fd9559591de3] succeeded in 1.8263552280000113s: None 2024-06-18T23:16:02.600112966Z [2024-06-18 23:16:02,599: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-18T23:16:02.603439142Z [2024-06-18 23:16:02,602: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:16:02.625937808Z [2024-06-18 23:16:02,625: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-18T23:16:02.627325729Z [2024-06-18 23:16:02,627: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:16:02.627347417Z [2024-06-18 23:16:02,627: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:16:02.627460497Z [2024-06-18 23:16:02,627: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:16:02.627557846Z [2024-06-18 23:16:02,627: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-18T23:16:02.627840118Z [2024-06-18 23:16:02,627: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-06-18T23:16:02.627856244Z [2024-06-18 23:16:02,627: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:16:02.728833183Z [2024-06-18 23:16:02,728: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:16:02.813565583Z [2024-06-18 23:16:02,812: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-18T23:16:02.818388746Z [2024-06-18 23:16:02,817: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:16:02.849053597Z [2024-06-18 23:16:02,848: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T23:16:02.851112980Z [2024-06-18 23:16:02,850: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:16:02.851172662Z [2024-06-18 23:16:02,850: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:16:02.851472315Z [2024-06-18 23:16:02,851: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:16:02.851505145Z [2024-06-18 23:16:02,851: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-18T23:16:02.852348045Z [2024-06-18 23:16:02,852: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T23:16:02.852415680Z [2024-06-18 23:16:02,852: INFO/ForkPoolWorker-16] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:16:02.946339870Z [2024-06-18 23:16:02,945: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:16:04.768518728Z [2024-06-18 23:16:04,768: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[36987a63-cdb5-41aa-836f-27c65f7332d5] succeeded in 4.09504373000027s: None 2024-06-18T23:16:05.142902976Z [2024-06-18 23:16:05,142: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[201c44b0-58fb-4226-be9b-bf06fc92fe08] succeeded in 4.437113724000028s: None 2024-06-18T23:17:00.480825988Z [2024-06-18 23:17:00,480: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5f4390d0-b58b-4f1d-8b42-2018b768421e] received 2024-06-18T23:17:00.488438594Z [2024-06-18 23:17:00,488: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8a9eb31d-a77c-4d6e-b5e8-4946a0154403] received 2024-06-18T23:17:00.495631031Z [2024-06-18 23:17:00,495: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[771193bd-1045-4e9a-91d0-d3d0328223d8] received 2024-06-18T23:17:00.512960787Z [2024-06-18 23:17:00,512: INFO/ForkPoolWorker-15] [5f4390d0-b58b-4f1d-8b42-2018b768421e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T23:17:00.513172123Z [2024-06-18 23:17:00,512: INFO/ForkPoolWorker-1] [771193bd-1045-4e9a-91d0-d3d0328223d8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T23:17:00.516527167Z [2024-06-18 23:17:00,516: INFO/ForkPoolWorker-16] [8a9eb31d-a77c-4d6e-b5e8-4946a0154403] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T23:17:00.844327194Z [2024-06-18 23:17:00,839: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T23:17:00.868327217Z [2024-06-18 23:17:00,864: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T23:17:00.904819593Z [2024-06-18 23:17:00,900: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T23:17:01.017662008Z [2024-06-18 23:17:01,017: INFO/ForkPoolWorker-16] Getting SDNC list 2024-06-18T23:17:01.021796946Z [2024-06-18 23:17:01,021: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:17:01.052876653Z [2024-06-18 23:17:01,052: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T23:17:01.056779591Z [2024-06-18 23:17:01,056: INFO/ForkPoolWorker-16] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T23:17:01.056863866Z [2024-06-18 23:17:01,056: INFO/ForkPoolWorker-16] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T23:17:01.056889192Z [2024-06-18 23:17:01,056: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-06-18T23:17:01.057257970Z [2024-06-18 23:17:01,057: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T23:17:01.150664189Z [2024-06-18 23:17:01,150: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:17:01.880690701Z [2024-06-18 23:17:01,880: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8a9eb31d-a77c-4d6e-b5e8-4946a0154403] succeeded in 1.3822305489998143s: None 2024-06-18T23:17:02.221634294Z [2024-06-18 23:17:02,221: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-18T23:17:02.225166141Z [2024-06-18 23:17:02,224: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:17:02.295390243Z [2024-06-18 23:17:02,294: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T23:17:02.299196060Z [2024-06-18 23:17:02,298: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:17:02.317137006Z [2024-06-18 23:17:02,316: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T23:17:02.343514935Z [2024-06-18 23:17:02,343: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:17:02.343737145Z [2024-06-18 23:17:02,343: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:17:02.343969751Z [2024-06-18 23:17:02,343: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:17:02.344130291Z [2024-06-18 23:17:02,343: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-18T23:17:02.344703934Z [2024-06-18 23:17:02,344: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T23:17:02.344871863Z [2024-06-18 23:17:02,344: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:17:02.348261280Z [2024-06-18 23:17:02,348: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T23:17:02.360474815Z [2024-06-18 23:17:02,360: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:17:02.360510592Z [2024-06-18 23:17:02,360: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:17:02.360697384Z [2024-06-18 23:17:02,360: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:17:02.360764670Z [2024-06-18 23:17:02,360: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T23:17:02.361226073Z [2024-06-18 23:17:02,360: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-06-18T23:17:02.361318668Z [2024-06-18 23:17:02,361: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:17:02.452601841Z [2024-06-18 23:17:02,452: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:17:02.455743290Z [2024-06-18 23:17:02,455: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:17:05.436949015Z [2024-06-18 23:17:05,436: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5f4390d0-b58b-4f1d-8b42-2018b768421e] succeeded in 4.953656850999778s: None 2024-06-18T23:17:05.980564433Z [2024-06-18 23:17:05,979: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[771193bd-1045-4e9a-91d0-d3d0328223d8] succeeded in 5.475885565999761s: None 2024-06-18T23:18:00.759641226Z [2024-06-18 23:18:00,758: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0dc974b5-6917-40ca-9503-33a2e3f1c2ed] received 2024-06-18T23:18:00.765522740Z [2024-06-18 23:18:00,765: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[896efd3d-077a-4ce5-939f-de9ef5ace562] received 2024-06-18T23:18:00.768772277Z [2024-06-18 23:18:00,768: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[468c3eee-c256-4d74-8ad2-b4c640f54ba7] received 2024-06-18T23:18:00.786673403Z [2024-06-18 23:18:00,786: INFO/ForkPoolWorker-15] [0dc974b5-6917-40ca-9503-33a2e3f1c2ed] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-18T23:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-18T23:18:00.789544754Z [2024-06-18 23:18:00,789: INFO/ForkPoolWorker-16] [896efd3d-077a-4ce5-939f-de9ef5ace562] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T23:18:00.790018192Z [2024-06-18 23:18:00,789: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8b359a1a-69cd-46e8-bd87-243ad70a526e] received 2024-06-18T23:18:00.791734769Z [2024-06-18 23:18:00,791: INFO/ForkPoolWorker-1] [468c3eee-c256-4d74-8ad2-b4c640f54ba7] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T23:18:00.802327586Z [2024-06-18 23:18:00,801: INFO/ForkPoolWorker-2] [8b359a1a-69cd-46e8-bd87-243ad70a526e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T23:18:01.098599904Z [2024-06-18 23:18:01,094: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T23:18:01.114718386Z [2024-06-18 23:18:01,111: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-18T23:18:01.122674330Z [2024-06-18 23:18:01,118: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T23:18:01.158846170Z [2024-06-18 23:18:01,154: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T23:18:01.280791103Z [2024-06-18 23:18:01,280: INFO/ForkPoolWorker-1] Getting SDNC list 2024-06-18T23:18:01.285886270Z [2024-06-18 23:18:01,285: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:18:01.326794585Z [2024-06-18 23:18:01,326: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T23:18:01.332756117Z [2024-06-18 23:18:01,332: INFO/ForkPoolWorker-1] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T23:18:01.332810258Z [2024-06-18 23:18:01,332: INFO/ForkPoolWorker-1] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T23:18:01.332890837Z [2024-06-18 23:18:01,332: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-06-18T23:18:01.333161495Z [2024-06-18 23:18:01,333: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T23:18:01.429158157Z [2024-06-18 23:18:01,428: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:18:01.475280530Z [2024-06-18 23:18:01,475: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:18:02.174514713Z [2024-06-18 23:18:02,174: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[468c3eee-c256-4d74-8ad2-b4c640f54ba7] succeeded in 1.3989231020000261s: None 2024-06-18T23:18:02.240473532Z [2024-06-18 23:18:02,239: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0dc974b5-6917-40ca-9503-33a2e3f1c2ed] succeeded in 1.4770455070001844s: None 2024-06-18T23:18:02.584393394Z [2024-06-18 23:18:02,583: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-18T23:18:02.587734255Z [2024-06-18 23:18:02,587: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:18:02.612179616Z [2024-06-18 23:18:02,611: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-18T23:18:02.613790767Z [2024-06-18 23:18:02,613: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:18:02.613989697Z [2024-06-18 23:18:02,613: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:18:02.614215504Z [2024-06-18 23:18:02,613: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:18:02.614362136Z [2024-06-18 23:18:02,614: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-18T23:18:02.614838947Z [2024-06-18 23:18:02,614: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-06-18T23:18:02.615025644Z [2024-06-18 23:18:02,614: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:18:02.720376797Z [2024-06-18 23:18:02,719: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:18:02.802618273Z [2024-06-18 23:18:02,802: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-18T23:18:02.805835723Z [2024-06-18 23:18:02,805: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:18:02.842994754Z [2024-06-18 23:18:02,842: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T23:18:02.847414948Z [2024-06-18 23:18:02,846: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:18:02.847522033Z [2024-06-18 23:18:02,847: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:18:02.847967353Z [2024-06-18 23:18:02,847: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:18:02.848135655Z [2024-06-18 23:18:02,847: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-18T23:18:02.848666042Z [2024-06-18 23:18:02,848: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T23:18:02.848837738Z [2024-06-18 23:18:02,848: INFO/ForkPoolWorker-16] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:18:02.971289784Z [2024-06-18 23:18:02,970: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:18:04.744819156Z [2024-06-18 23:18:04,744: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[896efd3d-077a-4ce5-939f-de9ef5ace562] succeeded in 3.9766129419999743s: None 2024-06-18T23:18:06.562102245Z [2024-06-18 23:18:06,561: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[8b359a1a-69cd-46e8-bd87-243ad70a526e] succeeded in 5.7693145659995935s: None 2024-06-18T23:19:01.146135775Z [2024-06-18 23:19:01,145: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9db8146e-c800-4c0c-93eb-a905a448962a] received 2024-06-18T23:19:01.153081105Z [2024-06-18 23:19:01,152: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fad2d059-dcd9-4576-bef7-445f92c2e84e] received 2024-06-18T23:19:01.156457788Z [2024-06-18 23:19:01,156: INFO/ForkPoolWorker-15] [9db8146e-c800-4c0c-93eb-a905a448962a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T23:19:01.158631112Z [2024-06-18 23:19:01,158: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[20e7cfef-2972-4013-b4e7-3f5a8ca5e3b7] received 2024-06-18T23:19:01.167927238Z [2024-06-18 23:19:01,167: INFO/ForkPoolWorker-1] [20e7cfef-2972-4013-b4e7-3f5a8ca5e3b7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T23:19:01.169775280Z [2024-06-18 23:19:01,169: INFO/ForkPoolWorker-16] [fad2d059-dcd9-4576-bef7-445f92c2e84e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T23:19:01.443020006Z [2024-06-18 23:19:01,439: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T23:19:01.476453136Z [2024-06-18 23:19:01,472: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T23:19:01.504192038Z [2024-06-18 23:19:01,499: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T23:19:01.626767147Z [2024-06-18 23:19:01,626: INFO/ForkPoolWorker-15] Getting SDNC list 2024-06-18T23:19:01.630924812Z [2024-06-18 23:19:01,630: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:19:01.693153932Z [2024-06-18 23:19:01,692: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T23:19:01.696827719Z [2024-06-18 23:19:01,696: INFO/ForkPoolWorker-15] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T23:19:01.697328560Z [2024-06-18 23:19:01,696: INFO/ForkPoolWorker-15] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T23:19:01.697582843Z [2024-06-18 23:19:01,697: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-06-18T23:19:01.698278329Z [2024-06-18 23:19:01,697: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T23:19:01.792372721Z [2024-06-18 23:19:01,792: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:19:02.416680489Z [2024-06-18 23:19:02,416: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9db8146e-c800-4c0c-93eb-a905a448962a] succeeded in 1.2676606509999147s: None 2024-06-18T23:19:02.754146415Z [2024-06-18 23:19:02,753: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-18T23:19:02.757549564Z [2024-06-18 23:19:02,757: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:19:02.787472028Z [2024-06-18 23:19:02,787: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T23:19:02.791948481Z [2024-06-18 23:19:02,791: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:19:02.791976180Z [2024-06-18 23:19:02,791: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:19:02.792747662Z [2024-06-18 23:19:02,791: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:19:02.792756713Z [2024-06-18 23:19:02,792: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-18T23:19:02.792761844Z [2024-06-18 23:19:02,792: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T23:19:02.792893193Z [2024-06-18 23:19:02,792: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:19:02.832798860Z [2024-06-18 23:19:02,832: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-18T23:19:02.835991188Z [2024-06-18 23:19:02,835: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:19:02.862320125Z [2024-06-18 23:19:02,862: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T23:19:02.864795989Z [2024-06-18 23:19:02,864: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:19:02.864871787Z [2024-06-18 23:19:02,864: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:19:02.865120659Z [2024-06-18 23:19:02,864: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:19:02.865590666Z [2024-06-18 23:19:02,865: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-18T23:19:02.866842069Z [2024-06-18 23:19:02,866: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-18T23:19:02.866932048Z [2024-06-18 23:19:02,866: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:19:02.891020815Z [2024-06-18 23:19:02,890: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:19:02.948992299Z [2024-06-18 23:19:02,948: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:19:04.503133505Z [2024-06-18 23:19:04,502: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[20e7cfef-2972-4013-b4e7-3f5a8ca5e3b7] succeeded in 3.3417589199998474s: None 2024-06-18T23:19:05.127818338Z [2024-06-18 23:19:05,127: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[fad2d059-dcd9-4576-bef7-445f92c2e84e] succeeded in 3.972869795999941s: None 2024-06-18T23:20:01.169716535Z [2024-06-18 23:20:01,168: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cd91f14e-45a0-414f-a049-37b041deacb8] received 2024-06-18T23:20:01.172408949Z [2024-06-18 23:20:01,172: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f6846c41-3596-4df3-a4bc-e84668ded1d2] received 2024-06-18T23:20:01.175029702Z [2024-06-18 23:20:01,174: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5a709ae4-45fa-42a6-a19b-ca5f90b9f682] received 2024-06-18T23:20:01.176745204Z [2024-06-18 23:20:01,176: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8071c4af-0011-4f6d-8dc1-a8b9d3b3f986] received 2024-06-18T23:20:01.179076290Z [2024-06-18 23:20:01,178: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ca62b928-746a-4e4a-bcd1-048bad4a0562] received 2024-06-18T23:20:01.189293802Z [2024-06-18 23:20:01,187: INFO/ForkPoolWorker-15] [cd91f14e-45a0-414f-a049-37b041deacb8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-18T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-18T23:20:01.192380921Z [2024-06-18 23:20:01,191: INFO/ForkPoolWorker-1] [5a709ae4-45fa-42a6-a19b-ca5f90b9f682] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T23:20:01.192893567Z [2024-06-18 23:20:01,192: INFO/ForkPoolWorker-16] [f6846c41-3596-4df3-a4bc-e84668ded1d2] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-18T23:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-18T23:20:01.218702924Z [2024-06-18 23:20:01,218: INFO/ForkPoolWorker-3] [ca62b928-746a-4e4a-bcd1-048bad4a0562] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T23:20:01.230600573Z [2024-06-18 23:20:01,230: INFO/ForkPoolWorker-2] [8071c4af-0011-4f6d-8dc1-a8b9d3b3f986] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T23:20:01.588474158Z [2024-06-18 23:20:01,584: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T23:20:01.611853334Z [2024-06-18 23:20:01,607: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T23:20:01.625190556Z [2024-06-18 23:20:01,620: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T23:20:01.763286023Z [2024-06-18 23:20:01,755: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T23:20:01.817421824Z [2024-06-18 23:20:01,809: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-18T23:20:02.035542859Z [2024-06-18 23:20:02,035: INFO/ForkPoolWorker-2] Getting SDNC list 2024-06-18T23:20:02.044785001Z [2024-06-18 23:20:02,044: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:20:02.100048808Z [2024-06-18 23:20:02,099: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-18T23:20:02.101660885Z [2024-06-18 23:20:02,101: INFO/ForkPoolWorker-2] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T23:20:02.101898690Z [2024-06-18 23:20:02,101: INFO/ForkPoolWorker-2] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T23:20:02.102080838Z [2024-06-18 23:20:02,101: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-06-18T23:20:02.102386026Z [2024-06-18 23:20:02,102: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T23:20:02.207828478Z [2024-06-18 23:20:02,207: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:20:02.247785786Z [2024-06-18 23:20:02,241: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:20:02.856645713Z [2024-06-18 23:20:02,853: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f6846c41-3596-4df3-a4bc-e84668ded1d2] succeeded in 1.675861678000274s: None 2024-06-18T23:20:03.047083241Z [2024-06-18 23:20:03,046: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[8071c4af-0011-4f6d-8dc1-a8b9d3b3f986] succeeded in 1.8576108480001494s: None 2024-06-18T23:20:03.384688381Z [2024-06-18 23:20:03,384: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T23:20:03.388109872Z [2024-06-18 23:20:03,387: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:20:03.408055272Z [2024-06-18 23:20:03,407: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T23:20:03.409959219Z [2024-06-18 23:20:03,409: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:20:03.410002518Z [2024-06-18 23:20:03,409: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:20:03.410097110Z [2024-06-18 23:20:03,409: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:20:03.410137937Z [2024-06-18 23:20:03,410: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T23:20:03.411117366Z [2024-06-18 23:20:03,410: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T23:20:03.411132480Z [2024-06-18 23:20:03,411: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:20:03.435130885Z [2024-06-18 23:20:03,434: INFO/ForkPoolWorker-3] Getting VIM list 2024-06-18T23:20:03.441299272Z [2024-06-18 23:20:03,440: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:20:03.461653476Z [2024-06-18 23:20:03,461: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-18T23:20:03.465074403Z [2024-06-18 23:20:03,464: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:20:03.481448840Z [2024-06-18 23:20:03,481: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-06-18T23:20:03.482960043Z [2024-06-18 23:20:03,482: INFO/ForkPoolWorker-3] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:20:03.483180385Z [2024-06-18 23:20:03,482: INFO/ForkPoolWorker-3] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:20:03.483624605Z [2024-06-18 23:20:03,483: INFO/ForkPoolWorker-3] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:20:03.483947976Z [2024-06-18 23:20:03,483: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-06-18T23:20:03.484397757Z [2024-06-18 23:20:03,484: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T23:20:03.484569700Z [2024-06-18 23:20:03,484: INFO/ForkPoolWorker-3] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:20:03.494292858Z [2024-06-18 23:20:03,494: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:20:03.496706591Z [2024-06-18 23:20:03,496: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T23:20:03.498209369Z [2024-06-18 23:20:03,498: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:20:03.498405760Z [2024-06-18 23:20:03,498: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:20:03.498642151Z [2024-06-18 23:20:03,498: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:20:03.498819411Z [2024-06-18 23:20:03,498: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-18T23:20:03.499183967Z [2024-06-18 23:20:03,499: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-06-18T23:20:03.499375180Z [2024-06-18 23:20:03,499: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:20:03.601178743Z [2024-06-18 23:20:03,600: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:20:03.604387655Z [2024-06-18 23:20:03,604: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:20:04.278875388Z [2024-06-18 23:20:04,278: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cd91f14e-45a0-414f-a049-37b041deacb8] succeeded in 3.103549540000131s: None 2024-06-18T23:20:05.108080201Z [2024-06-18 23:20:05,107: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c9f23151-ac97-40e4-9042-03f3c87b7a89] received 2024-06-18T23:20:05.119251507Z [2024-06-18 23:20:05,118: INFO/ForkPoolWorker-15] [c9f23151-ac97-40e4-9042-03f3c87b7a89] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'split_metrics', 'scheduled__2024-06-18T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-18T23:20:05.357738168Z [2024-06-18 23:20:05,357: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[ca62b928-746a-4e4a-bcd1-048bad4a0562] succeeded in 4.16921234199981s: None 2024-06-18T23:20:05.447370650Z [2024-06-18 23:20:05,442: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T23:20:05.706137574Z [2024-06-18 23:20:05,705: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5a709ae4-45fa-42a6-a19b-ca5f90b9f682] succeeded in 4.52370817999963s: None 2024-06-18T23:20:06.598505242Z [2024-06-18 23:20:06,598: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T23:20:06.602124174Z [2024-06-18 23:20:06,601: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:20:06.626921651Z [2024-06-18 23:20:06,626: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T23:20:06.628561192Z [2024-06-18 23:20:06,628: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:20:06.628633194Z [2024-06-18 23:20:06,628: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:20:06.628861212Z [2024-06-18 23:20:06,628: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:20:06.628957486Z [2024-06-18 23:20:06,628: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T23:20:06.629376632Z [2024-06-18 23:20:06,629: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T23:20:06.629562663Z [2024-06-18 23:20:06,629: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:20:06.726675035Z [2024-06-18 23:20:06,726: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:20:07.538174532Z [2024-06-18 23:20:07,537: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[28c98a19-22bd-4fc1-9c59-e29a00bd7689] received 2024-06-18T23:20:07.542176022Z [2024-06-18 23:20:07,541: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c9f23151-ac97-40e4-9042-03f3c87b7a89] succeeded in 2.4304647720000503s: None 2024-06-18T23:20:07.564940271Z [2024-06-18 23:20:07,563: INFO/ForkPoolWorker-16] [28c98a19-22bd-4fc1-9c59-e29a00bd7689] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'collect_metrics', 'scheduled__2024-06-18T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-18T23:20:07.847262948Z [2024-06-18 23:20:07,844: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T23:20:09.009724851Z [2024-06-18 23:20:09,009: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-18T23:20:09.013124537Z [2024-06-18 23:20:09,012: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:20:09.036482387Z [2024-06-18 23:20:09,036: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T23:20:09.038137953Z [2024-06-18 23:20:09,037: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:20:09.038195123Z [2024-06-18 23:20:09,038: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:20:09.038341258Z [2024-06-18 23:20:09,038: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:20:09.038429283Z [2024-06-18 23:20:09,038: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-18T23:20:09.038774640Z [2024-06-18 23:20:09,038: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T23:20:09.038852254Z [2024-06-18 23:20:09,038: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:20:09.133496652Z [2024-06-18 23:20:09,133: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:20:09.838682214Z [2024-06-18 23:20:09,837: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[28c98a19-22bd-4fc1-9c59-e29a00bd7689] succeeded in 2.296264470999631s: None 2024-06-18T23:20:10.067948180Z [2024-06-18 23:20:10,067: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a883a075-0c9b-4697-9f41-534514e2741c] received 2024-06-18T23:20:10.079873416Z [2024-06-18 23:20:10,079: INFO/ForkPoolWorker-15] [a883a075-0c9b-4697-9f41-534514e2741c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'send_prometheus', 'scheduled__2024-06-18T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-18T23:20:10.352396898Z [2024-06-18 23:20:10,349: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T23:20:11.440034610Z [2024-06-18 23:20:11,439: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T23:20:11.443444139Z [2024-06-18 23:20:11,442: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:20:11.471673626Z [2024-06-18 23:20:11,471: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T23:20:11.473907528Z [2024-06-18 23:20:11,473: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:20:11.474014639Z [2024-06-18 23:20:11,473: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:20:11.474282360Z [2024-06-18 23:20:11,473: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:20:11.474461815Z [2024-06-18 23:20:11,474: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T23:20:11.474785961Z [2024-06-18 23:20:11,474: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T23:20:11.474802949Z [2024-06-18 23:20:11,474: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:20:11.577184866Z [2024-06-18 23:20:11,576: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:20:12.190423388Z [2024-06-18 23:20:12,189: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a883a075-0c9b-4697-9f41-534514e2741c] succeeded in 2.1192332929999793s: None 2024-06-18T23:21:00.974897844Z [2024-06-18 23:21:00,974: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e71b0d62-ed16-4447-b333-8cfc69663ac7] received 2024-06-18T23:21:00.986610708Z [2024-06-18 23:21:00,986: INFO/ForkPoolWorker-15] [e71b0d62-ed16-4447-b333-8cfc69663ac7] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T23:21:00.988230303Z [2024-06-18 23:21:00,987: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ecd54cc9-e179-4555-9e94-cd21faaa7c1a] received 2024-06-18T23:21:00.999616629Z [2024-06-18 23:21:00,999: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6f1f0f87-abbc-477e-9f24-d66d4cf623df] received 2024-06-18T23:21:01.014196733Z [2024-06-18 23:21:01,013: INFO/ForkPoolWorker-16] [ecd54cc9-e179-4555-9e94-cd21faaa7c1a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T23:21:01.032632190Z [2024-06-18 23:21:01,032: INFO/ForkPoolWorker-1] [6f1f0f87-abbc-477e-9f24-d66d4cf623df] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T23:21:01.479363310Z [2024-06-18 23:21:01,475: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T23:21:01.549926829Z [2024-06-18 23:21:01,545: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T23:21:01.610046535Z [2024-06-18 23:21:01,605: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T23:21:01.645117102Z [2024-06-18 23:21:01,644: INFO/ForkPoolWorker-15] Getting SDNC list 2024-06-18T23:21:01.649403308Z [2024-06-18 23:21:01,648: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:21:01.692318407Z [2024-06-18 23:21:01,691: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T23:21:01.695030071Z [2024-06-18 23:21:01,694: INFO/ForkPoolWorker-15] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T23:21:01.695367645Z [2024-06-18 23:21:01,694: INFO/ForkPoolWorker-15] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T23:21:01.695645352Z [2024-06-18 23:21:01,695: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-06-18T23:21:01.696172378Z [2024-06-18 23:21:01,695: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T23:21:01.840405368Z [2024-06-18 23:21:01,840: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:21:02.734824078Z [2024-06-18 23:21:02,733: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e71b0d62-ed16-4447-b333-8cfc69663ac7] succeeded in 1.7571005629997671s: None 2024-06-18T23:21:03.019284129Z [2024-06-18 23:21:03,018: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-18T23:21:03.022531893Z [2024-06-18 23:21:03,022: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:21:03.046458027Z [2024-06-18 23:21:03,046: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T23:21:03.048331899Z [2024-06-18 23:21:03,047: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:21:03.048507795Z [2024-06-18 23:21:03,048: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:21:03.048817500Z [2024-06-18 23:21:03,048: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:21:03.048957746Z [2024-06-18 23:21:03,048: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-18T23:21:03.049992482Z [2024-06-18 23:21:03,049: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-06-18T23:21:03.050147557Z [2024-06-18 23:21:03,049: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:21:03.152821098Z [2024-06-18 23:21:03,152: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:21:03.180162688Z [2024-06-18 23:21:03,179: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-18T23:21:03.183460238Z [2024-06-18 23:21:03,182: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:21:03.221116338Z [2024-06-18 23:21:03,220: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T23:21:03.223296910Z [2024-06-18 23:21:03,222: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:21:03.223330963Z [2024-06-18 23:21:03,223: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:21:03.223754097Z [2024-06-18 23:21:03,223: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:21:03.223923011Z [2024-06-18 23:21:03,223: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-18T23:21:03.224692170Z [2024-06-18 23:21:03,224: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T23:21:03.224758866Z [2024-06-18 23:21:03,224: INFO/ForkPoolWorker-16] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:21:03.344664350Z [2024-06-18 23:21:03,344: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:21:05.052039726Z [2024-06-18 23:21:05,051: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ecd54cc9-e179-4555-9e94-cd21faaa7c1a] succeeded in 4.057872692000274s: None 2024-06-18T23:21:05.366360870Z [2024-06-18 23:21:05,365: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6f1f0f87-abbc-477e-9f24-d66d4cf623df] succeeded in 4.357401498000399s: None 2024-06-18T23:22:00.945024828Z [2024-06-18 23:22:00,944: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8295bbef-dfb1-4d93-a298-eed307ac1fa8] received 2024-06-18T23:22:00.948208375Z [2024-06-18 23:22:00,947: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4b309d78-9f66-485f-908a-9f1a2561d7af] received 2024-06-18T23:22:00.949690668Z [2024-06-18 23:22:00,949: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5e2b631f-62d4-49ca-85eb-9759d124154a] received 2024-06-18T23:22:00.958648387Z [2024-06-18 23:22:00,958: INFO/ForkPoolWorker-15] [8295bbef-dfb1-4d93-a298-eed307ac1fa8] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-18T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-18T23:22:00.959671631Z [2024-06-18 23:22:00,959: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9c0411f3-7312-4365-858b-498f998b6a89] received 2024-06-18T23:22:00.974671689Z [2024-06-18 23:22:00,974: INFO/ForkPoolWorker-2] [9c0411f3-7312-4365-858b-498f998b6a89] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T23:22:00.974977228Z [2024-06-18 23:22:00,974: INFO/ForkPoolWorker-16] [4b309d78-9f66-485f-908a-9f1a2561d7af] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T23:22:00.992125198Z [2024-06-18 23:22:00,991: INFO/ForkPoolWorker-1] [5e2b631f-62d4-49ca-85eb-9759d124154a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T23:22:01.338804117Z [2024-06-18 23:22:01,332: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T23:22:01.363311452Z [2024-06-18 23:22:01,354: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T23:22:01.400095423Z [2024-06-18 23:22:01,396: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T23:22:01.400480349Z [2024-06-18 23:22:01,387: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-18T23:22:01.560775972Z [2024-06-18 23:22:01,560: INFO/ForkPoolWorker-2] Getting SDNC list 2024-06-18T23:22:01.567744937Z [2024-06-18 23:22:01,567: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:22:01.611403355Z [2024-06-18 23:22:01,611: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-18T23:22:01.613164455Z [2024-06-18 23:22:01,612: INFO/ForkPoolWorker-2] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T23:22:01.613666426Z [2024-06-18 23:22:01,613: INFO/ForkPoolWorker-2] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T23:22:01.613853540Z [2024-06-18 23:22:01,613: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-06-18T23:22:01.614974307Z [2024-06-18 23:22:01,614: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T23:22:01.741959348Z [2024-06-18 23:22:01,741: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:22:01.760814880Z [2024-06-18 23:22:01,760: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:22:02.432439800Z [2024-06-18 23:22:02,431: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8295bbef-dfb1-4d93-a298-eed307ac1fa8] succeeded in 1.4832322259999273s: None 2024-06-18T23:22:02.547853974Z [2024-06-18 23:22:02,547: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[9c0411f3-7312-4365-858b-498f998b6a89] succeeded in 1.5830735299996377s: None 2024-06-18T23:22:02.767514836Z [2024-06-18 23:22:02,767: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-18T23:22:02.770881866Z [2024-06-18 23:22:02,770: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:22:02.795801225Z [2024-06-18 23:22:02,795: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T23:22:02.797362782Z [2024-06-18 23:22:02,797: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:22:02.797550264Z [2024-06-18 23:22:02,797: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:22:02.797744552Z [2024-06-18 23:22:02,797: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:22:02.797950525Z [2024-06-18 23:22:02,797: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-18T23:22:02.798239301Z [2024-06-18 23:22:02,798: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-06-18T23:22:02.798326510Z [2024-06-18 23:22:02,798: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:22:02.884358072Z [2024-06-18 23:22:02,884: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:22:02.895527910Z [2024-06-18 23:22:02,895: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-18T23:22:02.898934868Z [2024-06-18 23:22:02,898: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:22:02.921458026Z [2024-06-18 23:22:02,921: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T23:22:02.922888388Z [2024-06-18 23:22:02,922: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:22:02.923017432Z [2024-06-18 23:22:02,922: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:22:02.923280457Z [2024-06-18 23:22:02,923: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:22:02.923362615Z [2024-06-18 23:22:02,923: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-18T23:22:02.923681850Z [2024-06-18 23:22:02,923: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T23:22:02.923902799Z [2024-06-18 23:22:02,923: INFO/ForkPoolWorker-16] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:22:03.017606251Z [2024-06-18 23:22:03,017: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:22:04.815261049Z [2024-06-18 23:22:04,814: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4b309d78-9f66-485f-908a-9f1a2561d7af] succeeded in 3.8614198179993764s: None 2024-06-18T23:22:04.976257237Z [2024-06-18 23:22:04,975: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5e2b631f-62d4-49ca-85eb-9759d124154a] succeeded in 4.018637448999925s: None 2024-06-18T23:23:00.415887144Z [2024-06-18 23:23:00,415: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d6876892-2ab5-471a-9798-5ed22173ba9e] received 2024-06-18T23:23:00.425171541Z [2024-06-18 23:23:00,424: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c86e48f3-0135-4abd-b16c-21c3dbbae49d] received 2024-06-18T23:23:00.433420006Z [2024-06-18 23:23:00,432: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6752541c-87a5-4bf8-b27d-5a8129043ed1] received 2024-06-18T23:23:00.434698653Z [2024-06-18 23:23:00,434: INFO/ForkPoolWorker-15] [d6876892-2ab5-471a-9798-5ed22173ba9e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T23:23:00.451017868Z [2024-06-18 23:23:00,450: INFO/ForkPoolWorker-1] [6752541c-87a5-4bf8-b27d-5a8129043ed1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T23:23:00.452783821Z [2024-06-18 23:23:00,452: INFO/ForkPoolWorker-16] [c86e48f3-0135-4abd-b16c-21c3dbbae49d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T23:23:00.764330362Z [2024-06-18 23:23:00,760: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T23:23:00.806344564Z [2024-06-18 23:23:00,803: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T23:23:00.826310376Z [2024-06-18 23:23:00,821: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T23:23:00.925867396Z [2024-06-18 23:23:00,925: INFO/ForkPoolWorker-15] Getting SDNC list 2024-06-18T23:23:00.930109634Z [2024-06-18 23:23:00,929: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:23:00.954620467Z [2024-06-18 23:23:00,954: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T23:23:00.956423045Z [2024-06-18 23:23:00,956: INFO/ForkPoolWorker-15] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T23:23:00.956702992Z [2024-06-18 23:23:00,956: INFO/ForkPoolWorker-15] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T23:23:00.956900300Z [2024-06-18 23:23:00,956: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-06-18T23:23:00.957255814Z [2024-06-18 23:23:00,957: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T23:23:01.049766548Z [2024-06-18 23:23:01,049: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:23:01.768120119Z [2024-06-18 23:23:01,767: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d6876892-2ab5-471a-9798-5ed22173ba9e] succeeded in 1.3471356189993458s: None 2024-06-18T23:23:01.976089509Z [2024-06-18 23:23:01,975: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-18T23:23:01.979453022Z [2024-06-18 23:23:01,978: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:23:02.008829524Z [2024-06-18 23:23:02,008: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T23:23:02.010567128Z [2024-06-18 23:23:02,010: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:23:02.010650069Z [2024-06-18 23:23:02,010: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:23:02.010771599Z [2024-06-18 23:23:02,010: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:23:02.010915527Z [2024-06-18 23:23:02,010: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-18T23:23:02.011295586Z [2024-06-18 23:23:02,011: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T23:23:02.011387650Z [2024-06-18 23:23:02,011: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:23:02.113645888Z [2024-06-18 23:23:02,113: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:23:02.121478112Z [2024-06-18 23:23:02,120: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-18T23:23:02.125064992Z [2024-06-18 23:23:02,124: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:23:02.148251276Z [2024-06-18 23:23:02,147: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T23:23:02.150329906Z [2024-06-18 23:23:02,149: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:23:02.150400185Z [2024-06-18 23:23:02,150: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:23:02.150468075Z [2024-06-18 23:23:02,150: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:23:02.150494983Z [2024-06-18 23:23:02,150: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-18T23:23:02.150777710Z [2024-06-18 23:23:02,150: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-18T23:23:02.150922443Z [2024-06-18 23:23:02,150: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:23:02.256701805Z [2024-06-18 23:23:02,254: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:23:03.905474009Z [2024-06-18 23:23:03,904: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6752541c-87a5-4bf8-b27d-5a8129043ed1] succeeded in 3.4641080450001027s: None 2024-06-18T23:23:04.312093180Z [2024-06-18 23:23:04,311: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c86e48f3-0135-4abd-b16c-21c3dbbae49d] succeeded in 3.8819126790003793s: None 2024-06-18T23:24:00.889189215Z [2024-06-18 23:24:00,888: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[272d2b57-b441-4e35-809e-5bf48c449118] received 2024-06-18T23:24:00.896030236Z [2024-06-18 23:24:00,895: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e54aaa19-9f1f-4c4b-a342-2818d49f0e72] received 2024-06-18T23:24:00.904980865Z [2024-06-18 23:24:00,904: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7cd39805-ddfd-43de-a11d-595ba1d5bac5] received 2024-06-18T23:24:00.907167151Z [2024-06-18 23:24:00,906: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[caef7921-e623-4557-bc0c-3493033bbaaa] received 2024-06-18T23:24:00.912341828Z [2024-06-18 23:24:00,908: INFO/ForkPoolWorker-16] [e54aaa19-9f1f-4c4b-a342-2818d49f0e72] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T23:24:00.917217040Z [2024-06-18 23:24:00,916: INFO/ForkPoolWorker-15] [272d2b57-b441-4e35-809e-5bf48c449118] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-18T23:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-18T23:24:00.923086942Z [2024-06-18 23:24:00,922: INFO/ForkPoolWorker-2] [caef7921-e623-4557-bc0c-3493033bbaaa] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T23:24:00.926557297Z [2024-06-18 23:24:00,926: INFO/ForkPoolWorker-1] [7cd39805-ddfd-43de-a11d-595ba1d5bac5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T23:24:01.249517261Z [2024-06-18 23:24:01,245: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T23:24:01.269933654Z [2024-06-18 23:24:01,264: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T23:24:01.288884552Z [2024-06-18 23:24:01,277: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T23:24:01.366808792Z [2024-06-18 23:24:01,363: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-18T23:24:01.507606522Z [2024-06-18 23:24:01,507: INFO/ForkPoolWorker-2] Getting SDNC list 2024-06-18T23:24:01.511864169Z [2024-06-18 23:24:01,511: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:24:01.544573254Z [2024-06-18 23:24:01,544: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-18T23:24:01.545894671Z [2024-06-18 23:24:01,545: INFO/ForkPoolWorker-2] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T23:24:01.546055989Z [2024-06-18 23:24:01,545: INFO/ForkPoolWorker-2] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T23:24:01.546139527Z [2024-06-18 23:24:01,546: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-06-18T23:24:01.546713642Z [2024-06-18 23:24:01,546: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T23:24:01.678182678Z [2024-06-18 23:24:01,677: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:24:01.700729931Z [2024-06-18 23:24:01,700: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:24:02.447637123Z [2024-06-18 23:24:02,447: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[272d2b57-b441-4e35-809e-5bf48c449118] succeeded in 1.5557426119994489s: None 2024-06-18T23:24:02.523098498Z [2024-06-18 23:24:02,522: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[caef7921-e623-4557-bc0c-3493033bbaaa] succeeded in 1.613153309000154s: None 2024-06-18T23:24:02.922014039Z [2024-06-18 23:24:02,921: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-18T23:24:02.923903912Z [2024-06-18 23:24:02,923: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-18T23:24:02.925737794Z [2024-06-18 23:24:02,925: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:24:02.930884226Z [2024-06-18 23:24:02,930: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:24:02.950585592Z [2024-06-18 23:24:02,950: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T23:24:02.952324767Z [2024-06-18 23:24:02,952: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:24:02.952382364Z [2024-06-18 23:24:02,952: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:24:02.952522515Z [2024-06-18 23:24:02,952: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:24:02.952579464Z [2024-06-18 23:24:02,952: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-18T23:24:02.952872276Z [2024-06-18 23:24:02,952: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T23:24:02.952883479Z [2024-06-18 23:24:02,952: INFO/ForkPoolWorker-16] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:24:02.960186194Z [2024-06-18 23:24:02,959: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T23:24:02.961956201Z [2024-06-18 23:24:02,961: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:24:02.962030331Z [2024-06-18 23:24:02,961: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:24:02.962267736Z [2024-06-18 23:24:02,962: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:24:02.962328958Z [2024-06-18 23:24:02,962: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-18T23:24:02.962679692Z [2024-06-18 23:24:02,962: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-06-18T23:24:02.962727244Z [2024-06-18 23:24:02,962: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:24:03.051013019Z [2024-06-18 23:24:03,050: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:24:03.054496712Z [2024-06-18 23:24:03,054: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:24:04.718882770Z [2024-06-18 23:24:04,718: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e54aaa19-9f1f-4c4b-a342-2818d49f0e72] succeeded in 3.8202533960002256s: None 2024-06-18T23:24:05.413982666Z [2024-06-18 23:24:05,413: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7cd39805-ddfd-43de-a11d-595ba1d5bac5] succeeded in 4.505543031999878s: None 2024-06-18T23:25:00.254794314Z [2024-06-18 23:25:00,254: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ad883267-695a-44c4-bae8-b7595a09a540] received 2024-06-18T23:25:00.257617002Z [2024-06-18 23:25:00,257: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[05e01bc8-b8d1-4e62-a215-e0841ad9e377] received 2024-06-18T23:25:00.269881097Z [2024-06-18 23:25:00,269: INFO/ForkPoolWorker-15] [ad883267-695a-44c4-bae8-b7595a09a540] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-18T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-18T23:25:00.275043186Z [2024-06-18 23:25:00,274: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f523793b-1177-4579-94e1-d804ecded99e] received 2024-06-18T23:25:00.278363769Z [2024-06-18 23:25:00,278: INFO/ForkPoolWorker-16] [05e01bc8-b8d1-4e62-a215-e0841ad9e377] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T23:25:00.280334263Z [2024-06-18 23:25:00,280: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[45bf28ba-9a17-454f-942a-668767a71bc6] received 2024-06-18T23:25:00.281987001Z [2024-06-18 23:25:00,281: INFO/ForkPoolWorker-1] [f523793b-1177-4579-94e1-d804ecded99e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T23:25:00.289971324Z [2024-06-18 23:25:00,289: INFO/ForkPoolWorker-2] [45bf28ba-9a17-454f-942a-668767a71bc6] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T23:25:00.586956507Z [2024-06-18 23:25:00,582: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T23:25:00.597245057Z [2024-06-18 23:25:00,593: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T23:25:00.631468308Z [2024-06-18 23:25:00,627: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T23:25:00.699929772Z [2024-06-18 23:25:00,695: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T23:25:00.770089866Z [2024-06-18 23:25:00,769: INFO/ForkPoolWorker-2] Getting SDNC list 2024-06-18T23:25:00.774014042Z [2024-06-18 23:25:00,773: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:25:00.816735107Z [2024-06-18 23:25:00,816: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-18T23:25:00.820481845Z [2024-06-18 23:25:00,820: INFO/ForkPoolWorker-2] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T23:25:00.820507102Z [2024-06-18 23:25:00,820: INFO/ForkPoolWorker-2] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T23:25:00.820565573Z [2024-06-18 23:25:00,820: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-06-18T23:25:00.820796703Z [2024-06-18 23:25:00,820: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T23:25:00.980427884Z [2024-06-18 23:25:00,980: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:25:01.687717591Z [2024-06-18 23:25:01,687: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[45bf28ba-9a17-454f-942a-668767a71bc6] succeeded in 1.4041875530001562s: None 2024-06-18T23:25:02.100835677Z [2024-06-18 23:25:02,100: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-18T23:25:02.104567707Z [2024-06-18 23:25:02,104: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:25:02.124357052Z [2024-06-18 23:25:02,123: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-18T23:25:02.127576060Z [2024-06-18 23:25:02,127: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:25:02.143333122Z [2024-06-18 23:25:02,143: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T23:25:02.145116492Z [2024-06-18 23:25:02,144: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:25:02.145309112Z [2024-06-18 23:25:02,145: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:25:02.145495475Z [2024-06-18 23:25:02,145: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:25:02.145627495Z [2024-06-18 23:25:02,145: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-18T23:25:02.146289246Z [2024-06-18 23:25:02,146: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T23:25:02.146417268Z [2024-06-18 23:25:02,146: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:25:02.157588958Z [2024-06-18 23:25:02,157: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T23:25:02.159089914Z [2024-06-18 23:25:02,158: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:25:02.159107980Z [2024-06-18 23:25:02,158: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:25:02.159171979Z [2024-06-18 23:25:02,159: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:25:02.159272899Z [2024-06-18 23:25:02,159: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-18T23:25:02.159467155Z [2024-06-18 23:25:02,159: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-18T23:25:02.159502157Z [2024-06-18 23:25:02,159: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:25:02.282051531Z [2024-06-18 23:25:02,280: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:25:02.317268088Z [2024-06-18 23:25:02,316: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:25:02.352760226Z [2024-06-18 23:25:02,352: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T23:25:02.356598900Z [2024-06-18 23:25:02,356: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:25:02.399902006Z [2024-06-18 23:25:02,399: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T23:25:02.408601266Z [2024-06-18 23:25:02,408: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:25:02.408840526Z [2024-06-18 23:25:02,408: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:25:02.409041243Z [2024-06-18 23:25:02,408: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:25:02.409097661Z [2024-06-18 23:25:02,409: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T23:25:02.409421838Z [2024-06-18 23:25:02,409: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T23:25:02.409468609Z [2024-06-18 23:25:02,409: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:25:02.509314112Z [2024-06-18 23:25:02,509: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:25:03.210091689Z [2024-06-18 23:25:03,209: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ad883267-695a-44c4-bae8-b7595a09a540] succeeded in 2.9502504949996364s: None 2024-06-18T23:25:03.225969965Z [2024-06-18 23:25:03,225: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[093db413-f760-48a9-b496-56f2892ecb32] received 2024-06-18T23:25:03.234727913Z [2024-06-18 23:25:03,234: INFO/ForkPoolWorker-15] [093db413-f760-48a9-b496-56f2892ecb32] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'split_metrics', 'scheduled__2024-06-18T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-18T23:25:03.551659873Z [2024-06-18 23:25:03,548: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T23:25:04.047618658Z [2024-06-18 23:25:04,047: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f523793b-1177-4579-94e1-d804ecded99e] succeeded in 3.7706329540005754s: None 2024-06-18T23:25:04.232545416Z [2024-06-18 23:25:04,232: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[05e01bc8-b8d1-4e62-a215-e0841ad9e377] succeeded in 3.9702167579998786s: None 2024-06-18T23:25:04.783150892Z [2024-06-18 23:25:04,782: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T23:25:04.786477730Z [2024-06-18 23:25:04,785: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:25:04.814645161Z [2024-06-18 23:25:04,814: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T23:25:04.816551075Z [2024-06-18 23:25:04,816: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:25:04.816643646Z [2024-06-18 23:25:04,816: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:25:04.816819593Z [2024-06-18 23:25:04,816: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:25:04.816903379Z [2024-06-18 23:25:04,816: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T23:25:04.817235279Z [2024-06-18 23:25:04,817: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T23:25:04.817309368Z [2024-06-18 23:25:04,817: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:25:04.930259921Z [2024-06-18 23:25:04,929: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:25:05.601070299Z [2024-06-18 23:25:05,600: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a7656648-dcb4-4e8c-8b2a-d05af077f458] received 2024-06-18T23:25:05.606933439Z [2024-06-18 23:25:05,606: INFO/ForkPoolWorker-16] [a7656648-dcb4-4e8c-8b2a-d05af077f458] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'collect_metrics', 'scheduled__2024-06-18T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-18T23:25:05.649187225Z [2024-06-18 23:25:05,648: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[093db413-f760-48a9-b496-56f2892ecb32] succeeded in 2.420429289999447s: None 2024-06-18T23:25:05.878766395Z [2024-06-18 23:25:05,875: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T23:25:07.095094799Z [2024-06-18 23:25:07,094: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-18T23:25:07.100510882Z [2024-06-18 23:25:07,099: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:25:07.147610575Z [2024-06-18 23:25:07,147: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T23:25:07.149956757Z [2024-06-18 23:25:07,149: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:25:07.149978850Z [2024-06-18 23:25:07,149: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:25:07.150242326Z [2024-06-18 23:25:07,149: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:25:07.150257188Z [2024-06-18 23:25:07,150: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-18T23:25:07.150651201Z [2024-06-18 23:25:07,150: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T23:25:07.150761733Z [2024-06-18 23:25:07,150: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:25:07.258144217Z [2024-06-18 23:25:07,257: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:25:07.900052319Z [2024-06-18 23:25:07,899: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a7656648-dcb4-4e8c-8b2a-d05af077f458] succeeded in 2.297057370999937s: None 2024-06-18T23:25:07.969121700Z [2024-06-18 23:25:07,968: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[76bc27bc-25f9-40b7-804d-86d5334fd792] received 2024-06-18T23:25:07.976620230Z [2024-06-18 23:25:07,976: INFO/ForkPoolWorker-15] [76bc27bc-25f9-40b7-804d-86d5334fd792] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'send_prometheus', 'scheduled__2024-06-18T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-18T23:25:08.273073910Z [2024-06-18 23:25:08,269: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T23:25:09.423885573Z [2024-06-18 23:25:09,423: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T23:25:09.427366574Z [2024-06-18 23:25:09,426: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:25:09.469470925Z [2024-06-18 23:25:09,469: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T23:25:09.472315030Z [2024-06-18 23:25:09,471: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:25:09.472572594Z [2024-06-18 23:25:09,472: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:25:09.472996232Z [2024-06-18 23:25:09,472: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:25:09.473313790Z [2024-06-18 23:25:09,472: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T23:25:09.474172920Z [2024-06-18 23:25:09,473: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T23:25:09.474458708Z [2024-06-18 23:25:09,474: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:25:09.633244357Z [2024-06-18 23:25:09,632: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:25:10.367908068Z [2024-06-18 23:25:10,365: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[76bc27bc-25f9-40b7-804d-86d5334fd792] succeeded in 2.393990708000274s: None 2024-06-18T23:26:00.644880352Z [2024-06-18 23:26:00,644: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[48614b2e-5f95-4d27-b2ed-e49187342049] received 2024-06-18T23:26:00.651855346Z [2024-06-18 23:26:00,651: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[27484d82-eca2-4494-bed4-8b13449ecc01] received 2024-06-18T23:26:00.657349672Z [2024-06-18 23:26:00,657: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f17dad86-5537-48e9-9078-913c854dd366] received 2024-06-18T23:26:00.658921174Z [2024-06-18 23:26:00,658: INFO/ForkPoolWorker-15] [48614b2e-5f95-4d27-b2ed-e49187342049] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-18T23:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-18T23:26:00.668584928Z [2024-06-18 23:26:00,668: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6cc6b123-d178-4ef3-9e1d-8929e5e5339a] received 2024-06-18T23:26:00.677277393Z [2024-06-18 23:26:00,676: INFO/ForkPoolWorker-1] [f17dad86-5537-48e9-9078-913c854dd366] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T23:26:00.677833581Z [2024-06-18 23:26:00,677: INFO/ForkPoolWorker-16] [27484d82-eca2-4494-bed4-8b13449ecc01] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T23:26:00.713331092Z [2024-06-18 23:26:00,712: INFO/ForkPoolWorker-2] [6cc6b123-d178-4ef3-9e1d-8929e5e5339a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T23:26:01.064189134Z [2024-06-18 23:26:01,057: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-18T23:26:01.083332712Z [2024-06-18 23:26:01,073: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T23:26:01.090019396Z [2024-06-18 23:26:01,078: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T23:26:01.092149887Z [2024-06-18 23:26:01,087: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T23:26:01.361599840Z [2024-06-18 23:26:01,361: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:26:01.364541351Z [2024-06-18 23:26:01,364: INFO/ForkPoolWorker-2] Getting SDNC list 2024-06-18T23:26:01.369084328Z [2024-06-18 23:26:01,368: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:26:01.407322792Z [2024-06-18 23:26:01,407: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-18T23:26:01.413430557Z [2024-06-18 23:26:01,412: INFO/ForkPoolWorker-2] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T23:26:01.413482998Z [2024-06-18 23:26:01,413: INFO/ForkPoolWorker-2] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T23:26:01.413503734Z [2024-06-18 23:26:01,413: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-06-18T23:26:01.413813010Z [2024-06-18 23:26:01,413: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T23:26:01.592841705Z [2024-06-18 23:26:01,592: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:26:02.129595220Z [2024-06-18 23:26:02,129: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[48614b2e-5f95-4d27-b2ed-e49187342049] succeeded in 1.4796665499998198s: None 2024-06-18T23:26:02.360792587Z [2024-06-18 23:26:02,360: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[6cc6b123-d178-4ef3-9e1d-8929e5e5339a] succeeded in 1.6864550720001716s: None 2024-06-18T23:26:02.665859400Z [2024-06-18 23:26:02,665: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-18T23:26:02.670500469Z [2024-06-18 23:26:02,668: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:26:02.696174345Z [2024-06-18 23:26:02,695: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T23:26:02.697915084Z [2024-06-18 23:26:02,697: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:26:02.698020622Z [2024-06-18 23:26:02,697: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:26:02.698161673Z [2024-06-18 23:26:02,698: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:26:02.698241178Z [2024-06-18 23:26:02,698: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-18T23:26:02.698516174Z [2024-06-18 23:26:02,698: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-18T23:26:02.698590408Z [2024-06-18 23:26:02,698: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:26:02.793186652Z [2024-06-18 23:26:02,792: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:26:02.807723704Z [2024-06-18 23:26:02,807: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-18T23:26:02.811228336Z [2024-06-18 23:26:02,810: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:26:02.843192197Z [2024-06-18 23:26:02,842: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T23:26:02.845754121Z [2024-06-18 23:26:02,845: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:26:02.845849390Z [2024-06-18 23:26:02,845: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:26:02.846125513Z [2024-06-18 23:26:02,845: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:26:02.846305979Z [2024-06-18 23:26:02,846: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-18T23:26:02.846731991Z [2024-06-18 23:26:02,846: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T23:26:02.846890399Z [2024-06-18 23:26:02,846: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:26:02.956125849Z [2024-06-18 23:26:02,955: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:26:04.712719423Z [2024-06-18 23:26:04,712: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f17dad86-5537-48e9-9078-913c854dd366] succeeded in 4.052386917000149s: None 2024-06-18T23:26:04.999156559Z [2024-06-18 23:26:04,998: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[27484d82-eca2-4494-bed4-8b13449ecc01] succeeded in 4.34223924700018s: None 2024-06-18T23:27:01.066149279Z [2024-06-18 23:27:01,065: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cb378d10-28ac-41be-83bd-c4c6e979b454] received 2024-06-18T23:27:01.073475881Z [2024-06-18 23:27:01,073: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5fb06f75-bc0b-4015-8a48-87f7bde3cadb] received 2024-06-18T23:27:01.076878140Z [2024-06-18 23:27:01,076: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6dac0d0a-de5c-458e-806f-70381d6714bb] received 2024-06-18T23:27:01.082242491Z [2024-06-18 23:27:01,081: INFO/ForkPoolWorker-16] [5fb06f75-bc0b-4015-8a48-87f7bde3cadb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T23:27:01.085903516Z [2024-06-18 23:27:01,085: INFO/ForkPoolWorker-1] [6dac0d0a-de5c-458e-806f-70381d6714bb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T23:27:01.086382093Z [2024-06-18 23:27:01,086: INFO/ForkPoolWorker-15] [cb378d10-28ac-41be-83bd-c4c6e979b454] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T23:27:01.362657570Z [2024-06-18 23:27:01,358: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T23:27:01.364942551Z [2024-06-18 23:27:01,361: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T23:27:01.372750537Z [2024-06-18 23:27:01,369: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T23:27:01.539362829Z [2024-06-18 23:27:01,538: INFO/ForkPoolWorker-15] Getting SDNC list 2024-06-18T23:27:01.543399419Z [2024-06-18 23:27:01,542: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:27:01.571124552Z [2024-06-18 23:27:01,570: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T23:27:01.572599334Z [2024-06-18 23:27:01,572: INFO/ForkPoolWorker-15] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T23:27:01.572805292Z [2024-06-18 23:27:01,572: INFO/ForkPoolWorker-15] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T23:27:01.572916795Z [2024-06-18 23:27:01,572: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-06-18T23:27:01.573184469Z [2024-06-18 23:27:01,573: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T23:27:01.676341849Z [2024-06-18 23:27:01,676: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:27:02.516291894Z [2024-06-18 23:27:02,515: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cb378d10-28ac-41be-83bd-c4c6e979b454] succeeded in 1.4471186729997498s: None 2024-06-18T23:27:02.758996287Z [2024-06-18 23:27:02,758: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-18T23:27:02.759555783Z [2024-06-18 23:27:02,759: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-18T23:27:02.762190909Z [2024-06-18 23:27:02,761: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:27:02.763166814Z [2024-06-18 23:27:02,762: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:27:02.783658235Z [2024-06-18 23:27:02,783: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T23:27:02.785492992Z [2024-06-18 23:27:02,785: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:27:02.785733165Z [2024-06-18 23:27:02,785: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:27:02.785989092Z [2024-06-18 23:27:02,785: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:27:02.786152523Z [2024-06-18 23:27:02,785: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-18T23:27:02.786802020Z [2024-06-18 23:27:02,786: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T23:27:02.786985107Z [2024-06-18 23:27:02,786: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:27:02.795004990Z [2024-06-18 23:27:02,794: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T23:27:02.796588205Z [2024-06-18 23:27:02,796: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:27:02.796611033Z [2024-06-18 23:27:02,796: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:27:02.796803979Z [2024-06-18 23:27:02,796: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:27:02.796824337Z [2024-06-18 23:27:02,796: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-18T23:27:02.797104840Z [2024-06-18 23:27:02,796: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-18T23:27:02.797285539Z [2024-06-18 23:27:02,797: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:27:02.898895404Z [2024-06-18 23:27:02,898: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:27:02.910653796Z [2024-06-18 23:27:02,910: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:27:04.763142734Z [2024-06-18 23:27:04,762: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6dac0d0a-de5c-458e-806f-70381d6714bb] succeeded in 3.684356119999393s: None 2024-06-18T23:27:05.058346043Z [2024-06-18 23:27:05,057: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5fb06f75-bc0b-4015-8a48-87f7bde3cadb] succeeded in 3.982793504000256s: None 2024-06-18T23:28:00.332148091Z [2024-06-18 23:28:00,331: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e6ce2cfa-12aa-483a-a41d-74204471a5c6] received 2024-06-18T23:28:00.335619843Z [2024-06-18 23:28:00,335: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[35535d11-061d-4d5c-a27b-7040c01f7dcd] received 2024-06-18T23:28:00.344736009Z [2024-06-18 23:28:00,344: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6198c6c9-f830-41eb-92da-d26b4459f05c] received 2024-06-18T23:28:00.348912338Z [2024-06-18 23:28:00,347: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[39faab30-0139-4280-af1f-c41b4f5a5e73] received 2024-06-18T23:28:00.354173081Z [2024-06-18 23:28:00,353: INFO/ForkPoolWorker-16] [35535d11-061d-4d5c-a27b-7040c01f7dcd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T23:28:00.362368239Z [2024-06-18 23:28:00,361: INFO/ForkPoolWorker-15] [e6ce2cfa-12aa-483a-a41d-74204471a5c6] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-18T23:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-18T23:28:00.369026667Z [2024-06-18 23:28:00,368: INFO/ForkPoolWorker-1] [6198c6c9-f830-41eb-92da-d26b4459f05c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T23:28:00.377016503Z [2024-06-18 23:28:00,376: INFO/ForkPoolWorker-2] [39faab30-0139-4280-af1f-c41b4f5a5e73] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T23:28:00.717448177Z [2024-06-18 23:28:00,713: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T23:28:00.737907343Z [2024-06-18 23:28:00,733: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T23:28:00.745589238Z [2024-06-18 23:28:00,741: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-18T23:28:00.777538594Z [2024-06-18 23:28:00,773: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T23:28:00.950930004Z [2024-06-18 23:28:00,950: INFO/ForkPoolWorker-2] Getting SDNC list 2024-06-18T23:28:00.956169393Z [2024-06-18 23:28:00,955: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:28:00.981902871Z [2024-06-18 23:28:00,981: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-18T23:28:00.983172609Z [2024-06-18 23:28:00,982: INFO/ForkPoolWorker-2] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T23:28:00.983332373Z [2024-06-18 23:28:00,983: INFO/ForkPoolWorker-2] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T23:28:00.983378751Z [2024-06-18 23:28:00,983: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-06-18T23:28:00.983602767Z [2024-06-18 23:28:00,983: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T23:28:01.047869750Z [2024-06-18 23:28:01,047: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:28:01.091793603Z [2024-06-18 23:28:01,091: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:28:01.608050019Z [2024-06-18 23:28:01,607: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[39faab30-0139-4280-af1f-c41b4f5a5e73] succeeded in 1.2553807399999641s: None 2024-06-18T23:28:01.648325604Z [2024-06-18 23:28:01,647: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e6ce2cfa-12aa-483a-a41d-74204471a5c6] succeeded in 1.3035107960004098s: None 2024-06-18T23:28:02.134623323Z [2024-06-18 23:28:02,134: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-18T23:28:02.137887063Z [2024-06-18 23:28:02,137: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:28:02.163358953Z [2024-06-18 23:28:02,163: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T23:28:02.164515364Z [2024-06-18 23:28:02,164: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-18T23:28:02.164989221Z [2024-06-18 23:28:02,164: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:28:02.165057485Z [2024-06-18 23:28:02,164: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:28:02.165294649Z [2024-06-18 23:28:02,164: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:28:02.165310114Z [2024-06-18 23:28:02,165: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-18T23:28:02.165689174Z [2024-06-18 23:28:02,165: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T23:28:02.166176723Z [2024-06-18 23:28:02,165: INFO/ForkPoolWorker-16] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:28:02.168542507Z [2024-06-18 23:28:02,167: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:28:02.193367332Z [2024-06-18 23:28:02,192: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T23:28:02.198279018Z [2024-06-18 23:28:02,196: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:28:02.198300535Z [2024-06-18 23:28:02,196: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:28:02.198304703Z [2024-06-18 23:28:02,196: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:28:02.198308498Z [2024-06-18 23:28:02,196: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-18T23:28:02.198311791Z [2024-06-18 23:28:02,197: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-06-18T23:28:02.198314962Z [2024-06-18 23:28:02,197: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:28:02.276107681Z [2024-06-18 23:28:02,275: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:28:02.376899379Z [2024-06-18 23:28:02,376: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:28:03.773504962Z [2024-06-18 23:28:03,772: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[35535d11-061d-4d5c-a27b-7040c01f7dcd] succeeded in 3.4281664919999457s: None 2024-06-18T23:28:04.306962347Z [2024-06-18 23:28:04,306: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6198c6c9-f830-41eb-92da-d26b4459f05c] succeeded in 3.9529230769994683s: None 2024-06-18T23:29:01.098042339Z [2024-06-18 23:29:01,097: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[db71bfed-4af3-474a-a720-6d3259b560ca] received 2024-06-18T23:29:01.103669905Z [2024-06-18 23:29:01,103: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a41c6b56-ef2c-47c0-8b61-6f1e13a71a14] received 2024-06-18T23:29:01.108718505Z [2024-06-18 23:29:01,108: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c89d9e20-9215-4f9e-8fe0-4eeb76473268] received 2024-06-18T23:29:01.122887510Z [2024-06-18 23:29:01,122: INFO/ForkPoolWorker-15] [db71bfed-4af3-474a-a720-6d3259b560ca] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T23:29:01.126558763Z [2024-06-18 23:29:01,126: INFO/ForkPoolWorker-1] [c89d9e20-9215-4f9e-8fe0-4eeb76473268] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T23:29:01.130716081Z [2024-06-18 23:29:01,130: INFO/ForkPoolWorker-16] [a41c6b56-ef2c-47c0-8b61-6f1e13a71a14] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T23:29:01.473503680Z [2024-06-18 23:29:01,470: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T23:29:01.494216527Z [2024-06-18 23:29:01,488: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T23:29:01.505267221Z [2024-06-18 23:29:01,501: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T23:29:01.669190685Z [2024-06-18 23:29:01,668: INFO/ForkPoolWorker-16] Getting SDNC list 2024-06-18T23:29:01.673476198Z [2024-06-18 23:29:01,672: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:29:01.700760609Z [2024-06-18 23:29:01,700: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T23:29:01.703681252Z [2024-06-18 23:29:01,703: INFO/ForkPoolWorker-16] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T23:29:01.703857591Z [2024-06-18 23:29:01,703: INFO/ForkPoolWorker-16] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T23:29:01.704015108Z [2024-06-18 23:29:01,703: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-06-18T23:29:01.704684507Z [2024-06-18 23:29:01,704: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T23:29:01.804700433Z [2024-06-18 23:29:01,804: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:29:02.685121951Z [2024-06-18 23:29:02,684: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-18T23:29:02.688264240Z [2024-06-18 23:29:02,687: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:29:02.694275553Z [2024-06-18 23:29:02,693: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a41c6b56-ef2c-47c0-8b61-6f1e13a71a14] succeeded in 1.575263896999786s: None 2024-06-18T23:29:02.715023843Z [2024-06-18 23:29:02,714: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T23:29:02.717293128Z [2024-06-18 23:29:02,716: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:29:02.717329126Z [2024-06-18 23:29:02,717: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:29:02.717435263Z [2024-06-18 23:29:02,717: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:29:02.717445353Z [2024-06-18 23:29:02,717: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-18T23:29:02.717772409Z [2024-06-18 23:29:02,717: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-06-18T23:29:02.717780992Z [2024-06-18 23:29:02,717: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:29:02.821375525Z [2024-06-18 23:29:02,821: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:29:02.951424242Z [2024-06-18 23:29:02,950: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T23:29:02.955085185Z [2024-06-18 23:29:02,954: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:29:02.981943473Z [2024-06-18 23:29:02,981: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T23:29:02.983838954Z [2024-06-18 23:29:02,983: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:29:02.984128851Z [2024-06-18 23:29:02,983: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:29:02.984401985Z [2024-06-18 23:29:02,984: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:29:02.984555840Z [2024-06-18 23:29:02,984: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T23:29:02.984947431Z [2024-06-18 23:29:02,984: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T23:29:02.985186413Z [2024-06-18 23:29:02,984: INFO/ForkPoolWorker-15] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:29:03.095845967Z [2024-06-18 23:29:03,094: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:29:04.901857658Z [2024-06-18 23:29:04,901: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[db71bfed-4af3-474a-a720-6d3259b560ca] succeeded in 3.8006667439995s: None 2024-06-18T23:29:04.975454806Z [2024-06-18 23:29:04,974: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c89d9e20-9215-4f9e-8fe0-4eeb76473268] succeeded in 3.857342602999779s: None 2024-06-18T23:30:01.242713845Z [2024-06-18 23:30:01,242: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[85965ff1-5575-44f1-bb40-05b5ddb30b2a] received 2024-06-18T23:30:01.251606354Z [2024-06-18 23:30:01,251: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e702ad41-d868-439d-b008-6d997e774a61] received 2024-06-18T23:30:01.253167701Z [2024-06-18 23:30:01,252: INFO/ForkPoolWorker-15] [85965ff1-5575-44f1-bb40-05b5ddb30b2a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-18T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-18T23:30:01.268019853Z [2024-06-18 23:30:01,267: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6ed706e6-bf79-4964-be53-968886523a6a] received 2024-06-18T23:30:01.269657474Z [2024-06-18 23:30:01,269: INFO/ForkPoolWorker-16] [e702ad41-d868-439d-b008-6d997e774a61] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-18T23:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-18T23:30:01.284926118Z [2024-06-18 23:30:01,284: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aeb18057-3db8-4e29-af9b-81b210c3afc3] received 2024-06-18T23:30:01.295308172Z [2024-06-18 23:30:01,294: INFO/ForkPoolWorker-1] [6ed706e6-bf79-4964-be53-968886523a6a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T23:30:01.306369869Z [2024-06-18 23:30:01,305: INFO/ForkPoolWorker-2] [aeb18057-3db8-4e29-af9b-81b210c3afc3] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T23:30:01.312680046Z [2024-06-18 23:30:01,312: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[227ff5f9-980d-4fb5-83a7-fab4b1564e68] received 2024-06-18T23:30:01.354027470Z [2024-06-18 23:30:01,353: INFO/ForkPoolWorker-3] [227ff5f9-980d-4fb5-83a7-fab4b1564e68] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T23:30:01.840224993Z [2024-06-18 23:30:01,835: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T23:30:01.866538584Z [2024-06-18 23:30:01,863: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-18T23:30:01.987851410Z [2024-06-18 23:30:01,976: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T23:30:02.007526219Z [2024-06-18 23:30:02,000: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T23:30:02.017338497Z [2024-06-18 23:30:02,004: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T23:30:02.140834749Z [2024-06-18 23:30:02,140: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:30:02.733801743Z [2024-06-18 23:30:02,733: INFO/ForkPoolWorker-2] Getting SDNC list 2024-06-18T23:30:02.738022966Z [2024-06-18 23:30:02,737: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:30:02.772308982Z [2024-06-18 23:30:02,772: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-18T23:30:02.776653904Z [2024-06-18 23:30:02,776: INFO/ForkPoolWorker-2] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T23:30:02.776676823Z [2024-06-18 23:30:02,776: INFO/ForkPoolWorker-2] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T23:30:02.776730969Z [2024-06-18 23:30:02,776: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-06-18T23:30:02.776950680Z [2024-06-18 23:30:02,776: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T23:30:02.945021219Z [2024-06-18 23:30:02,944: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:30:03.220795143Z [2024-06-18 23:30:03,220: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e702ad41-d868-439d-b008-6d997e774a61] succeeded in 1.9599664560000747s: None 2024-06-18T23:30:03.714892775Z [2024-06-18 23:30:03,714: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[aeb18057-3db8-4e29-af9b-81b210c3afc3] succeeded in 2.4252282190000187s: None 2024-06-18T23:30:03.782690729Z [2024-06-18 23:30:03,782: INFO/ForkPoolWorker-3] Getting VIM list 2024-06-18T23:30:03.786083478Z [2024-06-18 23:30:03,785: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:30:03.803031805Z [2024-06-18 23:30:03,802: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-18T23:30:03.806524347Z [2024-06-18 23:30:03,805: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:30:03.831895998Z [2024-06-18 23:30:03,831: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T23:30:03.833124545Z [2024-06-18 23:30:03,832: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:30:03.833171366Z [2024-06-18 23:30:03,833: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:30:03.833231969Z [2024-06-18 23:30:03,833: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:30:03.833247358Z [2024-06-18 23:30:03,833: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-18T23:30:03.833521796Z [2024-06-18 23:30:03,833: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T23:30:03.833536617Z [2024-06-18 23:30:03,833: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:30:03.837570316Z [2024-06-18 23:30:03,837: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-06-18T23:30:03.840915708Z [2024-06-18 23:30:03,840: INFO/ForkPoolWorker-3] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:30:03.841395737Z [2024-06-18 23:30:03,841: INFO/ForkPoolWorker-3] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:30:03.841726279Z [2024-06-18 23:30:03,841: INFO/ForkPoolWorker-3] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:30:03.841946710Z [2024-06-18 23:30:03,841: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-06-18T23:30:03.842418129Z [2024-06-18 23:30:03,842: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-06-18T23:30:03.842857062Z [2024-06-18 23:30:03,842: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:30:03.929873786Z [2024-06-18 23:30:03,929: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:30:03.940684812Z [2024-06-18 23:30:03,940: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:30:04.048509504Z [2024-06-18 23:30:04,048: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T23:30:04.051987391Z [2024-06-18 23:30:04,051: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:30:04.068025970Z [2024-06-18 23:30:04,067: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T23:30:04.069301370Z [2024-06-18 23:30:04,069: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:30:04.069383050Z [2024-06-18 23:30:04,069: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:30:04.069539798Z [2024-06-18 23:30:04,069: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:30:04.069625582Z [2024-06-18 23:30:04,069: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T23:30:04.069838889Z [2024-06-18 23:30:04,069: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T23:30:04.069924156Z [2024-06-18 23:30:04,069: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:30:04.191003500Z [2024-06-18 23:30:04,190: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:30:04.861768845Z [2024-06-18 23:30:04,861: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[85965ff1-5575-44f1-bb40-05b5ddb30b2a] succeeded in 3.6169425999996747s: None 2024-06-18T23:30:05.066036631Z [2024-06-18 23:30:05,065: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4ea76c2c-c353-40ed-9187-9a2d605434fc] received 2024-06-18T23:30:05.074965561Z [2024-06-18 23:30:05,074: INFO/ForkPoolWorker-15] [4ea76c2c-c353-40ed-9187-9a2d605434fc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'split_metrics', 'scheduled__2024-06-18T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-18T23:30:05.376074406Z [2024-06-18 23:30:05,373: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T23:30:05.435259288Z [2024-06-18 23:30:05,434: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6ed706e6-bf79-4964-be53-968886523a6a] succeeded in 4.157520266000574s: None 2024-06-18T23:30:05.812108162Z [2024-06-18 23:30:05,811: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[227ff5f9-980d-4fb5-83a7-fab4b1564e68] succeeded in 4.494864079000763s: None 2024-06-18T23:30:06.520499236Z [2024-06-18 23:30:06,520: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T23:30:06.524216687Z [2024-06-18 23:30:06,523: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:30:06.548810794Z [2024-06-18 23:30:06,548: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T23:30:06.550375183Z [2024-06-18 23:30:06,550: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:30:06.550597563Z [2024-06-18 23:30:06,550: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:30:06.550709267Z [2024-06-18 23:30:06,550: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:30:06.550823273Z [2024-06-18 23:30:06,550: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T23:30:06.551181999Z [2024-06-18 23:30:06,551: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T23:30:06.551336389Z [2024-06-18 23:30:06,551: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:30:06.675255199Z [2024-06-18 23:30:06,674: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:30:07.353005555Z [2024-06-18 23:30:07,352: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4ea76c2c-c353-40ed-9187-9a2d605434fc] succeeded in 2.2840690709999762s: None 2024-06-18T23:30:07.523274434Z [2024-06-18 23:30:07,523: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5ca89a13-080d-4780-94ea-129d50ed024b] received 2024-06-18T23:30:07.536448649Z [2024-06-18 23:30:07,536: INFO/ForkPoolWorker-15] [5ca89a13-080d-4780-94ea-129d50ed024b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'collect_metrics', 'scheduled__2024-06-18T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-18T23:30:07.892000498Z [2024-06-18 23:30:07,886: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T23:30:08.982317757Z [2024-06-18 23:30:08,981: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T23:30:08.985506624Z [2024-06-18 23:30:08,985: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:30:09.016809319Z [2024-06-18 23:30:09,016: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T23:30:09.019583330Z [2024-06-18 23:30:09,019: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:30:09.019898295Z [2024-06-18 23:30:09,019: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:30:09.020213781Z [2024-06-18 23:30:09,019: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:30:09.020379315Z [2024-06-18 23:30:09,020: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T23:30:09.020866417Z [2024-06-18 23:30:09,020: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T23:30:09.021128992Z [2024-06-18 23:30:09,020: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:30:09.125831992Z [2024-06-18 23:30:09,125: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:30:09.777609696Z [2024-06-18 23:30:09,776: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5ca89a13-080d-4780-94ea-129d50ed024b] succeeded in 2.2517984109999816s: None 2024-06-18T23:30:09.874102358Z [2024-06-18 23:30:09,873: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[77568ccd-9506-48a9-a51e-72813185cd2d] received 2024-06-18T23:30:09.883960802Z [2024-06-18 23:30:09,882: INFO/ForkPoolWorker-15] [77568ccd-9506-48a9-a51e-72813185cd2d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'send_prometheus', 'scheduled__2024-06-18T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-18T23:30:10.184925353Z [2024-06-18 23:30:10,181: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T23:30:11.237418474Z [2024-06-18 23:30:11,237: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T23:30:11.240857419Z [2024-06-18 23:30:11,240: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:30:11.259576017Z [2024-06-18 23:30:11,259: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T23:30:11.261085711Z [2024-06-18 23:30:11,260: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:30:11.261114999Z [2024-06-18 23:30:11,260: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:30:11.261251026Z [2024-06-18 23:30:11,261: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:30:11.261266886Z [2024-06-18 23:30:11,261: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T23:30:11.261517050Z [2024-06-18 23:30:11,261: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T23:30:11.261542821Z [2024-06-18 23:30:11,261: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:30:11.370063488Z [2024-06-18 23:30:11,369: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:30:12.094361232Z [2024-06-18 23:30:12,093: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[77568ccd-9506-48a9-a51e-72813185cd2d] succeeded in 2.21762690200012s: None 2024-06-18T23:31:00.433510662Z [2024-06-18 23:31:00,432: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1149a31e-9c77-4009-9a1f-5c584a7bdbe9] received 2024-06-18T23:31:00.466395550Z [2024-06-18 23:31:00,465: INFO/ForkPoolWorker-15] [1149a31e-9c77-4009-9a1f-5c584a7bdbe9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T23:31:00.475059845Z [2024-06-18 23:31:00,474: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2f6f14ae-00d0-43e9-9a75-1bdb98d81fb8] received 2024-06-18T23:31:00.476659912Z [2024-06-18 23:31:00,476: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d3e71c71-1e0c-41df-a700-f63f9b1b59b8] received 2024-06-18T23:31:00.510601371Z [2024-06-18 23:31:00,509: INFO/ForkPoolWorker-1] [d3e71c71-1e0c-41df-a700-f63f9b1b59b8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T23:31:00.521440274Z [2024-06-18 23:31:00,520: INFO/ForkPoolWorker-16] [2f6f14ae-00d0-43e9-9a75-1bdb98d81fb8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T23:31:00.866832718Z [2024-06-18 23:31:00,862: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T23:31:00.924156002Z [2024-06-18 23:31:00,918: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T23:31:00.944320492Z [2024-06-18 23:31:00,934: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T23:31:01.043157520Z [2024-06-18 23:31:01,042: INFO/ForkPoolWorker-15] Getting SDNC list 2024-06-18T23:31:01.047010368Z [2024-06-18 23:31:01,046: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:31:01.064723498Z [2024-06-18 23:31:01,064: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T23:31:01.065707522Z [2024-06-18 23:31:01,065: INFO/ForkPoolWorker-15] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T23:31:01.065762621Z [2024-06-18 23:31:01,065: INFO/ForkPoolWorker-15] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T23:31:01.065829530Z [2024-06-18 23:31:01,065: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-06-18T23:31:01.066392136Z [2024-06-18 23:31:01,066: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T23:31:01.157910669Z [2024-06-18 23:31:01,157: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:31:01.876874653Z [2024-06-18 23:31:01,876: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1149a31e-9c77-4009-9a1f-5c584a7bdbe9] succeeded in 1.4314009070003522s: None 2024-06-18T23:31:02.188800953Z [2024-06-18 23:31:02,188: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-18T23:31:02.192219939Z [2024-06-18 23:31:02,191: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:31:02.271795333Z [2024-06-18 23:31:02,271: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T23:31:02.276020243Z [2024-06-18 23:31:02,275: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:31:02.276171251Z [2024-06-18 23:31:02,275: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:31:02.276350495Z [2024-06-18 23:31:02,276: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:31:02.276475737Z [2024-06-18 23:31:02,276: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-18T23:31:02.276827381Z [2024-06-18 23:31:02,276: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-18T23:31:02.276960344Z [2024-06-18 23:31:02,276: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:31:02.404053041Z [2024-06-18 23:31:02,403: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:31:02.425183614Z [2024-06-18 23:31:02,424: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-18T23:31:02.429067553Z [2024-06-18 23:31:02,428: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:31:02.456498829Z [2024-06-18 23:31:02,456: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T23:31:02.459866577Z [2024-06-18 23:31:02,459: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:31:02.460030883Z [2024-06-18 23:31:02,459: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:31:02.460206547Z [2024-06-18 23:31:02,460: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:31:02.460294362Z [2024-06-18 23:31:02,460: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-18T23:31:02.460718397Z [2024-06-18 23:31:02,460: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T23:31:02.460823171Z [2024-06-18 23:31:02,460: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:31:02.581435146Z [2024-06-18 23:31:02,581: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:31:04.316963367Z [2024-06-18 23:31:04,316: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d3e71c71-1e0c-41df-a700-f63f9b1b59b8] succeeded in 3.824347241000396s: None 2024-06-18T23:31:04.368333832Z [2024-06-18 23:31:04,367: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2f6f14ae-00d0-43e9-9a75-1bdb98d81fb8] succeeded in 3.8863115759995708s: None 2024-06-18T23:32:00.345218162Z [2024-06-18 23:32:00,344: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5ff610fd-42a9-49a8-9865-544f10c58f5d] received 2024-06-18T23:32:00.348022023Z [2024-06-18 23:32:00,347: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c677fdeb-4c51-4cf7-baee-4678c1ace54b] received 2024-06-18T23:32:00.360547608Z [2024-06-18 23:32:00,360: INFO/ForkPoolWorker-15] [5ff610fd-42a9-49a8-9865-544f10c58f5d] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-18T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-18T23:32:00.365343979Z [2024-06-18 23:32:00,365: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[03e0097c-5a65-4d58-9bda-442d8ce2cdf8] received 2024-06-18T23:32:00.365533243Z [2024-06-18 23:32:00,365: INFO/ForkPoolWorker-16] [c677fdeb-4c51-4cf7-baee-4678c1ace54b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T23:32:00.370717535Z [2024-06-18 23:32:00,370: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[97579b96-5322-41f5-8a02-c0b65e566e9b] received 2024-06-18T23:32:00.391100343Z [2024-06-18 23:32:00,390: INFO/ForkPoolWorker-1] [03e0097c-5a65-4d58-9bda-442d8ce2cdf8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T23:32:00.395374577Z [2024-06-18 23:32:00,394: INFO/ForkPoolWorker-2] [97579b96-5322-41f5-8a02-c0b65e566e9b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T23:32:00.728969111Z [2024-06-18 23:32:00,724: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T23:32:00.761736809Z [2024-06-18 23:32:00,756: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T23:32:00.797905686Z [2024-06-18 23:32:00,793: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-18T23:32:00.810751319Z [2024-06-18 23:32:00,807: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T23:32:00.895831913Z [2024-06-18 23:32:00,895: INFO/ForkPoolWorker-2] Getting SDNC list 2024-06-18T23:32:00.900299201Z [2024-06-18 23:32:00,899: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:32:00.932172154Z [2024-06-18 23:32:00,931: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-18T23:32:00.933224387Z [2024-06-18 23:32:00,933: INFO/ForkPoolWorker-2] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T23:32:00.933460065Z [2024-06-18 23:32:00,933: INFO/ForkPoolWorker-2] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T23:32:00.933759292Z [2024-06-18 23:32:00,933: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-06-18T23:32:00.934238585Z [2024-06-18 23:32:00,933: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T23:32:01.069577171Z [2024-06-18 23:32:01,069: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:32:01.085119175Z [2024-06-18 23:32:01,084: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:32:01.652308844Z [2024-06-18 23:32:01,651: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5ff610fd-42a9-49a8-9865-544f10c58f5d] succeeded in 1.302518630999657s: None 2024-06-18T23:32:01.795542633Z [2024-06-18 23:32:01,795: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[97579b96-5322-41f5-8a02-c0b65e566e9b] succeeded in 1.4152901669995117s: None 2024-06-18T23:32:02.274705820Z [2024-06-18 23:32:02,269: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-18T23:32:02.274741154Z [2024-06-18 23:32:02,272: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:32:02.300413518Z [2024-06-18 23:32:02,300: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-18T23:32:02.303746185Z [2024-06-18 23:32:02,303: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:32:02.377447350Z [2024-06-18 23:32:02,377: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T23:32:02.384589063Z [2024-06-18 23:32:02,384: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:32:02.384700167Z [2024-06-18 23:32:02,384: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:32:02.384883841Z [2024-06-18 23:32:02,384: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:32:02.384940214Z [2024-06-18 23:32:02,384: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-18T23:32:02.385308446Z [2024-06-18 23:32:02,385: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-18T23:32:02.385440286Z [2024-06-18 23:32:02,385: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:32:02.386876249Z [2024-06-18 23:32:02,386: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T23:32:02.388260609Z [2024-06-18 23:32:02,388: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:32:02.388278074Z [2024-06-18 23:32:02,388: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:32:02.388411712Z [2024-06-18 23:32:02,388: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:32:02.388440077Z [2024-06-18 23:32:02,388: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-18T23:32:02.388680115Z [2024-06-18 23:32:02,388: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T23:32:02.388718810Z [2024-06-18 23:32:02,388: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:32:02.467167478Z [2024-06-18 23:32:02,466: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:32:02.483724825Z [2024-06-18 23:32:02,483: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:32:04.086952816Z [2024-06-18 23:32:04,084: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[03e0097c-5a65-4d58-9bda-442d8ce2cdf8] succeeded in 3.7048931600002106s: None 2024-06-18T23:32:04.309497300Z [2024-06-18 23:32:04,309: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c677fdeb-4c51-4cf7-baee-4678c1ace54b] succeeded in 3.9594418220003718s: None 2024-06-18T23:33:00.255848077Z [2024-06-18 23:33:00,255: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dd82ad4e-0fcd-4a9b-9c06-032dd6084c2a] received 2024-06-18T23:33:00.264309935Z [2024-06-18 23:33:00,264: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6a21bcde-f3f4-412b-a310-d79b04f6ef54] received 2024-06-18T23:33:00.265862935Z [2024-06-18 23:33:00,265: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c3a54dc5-2bca-427e-b5e2-8227ab89cceb] received 2024-06-18T23:33:00.280312289Z [2024-06-18 23:33:00,279: INFO/ForkPoolWorker-15] [dd82ad4e-0fcd-4a9b-9c06-032dd6084c2a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T23:33:00.284777327Z [2024-06-18 23:33:00,284: INFO/ForkPoolWorker-16] [6a21bcde-f3f4-412b-a310-d79b04f6ef54] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T23:33:00.285173865Z [2024-06-18 23:33:00,284: INFO/ForkPoolWorker-1] [c3a54dc5-2bca-427e-b5e2-8227ab89cceb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T23:33:00.718498155Z [2024-06-18 23:33:00,714: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T23:33:00.738656899Z [2024-06-18 23:33:00,734: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T23:33:00.740423621Z [2024-06-18 23:33:00,735: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T23:33:01.013758892Z [2024-06-18 23:33:01,013: INFO/ForkPoolWorker-15] Getting SDNC list 2024-06-18T23:33:01.018497555Z [2024-06-18 23:33:01,017: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:33:01.064743332Z [2024-06-18 23:33:01,064: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T23:33:01.067055649Z [2024-06-18 23:33:01,066: INFO/ForkPoolWorker-15] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T23:33:01.067444562Z [2024-06-18 23:33:01,067: INFO/ForkPoolWorker-15] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T23:33:01.067791787Z [2024-06-18 23:33:01,067: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-06-18T23:33:01.068522000Z [2024-06-18 23:33:01,068: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T23:33:01.236066659Z [2024-06-18 23:33:01,235: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:33:01.970366084Z [2024-06-18 23:33:01,969: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-18T23:33:01.971972790Z [2024-06-18 23:33:01,971: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[dd82ad4e-0fcd-4a9b-9c06-032dd6084c2a] succeeded in 1.712986589999673s: None 2024-06-18T23:33:01.973604611Z [2024-06-18 23:33:01,973: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:33:01.996593361Z [2024-06-18 23:33:01,996: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T23:33:01.997956359Z [2024-06-18 23:33:01,997: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:33:01.997994246Z [2024-06-18 23:33:01,997: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:33:01.998187868Z [2024-06-18 23:33:01,997: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:33:01.998229620Z [2024-06-18 23:33:01,998: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-18T23:33:01.998556199Z [2024-06-18 23:33:01,998: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-06-18T23:33:01.998643735Z [2024-06-18 23:33:01,998: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:33:02.079513798Z [2024-06-18 23:33:02,079: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-18T23:33:02.080998702Z [2024-06-18 23:33:02,080: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:33:02.082645631Z [2024-06-18 23:33:02,082: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:33:02.106653236Z [2024-06-18 23:33:02,106: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T23:33:02.108242645Z [2024-06-18 23:33:02,107: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:33:02.108273696Z [2024-06-18 23:33:02,108: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:33:02.108503429Z [2024-06-18 23:33:02,108: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:33:02.108571907Z [2024-06-18 23:33:02,108: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-18T23:33:02.108933553Z [2024-06-18 23:33:02,108: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T23:33:02.108948100Z [2024-06-18 23:33:02,108: INFO/ForkPoolWorker-16] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:33:02.224704928Z [2024-06-18 23:33:02,221: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:33:03.998056104Z [2024-06-18 23:33:03,997: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c3a54dc5-2bca-427e-b5e2-8227ab89cceb] succeeded in 3.728298203000122s: None 2024-06-18T23:33:04.228879326Z [2024-06-18 23:33:04,228: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6a21bcde-f3f4-412b-a310-d79b04f6ef54] succeeded in 3.960061216000213s: None 2024-06-18T23:34:01.339464305Z [2024-06-18 23:34:01,338: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1634ab6d-88b5-42f8-b36c-f5671e8e89a0] received 2024-06-18T23:34:01.344365652Z [2024-06-18 23:34:01,343: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d012c7d6-1698-4771-b4c0-6eca818d97a5] received 2024-06-18T23:34:01.351977231Z [2024-06-18 23:34:01,351: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9077232a-263a-4372-bb01-2126028d1ea7] received 2024-06-18T23:34:01.362156334Z [2024-06-18 23:34:01,361: INFO/ForkPoolWorker-15] [1634ab6d-88b5-42f8-b36c-f5671e8e89a0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T23:34:01.364231742Z [2024-06-18 23:34:01,364: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ac946efb-2c54-400a-a24e-9cd85fe01bdd] received 2024-06-18T23:34:01.371210508Z [2024-06-18 23:34:01,370: INFO/ForkPoolWorker-1] [9077232a-263a-4372-bb01-2126028d1ea7] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-18T23:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-18T23:34:01.374697614Z [2024-06-18 23:34:01,374: INFO/ForkPoolWorker-16] [d012c7d6-1698-4771-b4c0-6eca818d97a5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T23:34:01.387544259Z [2024-06-18 23:34:01,387: INFO/ForkPoolWorker-2] [ac946efb-2c54-400a-a24e-9cd85fe01bdd] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T23:34:01.748860867Z [2024-06-18 23:34:01,744: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T23:34:01.857252926Z [2024-06-18 23:34:01,853: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T23:34:01.906719228Z [2024-06-18 23:34:01,898: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T23:34:01.926904451Z [2024-06-18 23:34:01,919: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-18T23:34:02.088274890Z [2024-06-18 23:34:02,087: INFO/ForkPoolWorker-2] Getting SDNC list 2024-06-18T23:34:02.092804822Z [2024-06-18 23:34:02,092: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:34:02.137363482Z [2024-06-18 23:34:02,137: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-18T23:34:02.140825172Z [2024-06-18 23:34:02,140: INFO/ForkPoolWorker-2] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T23:34:02.141130881Z [2024-06-18 23:34:02,140: INFO/ForkPoolWorker-2] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T23:34:02.141333893Z [2024-06-18 23:34:02,141: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-06-18T23:34:02.141688135Z [2024-06-18 23:34:02,141: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T23:34:02.305771111Z [2024-06-18 23:34:02,305: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:34:02.339236741Z [2024-06-18 23:34:02,338: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:34:03.012797741Z [2024-06-18 23:34:03,012: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[ac946efb-2c54-400a-a24e-9cd85fe01bdd] succeeded in 1.6427219059996787s: None 2024-06-18T23:34:03.019209548Z [2024-06-18 23:34:03,018: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9077232a-263a-4372-bb01-2126028d1ea7] succeeded in 1.6618418440002642s: None 2024-06-18T23:34:03.222140172Z [2024-06-18 23:34:03,221: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-18T23:34:03.225446917Z [2024-06-18 23:34:03,224: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:34:03.249886570Z [2024-06-18 23:34:03,249: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T23:34:03.251508863Z [2024-06-18 23:34:03,251: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:34:03.251567502Z [2024-06-18 23:34:03,251: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:34:03.251829735Z [2024-06-18 23:34:03,251: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:34:03.251912614Z [2024-06-18 23:34:03,251: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-18T23:34:03.252277287Z [2024-06-18 23:34:03,252: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-18T23:34:03.252395654Z [2024-06-18 23:34:03,252: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:34:03.365094333Z [2024-06-18 23:34:03,364: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:34:03.422496530Z [2024-06-18 23:34:03,422: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T23:34:03.426147639Z [2024-06-18 23:34:03,425: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:34:03.450628041Z [2024-06-18 23:34:03,450: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T23:34:03.452813929Z [2024-06-18 23:34:03,452: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:34:03.452924628Z [2024-06-18 23:34:03,452: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:34:03.453105877Z [2024-06-18 23:34:03,452: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:34:03.453172666Z [2024-06-18 23:34:03,453: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T23:34:03.453543528Z [2024-06-18 23:34:03,453: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T23:34:03.453574296Z [2024-06-18 23:34:03,453: INFO/ForkPoolWorker-15] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:34:03.541830385Z [2024-06-18 23:34:03,541: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:34:05.356031573Z [2024-06-18 23:34:05,355: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1634ab6d-88b5-42f8-b36c-f5671e8e89a0] succeeded in 4.011523073000717s: None 2024-06-18T23:34:05.465711994Z [2024-06-18 23:34:05,464: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d012c7d6-1698-4771-b4c0-6eca818d97a5] succeeded in 4.11591597000006s: None 2024-06-18T23:35:00.400832916Z [2024-06-18 23:35:00,400: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d6ef8f7d-0247-4e7a-956f-2d1aec7ec838] received 2024-06-18T23:35:00.411748691Z [2024-06-18 23:35:00,411: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[685a3492-b82d-4037-87c4-bf0069034f24] received 2024-06-18T23:35:00.419822279Z [2024-06-18 23:35:00,419: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ce51ab07-9e4b-4549-8c3d-407c37f61dd9] received 2024-06-18T23:35:00.436434356Z [2024-06-18 23:35:00,436: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[05359fad-b5b9-4e4e-950b-c19ce36122bf] received 2024-06-18T23:35:00.437181883Z [2024-06-18 23:35:00,436: INFO/ForkPoolWorker-15] [d6ef8f7d-0247-4e7a-956f-2d1aec7ec838] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-18T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-18T23:35:00.437972764Z [2024-06-18 23:35:00,436: INFO/ForkPoolWorker-1] [ce51ab07-9e4b-4549-8c3d-407c37f61dd9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T23:35:00.443361868Z [2024-06-18 23:35:00,442: INFO/ForkPoolWorker-16] [685a3492-b82d-4037-87c4-bf0069034f24] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T23:35:00.485447797Z [2024-06-18 23:35:00,485: INFO/ForkPoolWorker-2] [05359fad-b5b9-4e4e-950b-c19ce36122bf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T23:35:01.019932093Z [2024-06-18 23:35:00,997: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T23:35:01.101169825Z [2024-06-18 23:35:01,096: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T23:35:01.128542453Z [2024-06-18 23:35:01,124: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T23:35:01.290755212Z [2024-06-18 23:35:01,283: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T23:35:01.582935064Z [2024-06-18 23:35:01,582: INFO/ForkPoolWorker-16] Getting SDNC list 2024-06-18T23:35:01.587521875Z [2024-06-18 23:35:01,587: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:35:01.683593853Z [2024-06-18 23:35:01,683: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T23:35:01.685295108Z [2024-06-18 23:35:01,685: INFO/ForkPoolWorker-16] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T23:35:01.685477549Z [2024-06-18 23:35:01,685: INFO/ForkPoolWorker-16] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T23:35:01.685565062Z [2024-06-18 23:35:01,685: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-06-18T23:35:01.685870704Z [2024-06-18 23:35:01,685: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T23:35:01.955838543Z [2024-06-18 23:35:01,955: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:35:03.077277575Z [2024-06-18 23:35:03,076: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[685a3492-b82d-4037-87c4-bf0069034f24] succeeded in 2.6617768659998546s: None 2024-06-18T23:35:03.514321258Z [2024-06-18 23:35:03,513: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T23:35:03.522618138Z [2024-06-18 23:35:03,522: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:35:03.548331807Z [2024-06-18 23:35:03,548: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T23:35:03.550609364Z [2024-06-18 23:35:03,550: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:35:03.551077904Z [2024-06-18 23:35:03,550: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:35:03.551289609Z [2024-06-18 23:35:03,551: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:35:03.551435519Z [2024-06-18 23:35:03,551: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T23:35:03.552023025Z [2024-06-18 23:35:03,551: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T23:35:03.552089993Z [2024-06-18 23:35:03,551: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:35:03.710221590Z [2024-06-18 23:35:03,709: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:35:03.812295791Z [2024-06-18 23:35:03,811: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-18T23:35:03.815976427Z [2024-06-18 23:35:03,815: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:35:03.848482218Z [2024-06-18 23:35:03,848: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-18T23:35:03.849687246Z [2024-06-18 23:35:03,849: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:35:03.849776783Z [2024-06-18 23:35:03,849: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:35:03.849950578Z [2024-06-18 23:35:03,849: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:35:03.850099895Z [2024-06-18 23:35:03,849: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-18T23:35:03.850534605Z [2024-06-18 23:35:03,850: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-06-18T23:35:03.850683534Z [2024-06-18 23:35:03,850: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:35:03.859434304Z [2024-06-18 23:35:03,859: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-18T23:35:03.867238391Z [2024-06-18 23:35:03,866: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:35:03.897638721Z [2024-06-18 23:35:03,897: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T23:35:03.908055748Z [2024-06-18 23:35:03,907: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:35:03.908329857Z [2024-06-18 23:35:03,908: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:35:03.908841826Z [2024-06-18 23:35:03,908: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:35:03.909007061Z [2024-06-18 23:35:03,908: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-18T23:35:03.909344546Z [2024-06-18 23:35:03,909: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T23:35:03.909534868Z [2024-06-18 23:35:03,909: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:35:03.997543840Z [2024-06-18 23:35:03,997: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:35:04.029150352Z [2024-06-18 23:35:04,028: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:35:04.796143389Z [2024-06-18 23:35:04,795: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d6ef8f7d-0247-4e7a-956f-2d1aec7ec838] succeeded in 4.390693758999987s: None 2024-06-18T23:35:04.910735402Z [2024-06-18 23:35:04,910: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[adb3f6bd-2c23-4953-86ad-05bd06482a6b] received 2024-06-18T23:35:04.933664288Z [2024-06-18 23:35:04,933: INFO/ForkPoolWorker-15] [adb3f6bd-2c23-4953-86ad-05bd06482a6b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'split_metrics', 'scheduled__2024-06-18T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-18T23:35:05.244667420Z [2024-06-18 23:35:05,241: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T23:35:05.865368730Z [2024-06-18 23:35:05,864: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ce51ab07-9e4b-4549-8c3d-407c37f61dd9] succeeded in 5.443090116000349s: None 2024-06-18T23:35:06.200751487Z [2024-06-18 23:35:06,200: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[05359fad-b5b9-4e4e-950b-c19ce36122bf] succeeded in 5.761044541999581s: None 2024-06-18T23:35:06.683219344Z [2024-06-18 23:35:06,682: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T23:35:06.686484458Z [2024-06-18 23:35:06,686: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:35:06.712375769Z [2024-06-18 23:35:06,712: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T23:35:06.717408935Z [2024-06-18 23:35:06,717: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:35:06.717433781Z [2024-06-18 23:35:06,717: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:35:06.717510037Z [2024-06-18 23:35:06,717: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:35:06.717519862Z [2024-06-18 23:35:06,717: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T23:35:06.717850043Z [2024-06-18 23:35:06,717: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T23:35:06.717873942Z [2024-06-18 23:35:06,717: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:35:06.799730040Z [2024-06-18 23:35:06,799: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:35:07.658594332Z [2024-06-18 23:35:07,658: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[adb3f6bd-2c23-4953-86ad-05bd06482a6b] succeeded in 2.7454991120002887s: None 2024-06-18T23:35:08.441427489Z [2024-06-18 23:35:08,441: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a5868d8a-5194-435a-8c62-1c106894904b] received 2024-06-18T23:35:08.455739725Z [2024-06-18 23:35:08,455: INFO/ForkPoolWorker-15] [a5868d8a-5194-435a-8c62-1c106894904b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'collect_metrics', 'scheduled__2024-06-18T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-18T23:35:08.825186720Z [2024-06-18 23:35:08,821: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T23:35:10.292217656Z [2024-06-18 23:35:10,291: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T23:35:10.296712747Z [2024-06-18 23:35:10,296: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:35:10.321171412Z [2024-06-18 23:35:10,320: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T23:35:10.323817768Z [2024-06-18 23:35:10,323: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:35:10.324026731Z [2024-06-18 23:35:10,323: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:35:10.324166843Z [2024-06-18 23:35:10,324: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:35:10.324233143Z [2024-06-18 23:35:10,324: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T23:35:10.324512504Z [2024-06-18 23:35:10,324: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T23:35:10.324578346Z [2024-06-18 23:35:10,324: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:35:10.438805603Z [2024-06-18 23:35:10,438: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:35:10.979727359Z [2024-06-18 23:35:10,979: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bc8280f7-de4d-4c8a-9c74-b526f38f5832] received 2024-06-18T23:35:10.998240587Z [2024-06-18 23:35:10,997: INFO/ForkPoolWorker-16] [bc8280f7-de4d-4c8a-9c74-b526f38f5832] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'send_prometheus', 'scheduled__2024-06-18T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-18T23:35:11.118283463Z [2024-06-18 23:35:11,117: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a5868d8a-5194-435a-8c62-1c106894904b] succeeded in 2.672801355000047s: None 2024-06-18T23:35:11.396052785Z [2024-06-18 23:35:11,392: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T23:35:12.825655349Z [2024-06-18 23:35:12,825: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-18T23:35:12.829590962Z [2024-06-18 23:35:12,829: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:35:12.854799411Z [2024-06-18 23:35:12,854: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T23:35:12.856644019Z [2024-06-18 23:35:12,856: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:35:12.856658874Z [2024-06-18 23:35:12,856: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:35:12.856957492Z [2024-06-18 23:35:12,856: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:35:12.859956635Z [2024-06-18 23:35:12,856: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-18T23:35:12.860340249Z [2024-06-18 23:35:12,860: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T23:35:12.860488086Z [2024-06-18 23:35:12,860: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:35:13.039337440Z [2024-06-18 23:35:13,034: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:35:13.828562061Z [2024-06-18 23:35:13,828: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[bc8280f7-de4d-4c8a-9c74-b526f38f5832] succeeded in 2.83838349799953s: None 2024-06-18T23:36:01.294246210Z [2024-06-18 23:36:01,293: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[35d9554f-3335-4f0e-b030-65ebe85803d8] received 2024-06-18T23:36:01.297442849Z [2024-06-18 23:36:01,297: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ca0c4d8c-88ef-402e-a740-9a2bfd2ca6af] received 2024-06-18T23:36:01.302705615Z [2024-06-18 23:36:01,302: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[534c9eed-ae38-4e05-ab93-77601e7d8d6b] received 2024-06-18T23:36:01.312438339Z [2024-06-18 23:36:01,312: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d5077282-a634-4bae-8fb3-5f2d7871ac0a] received 2024-06-18T23:36:01.312550027Z [2024-06-18 23:36:01,312: INFO/ForkPoolWorker-16] [ca0c4d8c-88ef-402e-a740-9a2bfd2ca6af] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T23:36:01.323297507Z [2024-06-18 23:36:01,321: INFO/ForkPoolWorker-15] [35d9554f-3335-4f0e-b030-65ebe85803d8] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-18T23:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-18T23:36:01.331557716Z [2024-06-18 23:36:01,331: INFO/ForkPoolWorker-2] [d5077282-a634-4bae-8fb3-5f2d7871ac0a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T23:36:01.342140403Z [2024-06-18 23:36:01,341: INFO/ForkPoolWorker-1] [534c9eed-ae38-4e05-ab93-77601e7d8d6b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T23:36:01.661021767Z [2024-06-18 23:36:01,656: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T23:36:01.682301014Z [2024-06-18 23:36:01,676: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-18T23:36:01.688210069Z [2024-06-18 23:36:01,683: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T23:36:01.695723397Z [2024-06-18 23:36:01,691: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T23:36:01.917593332Z [2024-06-18 23:36:01,917: INFO/ForkPoolWorker-16] Getting SDNC list 2024-06-18T23:36:01.921875122Z [2024-06-18 23:36:01,921: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:36:01.965718789Z [2024-06-18 23:36:01,965: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T23:36:01.969586123Z [2024-06-18 23:36:01,969: INFO/ForkPoolWorker-16] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T23:36:01.970734676Z [2024-06-18 23:36:01,969: INFO/ForkPoolWorker-16] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T23:36:01.970900867Z [2024-06-18 23:36:01,970: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-06-18T23:36:01.971132006Z [2024-06-18 23:36:01,971: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T23:36:02.116153889Z [2024-06-18 23:36:02,115: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:36:02.119761892Z [2024-06-18 23:36:02,119: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:36:02.962275793Z [2024-06-18 23:36:02,961: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[35d9554f-3335-4f0e-b030-65ebe85803d8] succeeded in 1.662543272000221s: None 2024-06-18T23:36:02.963413622Z [2024-06-18 23:36:02,963: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ca0c4d8c-88ef-402e-a740-9a2bfd2ca6af] succeeded in 1.6639544079998814s: None 2024-06-18T23:36:03.364995285Z [2024-06-18 23:36:03,364: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-18T23:36:03.368703576Z [2024-06-18 23:36:03,368: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:36:03.402616333Z [2024-06-18 23:36:03,402: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T23:36:03.403793945Z [2024-06-18 23:36:03,403: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:36:03.403900866Z [2024-06-18 23:36:03,403: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:36:03.404056615Z [2024-06-18 23:36:03,403: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:36:03.404069231Z [2024-06-18 23:36:03,403: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-18T23:36:03.404781109Z [2024-06-18 23:36:03,404: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T23:36:03.404788303Z [2024-06-18 23:36:03,404: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:36:03.449568901Z [2024-06-18 23:36:03,449: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-18T23:36:03.452790079Z [2024-06-18 23:36:03,452: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:36:03.481501324Z [2024-06-18 23:36:03,481: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-18T23:36:03.482759063Z [2024-06-18 23:36:03,482: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:36:03.482776298Z [2024-06-18 23:36:03,482: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:36:03.482892621Z [2024-06-18 23:36:03,482: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:36:03.482966384Z [2024-06-18 23:36:03,482: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-18T23:36:03.483124812Z [2024-06-18 23:36:03,482: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-06-18T23:36:03.483136029Z [2024-06-18 23:36:03,483: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:36:03.489308709Z [2024-06-18 23:36:03,489: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:36:03.577829168Z [2024-06-18 23:36:03,577: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:36:05.197024367Z [2024-06-18 23:36:05,196: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[534c9eed-ae38-4e05-ab93-77601e7d8d6b] succeeded in 3.8838403020008627s: None 2024-06-18T23:36:05.515642904Z [2024-06-18 23:36:05,514: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d5077282-a634-4bae-8fb3-5f2d7871ac0a] succeeded in 4.197727578000013s: None 2024-06-18T23:37:01.341967223Z [2024-06-18 23:37:01,341: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[716029eb-7861-4769-8722-68b9b951c830] received 2024-06-18T23:37:01.344321536Z [2024-06-18 23:37:01,344: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c815b9f6-62a9-4489-b435-61575be91203] received 2024-06-18T23:37:01.345947774Z [2024-06-18 23:37:01,345: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d266cc8f-6111-44a9-ada6-9201d5e7195b] received 2024-06-18T23:37:01.356709752Z [2024-06-18 23:37:01,356: INFO/ForkPoolWorker-1] [d266cc8f-6111-44a9-ada6-9201d5e7195b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T23:37:01.361536550Z [2024-06-18 23:37:01,361: INFO/ForkPoolWorker-15] [716029eb-7861-4769-8722-68b9b951c830] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T23:37:01.363924769Z [2024-06-18 23:37:01,363: INFO/ForkPoolWorker-16] [c815b9f6-62a9-4489-b435-61575be91203] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T23:37:01.682205203Z [2024-06-18 23:37:01,678: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T23:37:01.690682429Z [2024-06-18 23:37:01,686: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T23:37:01.763112960Z [2024-06-18 23:37:01,759: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T23:37:01.856045171Z [2024-06-18 23:37:01,855: INFO/ForkPoolWorker-16] Getting SDNC list 2024-06-18T23:37:01.860375543Z [2024-06-18 23:37:01,859: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:37:01.898511859Z [2024-06-18 23:37:01,898: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T23:37:01.901592023Z [2024-06-18 23:37:01,901: INFO/ForkPoolWorker-16] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T23:37:01.901962886Z [2024-06-18 23:37:01,901: INFO/ForkPoolWorker-16] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T23:37:01.902031744Z [2024-06-18 23:37:01,901: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-06-18T23:37:01.902472935Z [2024-06-18 23:37:01,902: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T23:37:02.019762123Z [2024-06-18 23:37:02,019: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:37:02.663389403Z [2024-06-18 23:37:02,662: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c815b9f6-62a9-4489-b435-61575be91203] succeeded in 1.3156235549995472s: None 2024-06-18T23:37:03.051435664Z [2024-06-18 23:37:03,050: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-18T23:37:03.054968973Z [2024-06-18 23:37:03,054: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:37:03.084611686Z [2024-06-18 23:37:03,084: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T23:37:03.086272973Z [2024-06-18 23:37:03,085: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:37:03.086289561Z [2024-06-18 23:37:03,086: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:37:03.086367930Z [2024-06-18 23:37:03,086: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:37:03.086401819Z [2024-06-18 23:37:03,086: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-18T23:37:03.086638490Z [2024-06-18 23:37:03,086: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-06-18T23:37:03.086677946Z [2024-06-18 23:37:03,086: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:37:03.171655430Z [2024-06-18 23:37:03,171: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:37:03.200086019Z [2024-06-18 23:37:03,199: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T23:37:03.203774110Z [2024-06-18 23:37:03,203: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:37:03.222010816Z [2024-06-18 23:37:03,221: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T23:37:03.223312839Z [2024-06-18 23:37:03,223: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:37:03.223414367Z [2024-06-18 23:37:03,223: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:37:03.223602511Z [2024-06-18 23:37:03,223: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:37:03.223703938Z [2024-06-18 23:37:03,223: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T23:37:03.224106807Z [2024-06-18 23:37:03,223: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T23:37:03.224202592Z [2024-06-18 23:37:03,224: INFO/ForkPoolWorker-15] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:37:03.332633761Z [2024-06-18 23:37:03,332: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:37:05.293746468Z [2024-06-18 23:37:05,292: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[716029eb-7861-4769-8722-68b9b951c830] succeeded in 3.943969413000559s: None 2024-06-18T23:37:05.516603685Z [2024-06-18 23:37:05,515: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d266cc8f-6111-44a9-ada6-9201d5e7195b] succeeded in 4.1682955590003985s: None 2024-06-18T23:38:01.260379041Z [2024-06-18 23:38:01,258: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5cb7d80c-e595-4147-a336-091157aacd29] received 2024-06-18T23:38:01.264155744Z [2024-06-18 23:38:01,263: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1b9502a0-38d1-4a17-938a-3873f70e8f8f] received 2024-06-18T23:38:01.279677005Z [2024-06-18 23:38:01,278: INFO/ForkPoolWorker-15] [5cb7d80c-e595-4147-a336-091157aacd29] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-18T23:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-18T23:38:01.281908487Z [2024-06-18 23:38:01,281: INFO/ForkPoolWorker-16] [1b9502a0-38d1-4a17-938a-3873f70e8f8f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T23:38:01.285010511Z [2024-06-18 23:38:01,284: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[583dccfc-f8b7-4e39-94f0-7245fa60b2ee] received 2024-06-18T23:38:01.288216817Z [2024-06-18 23:38:01,287: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1657cba8-105b-43ca-855f-6f860a3265a8] received 2024-06-18T23:38:01.298034891Z [2024-06-18 23:38:01,297: INFO/ForkPoolWorker-1] [583dccfc-f8b7-4e39-94f0-7245fa60b2ee] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T23:38:01.300554015Z [2024-06-18 23:38:01,300: INFO/ForkPoolWorker-2] [1657cba8-105b-43ca-855f-6f860a3265a8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T23:38:01.604907818Z [2024-06-18 23:38:01,600: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T23:38:01.615554151Z [2024-06-18 23:38:01,610: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T23:38:01.630950116Z [2024-06-18 23:38:01,625: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-18T23:38:01.636972519Z [2024-06-18 23:38:01,632: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T23:38:01.796899816Z [2024-06-18 23:38:01,796: INFO/ForkPoolWorker-16] Getting SDNC list 2024-06-18T23:38:01.801271107Z [2024-06-18 23:38:01,800: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:38:01.853050002Z [2024-06-18 23:38:01,852: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T23:38:01.856481607Z [2024-06-18 23:38:01,856: INFO/ForkPoolWorker-16] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T23:38:01.856690611Z [2024-06-18 23:38:01,856: INFO/ForkPoolWorker-16] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T23:38:01.856753285Z [2024-06-18 23:38:01,856: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-06-18T23:38:01.857040671Z [2024-06-18 23:38:01,856: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T23:38:01.989998240Z [2024-06-18 23:38:01,989: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:38:02.069290341Z [2024-06-18 23:38:02,069: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:38:02.851432542Z [2024-06-18 23:38:02,851: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5cb7d80c-e595-4147-a336-091157aacd29] succeeded in 1.5882785240000885s: None 2024-06-18T23:38:02.958589380Z [2024-06-18 23:38:02,958: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1b9502a0-38d1-4a17-938a-3873f70e8f8f] succeeded in 1.6895297920000303s: None 2024-06-18T23:38:03.405577826Z [2024-06-18 23:38:03,405: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-18T23:38:03.408941620Z [2024-06-18 23:38:03,408: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:38:03.432167644Z [2024-06-18 23:38:03,431: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T23:38:03.433591532Z [2024-06-18 23:38:03,433: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:38:03.433608495Z [2024-06-18 23:38:03,433: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:38:03.434691489Z [2024-06-18 23:38:03,434: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:38:03.434794306Z [2024-06-18 23:38:03,434: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-18T23:38:03.435151314Z [2024-06-18 23:38:03,434: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-06-18T23:38:03.435214799Z [2024-06-18 23:38:03,435: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:38:03.465797276Z [2024-06-18 23:38:03,465: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-18T23:38:03.469139558Z [2024-06-18 23:38:03,468: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:38:03.493910525Z [2024-06-18 23:38:03,493: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-18T23:38:03.496173938Z [2024-06-18 23:38:03,495: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:38:03.496697426Z [2024-06-18 23:38:03,496: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:38:03.497588363Z [2024-06-18 23:38:03,497: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:38:03.497756391Z [2024-06-18 23:38:03,497: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-18T23:38:03.498130636Z [2024-06-18 23:38:03,497: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T23:38:03.498346437Z [2024-06-18 23:38:03,498: INFO/ForkPoolWorker-2] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:38:03.559192257Z [2024-06-18 23:38:03,558: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:38:03.598235941Z [2024-06-18 23:38:03,597: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:38:05.446138414Z [2024-06-18 23:38:05,445: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[1657cba8-105b-43ca-855f-6f860a3265a8] succeeded in 4.154343053000048s: None 2024-06-18T23:38:05.759759919Z [2024-06-18 23:38:05,759: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[583dccfc-f8b7-4e39-94f0-7245fa60b2ee] succeeded in 4.469489109000278s: None 2024-06-18T23:39:01.246818934Z [2024-06-18 23:39:01,246: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ad22fe3e-52dc-4840-a36f-6edb5d844d81] received 2024-06-18T23:39:01.253359636Z [2024-06-18 23:39:01,252: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b0bc55ea-8a17-46f8-87af-583a78efe5be] received 2024-06-18T23:39:01.256939146Z [2024-06-18 23:39:01,256: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ff1f8012-cf61-4369-af9e-d5a7b973421f] received 2024-06-18T23:39:01.268505406Z [2024-06-18 23:39:01,268: INFO/ForkPoolWorker-15] [ad22fe3e-52dc-4840-a36f-6edb5d844d81] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T23:39:01.270793963Z [2024-06-18 23:39:01,270: INFO/ForkPoolWorker-16] [b0bc55ea-8a17-46f8-87af-583a78efe5be] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T23:39:01.271334134Z [2024-06-18 23:39:01,270: INFO/ForkPoolWorker-1] [ff1f8012-cf61-4369-af9e-d5a7b973421f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T23:39:01.584236556Z [2024-06-18 23:39:01,580: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T23:39:01.584281029Z [2024-06-18 23:39:01,580: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T23:39:01.605834329Z [2024-06-18 23:39:01,602: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T23:39:01.753277807Z [2024-06-18 23:39:01,752: INFO/ForkPoolWorker-15] Getting SDNC list 2024-06-18T23:39:01.758861201Z [2024-06-18 23:39:01,758: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:39:01.793348409Z [2024-06-18 23:39:01,793: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T23:39:01.795218781Z [2024-06-18 23:39:01,794: INFO/ForkPoolWorker-15] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T23:39:01.795259624Z [2024-06-18 23:39:01,795: INFO/ForkPoolWorker-15] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T23:39:01.795403632Z [2024-06-18 23:39:01,795: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-06-18T23:39:01.795924886Z [2024-06-18 23:39:01,795: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T23:39:01.883524126Z [2024-06-18 23:39:01,883: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:39:02.544130845Z [2024-06-18 23:39:02,543: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ad22fe3e-52dc-4840-a36f-6edb5d844d81] succeeded in 1.2940175070007172s: None 2024-06-18T23:39:02.902187811Z [2024-06-18 23:39:02,901: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-18T23:39:02.905593965Z [2024-06-18 23:39:02,905: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:39:02.910388556Z [2024-06-18 23:39:02,909: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-18T23:39:02.913800057Z [2024-06-18 23:39:02,913: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:39:02.935296289Z [2024-06-18 23:39:02,935: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T23:39:02.935866075Z [2024-06-18 23:39:02,935: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T23:39:02.938825082Z [2024-06-18 23:39:02,938: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:39:02.938969958Z [2024-06-18 23:39:02,938: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:39:02.939168101Z [2024-06-18 23:39:02,938: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:39:02.939208852Z [2024-06-18 23:39:02,939: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:39:02.939284724Z [2024-06-18 23:39:02,939: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:39:02.939333843Z [2024-06-18 23:39:02,939: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-18T23:39:02.939381794Z [2024-06-18 23:39:02,939: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:39:02.939428463Z [2024-06-18 23:39:02,939: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-18T23:39:02.939763363Z [2024-06-18 23:39:02,939: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T23:39:02.939776040Z [2024-06-18 23:39:02,939: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:39:02.939912518Z [2024-06-18 23:39:02,939: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-18T23:39:02.940329750Z [2024-06-18 23:39:02,940: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:39:03.021719391Z [2024-06-18 23:39:03,021: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:39:03.039800403Z [2024-06-18 23:39:03,039: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:39:04.855324053Z [2024-06-18 23:39:04,854: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ff1f8012-cf61-4369-af9e-d5a7b973421f] succeeded in 3.595041741999921s: None 2024-06-18T23:39:05.143047469Z [2024-06-18 23:39:05,142: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b0bc55ea-8a17-46f8-87af-583a78efe5be] succeeded in 3.887091419999706s: None 2024-06-18T23:40:00.633224507Z [2024-06-18 23:40:00,632: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e9b31e47-9f01-4cc6-9949-92173f4bccfe] received 2024-06-18T23:40:00.639634205Z [2024-06-18 23:40:00,637: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[411e7c1f-d442-403f-95f8-93379c4add8d] received 2024-06-18T23:40:00.647178274Z [2024-06-18 23:40:00,646: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d16fc95e-a6d6-4174-9761-c7ba3a06bf76] received 2024-06-18T23:40:00.650780377Z [2024-06-18 23:40:00,650: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[58af80f0-f72c-4529-adae-6b66ab2d7332] received 2024-06-18T23:40:00.657322619Z [2024-06-18 23:40:00,656: INFO/ForkPoolWorker-15] [e9b31e47-9f01-4cc6-9949-92173f4bccfe] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T23:40:00.660344546Z [2024-06-18 23:40:00,659: INFO/ForkPoolWorker-16] [411e7c1f-d442-403f-95f8-93379c4add8d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-18T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-18T23:40:00.666683698Z [2024-06-18 23:40:00,666: INFO/ForkPoolWorker-1] [d16fc95e-a6d6-4174-9761-c7ba3a06bf76] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T23:40:00.668630979Z [2024-06-18 23:40:00,667: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[353a9e4f-fbb2-413f-a969-bff1449089e2] received 2024-06-18T23:40:00.681065516Z [2024-06-18 23:40:00,680: INFO/ForkPoolWorker-2] [58af80f0-f72c-4529-adae-6b66ab2d7332] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-18T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-18T23:40:00.699221256Z [2024-06-18 23:40:00,698: INFO/ForkPoolWorker-3] [353a9e4f-fbb2-413f-a969-bff1449089e2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T23:40:01.099805219Z [2024-06-18 23:40:01,094: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T23:40:01.392924050Z [2024-06-18 23:40:01,387: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T23:40:01.616407093Z [2024-06-18 23:40:01,610: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-18T23:40:01.666726663Z [2024-06-18 23:40:01,660: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T23:40:01.871406374Z [2024-06-18 23:40:01,848: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T23:40:01.935170110Z [2024-06-18 23:40:01,934: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:40:02.068449494Z [2024-06-18 23:40:02,065: INFO/ForkPoolWorker-15] Getting SDNC list 2024-06-18T23:40:02.080496484Z [2024-06-18 23:40:02,079: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:40:02.118391521Z [2024-06-18 23:40:02,118: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T23:40:02.124231849Z [2024-06-18 23:40:02,123: INFO/ForkPoolWorker-15] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T23:40:02.124292182Z [2024-06-18 23:40:02,124: INFO/ForkPoolWorker-15] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T23:40:02.124301893Z [2024-06-18 23:40:02,124: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-06-18T23:40:02.124531796Z [2024-06-18 23:40:02,124: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T23:40:02.369756280Z [2024-06-18 23:40:02,369: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:40:03.256384916Z [2024-06-18 23:40:03,255: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[58af80f0-f72c-4529-adae-6b66ab2d7332] succeeded in 2.591699311999946s: None 2024-06-18T23:40:03.931648437Z [2024-06-18 23:40:03,930: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e9b31e47-9f01-4cc6-9949-92173f4bccfe] succeeded in 3.2928397089999635s: None 2024-06-18T23:40:04.106800302Z [2024-06-18 23:40:04,106: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-18T23:40:04.112017405Z [2024-06-18 23:40:04,111: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:40:04.124868798Z [2024-06-18 23:40:04,122: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-18T23:40:04.142747300Z [2024-06-18 23:40:04,139: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:40:04.201307833Z [2024-06-18 23:40:04,201: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T23:40:04.208642871Z [2024-06-18 23:40:04,208: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:40:04.208670495Z [2024-06-18 23:40:04,208: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:40:04.208773265Z [2024-06-18 23:40:04,208: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:40:04.208823165Z [2024-06-18 23:40:04,208: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-18T23:40:04.209059723Z [2024-06-18 23:40:04,208: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T23:40:04.209071902Z [2024-06-18 23:40:04,209: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:40:04.221303250Z [2024-06-18 23:40:04,221: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T23:40:04.232113040Z [2024-06-18 23:40:04,231: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:40:04.234194937Z [2024-06-18 23:40:04,233: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:40:04.234253059Z [2024-06-18 23:40:04,234: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:40:04.234333775Z [2024-06-18 23:40:04,234: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-18T23:40:04.235083519Z [2024-06-18 23:40:04,234: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T23:40:04.235160055Z [2024-06-18 23:40:04,235: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:40:04.459098531Z [2024-06-18 23:40:04,458: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:40:04.464411006Z [2024-06-18 23:40:04,462: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:40:05.297708395Z [2024-06-18 23:40:05,297: INFO/ForkPoolWorker-3] Getting VIM list 2024-06-18T23:40:05.303964306Z [2024-06-18 23:40:05,303: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:40:05.340220377Z [2024-06-18 23:40:05,340: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-06-18T23:40:05.343318730Z [2024-06-18 23:40:05,343: INFO/ForkPoolWorker-3] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:40:05.343501267Z [2024-06-18 23:40:05,343: INFO/ForkPoolWorker-3] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:40:05.343765123Z [2024-06-18 23:40:05,343: INFO/ForkPoolWorker-3] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:40:05.343924680Z [2024-06-18 23:40:05,343: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-06-18T23:40:05.344250469Z [2024-06-18 23:40:05,344: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-06-18T23:40:05.345286413Z [2024-06-18 23:40:05,345: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:40:05.379450288Z [2024-06-18 23:40:05,379: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[411e7c1f-d442-403f-95f8-93379c4add8d] succeeded in 4.7338728880004055s: None 2024-06-18T23:40:05.442817748Z [2024-06-18 23:40:05,442: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:40:05.502571977Z [2024-06-18 23:40:05,502: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[33f66810-59a7-4674-8191-c0dc4e7d33bf] received 2024-06-18T23:40:05.510702268Z [2024-06-18 23:40:05,510: INFO/ForkPoolWorker-15] [33f66810-59a7-4674-8191-c0dc4e7d33bf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'split_metrics', 'scheduled__2024-06-18T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-18T23:40:06.257588166Z [2024-06-18 23:40:06,254: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T23:40:06.400637853Z [2024-06-18 23:40:06,400: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d16fc95e-a6d6-4174-9761-c7ba3a06bf76] succeeded in 5.746278464999705s: None 2024-06-18T23:40:07.903389991Z [2024-06-18 23:40:07,903: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T23:40:07.907638000Z [2024-06-18 23:40:07,906: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:40:07.916311841Z [2024-06-18 23:40:07,914: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[353a9e4f-fbb2-413f-a969-bff1449089e2] succeeded in 7.2340069159999985s: None 2024-06-18T23:40:07.945931166Z [2024-06-18 23:40:07,945: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T23:40:07.948517899Z [2024-06-18 23:40:07,946: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:40:07.948550952Z [2024-06-18 23:40:07,947: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:40:07.948582198Z [2024-06-18 23:40:07,947: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:40:07.948587540Z [2024-06-18 23:40:07,947: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T23:40:07.948590931Z [2024-06-18 23:40:07,947: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T23:40:07.948594250Z [2024-06-18 23:40:07,947: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:40:08.059198216Z [2024-06-18 23:40:08,058: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:40:08.819993004Z [2024-06-18 23:40:08,819: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[33f66810-59a7-4674-8191-c0dc4e7d33bf] succeeded in 3.3142845790007414s: None 2024-06-18T23:40:09.660667905Z [2024-06-18 23:40:09,660: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2d196e5a-c188-4d16-826f-9db0dc63aca6] received 2024-06-18T23:40:09.686920257Z [2024-06-18 23:40:09,686: INFO/ForkPoolWorker-15] [2d196e5a-c188-4d16-826f-9db0dc63aca6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'collect_metrics', 'scheduled__2024-06-18T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-18T23:40:10.017781492Z [2024-06-18 23:40:10,014: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T23:40:11.201047021Z [2024-06-18 23:40:11,200: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T23:40:11.204849927Z [2024-06-18 23:40:11,204: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:40:11.232180907Z [2024-06-18 23:40:11,231: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T23:40:11.244452144Z [2024-06-18 23:40:11,243: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:40:11.244498517Z [2024-06-18 23:40:11,244: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:40:11.244646550Z [2024-06-18 23:40:11,244: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:40:11.244817519Z [2024-06-18 23:40:11,244: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T23:40:11.245273575Z [2024-06-18 23:40:11,245: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T23:40:11.245299631Z [2024-06-18 23:40:11,245: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:40:11.363842909Z [2024-06-18 23:40:11,363: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:40:12.098292913Z [2024-06-18 23:40:12,097: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2d196e5a-c188-4d16-826f-9db0dc63aca6] succeeded in 2.4359708680003678s: None 2024-06-18T23:40:12.595505581Z [2024-06-18 23:40:12,594: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9759089d-995b-4e02-a18f-c562565c482b] received 2024-06-18T23:40:12.607046553Z [2024-06-18 23:40:12,606: INFO/ForkPoolWorker-15] [9759089d-995b-4e02-a18f-c562565c482b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'send_prometheus', 'scheduled__2024-06-18T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-18T23:40:12.939319579Z [2024-06-18 23:40:12,936: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T23:40:14.145235640Z [2024-06-18 23:40:14,143: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T23:40:14.148075807Z [2024-06-18 23:40:14,147: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:40:14.195595359Z [2024-06-18 23:40:14,195: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T23:40:14.197516279Z [2024-06-18 23:40:14,197: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:40:14.197798302Z [2024-06-18 23:40:14,197: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:40:14.198435770Z [2024-06-18 23:40:14,197: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:40:14.198444497Z [2024-06-18 23:40:14,198: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T23:40:14.198640923Z [2024-06-18 23:40:14,198: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T23:40:14.198788848Z [2024-06-18 23:40:14,198: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:40:14.292801300Z [2024-06-18 23:40:14,292: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:40:15.022747091Z [2024-06-18 23:40:15,022: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9759089d-995b-4e02-a18f-c562565c482b] succeeded in 2.4227891209993686s: None 2024-06-18T23:41:01.266862155Z [2024-06-18 23:41:01,266: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[014971c5-eeda-44f4-834c-9c3ec8109c44] received 2024-06-18T23:41:01.274225128Z [2024-06-18 23:41:01,273: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2ffd66cb-d779-457d-83d1-6a3654b6d95a] received 2024-06-18T23:41:01.275928446Z [2024-06-18 23:41:01,275: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0ed2a359-ed3a-41db-979d-23f847c392b0] received 2024-06-18T23:41:01.288720187Z [2024-06-18 23:41:01,288: INFO/ForkPoolWorker-15] [014971c5-eeda-44f4-834c-9c3ec8109c44] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T23:41:01.291154762Z [2024-06-18 23:41:01,290: INFO/ForkPoolWorker-16] [2ffd66cb-d779-457d-83d1-6a3654b6d95a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T23:41:01.298153023Z [2024-06-18 23:41:01,297: INFO/ForkPoolWorker-1] [0ed2a359-ed3a-41db-979d-23f847c392b0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T23:41:01.673334338Z [2024-06-18 23:41:01,666: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T23:41:01.682730667Z [2024-06-18 23:41:01,669: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T23:41:01.714684889Z [2024-06-18 23:41:01,710: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T23:41:01.876447638Z [2024-06-18 23:41:01,875: INFO/ForkPoolWorker-16] Getting SDNC list 2024-06-18T23:41:01.880501207Z [2024-06-18 23:41:01,879: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:41:01.948623397Z [2024-06-18 23:41:01,948: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T23:41:01.949729963Z [2024-06-18 23:41:01,949: INFO/ForkPoolWorker-16] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T23:41:01.949785142Z [2024-06-18 23:41:01,949: INFO/ForkPoolWorker-16] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T23:41:01.949828369Z [2024-06-18 23:41:01,949: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-06-18T23:41:01.950036759Z [2024-06-18 23:41:01,949: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T23:41:02.098962468Z [2024-06-18 23:41:02,098: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:41:02.821775429Z [2024-06-18 23:41:02,821: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2ffd66cb-d779-457d-83d1-6a3654b6d95a] succeeded in 1.5439855859995077s: None 2024-06-18T23:41:03.171193730Z [2024-06-18 23:41:03,170: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T23:41:03.174811725Z [2024-06-18 23:41:03,174: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:41:03.215797046Z [2024-06-18 23:41:03,215: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T23:41:03.235794035Z [2024-06-18 23:41:03,217: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:41:03.235826013Z [2024-06-18 23:41:03,219: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:41:03.235830585Z [2024-06-18 23:41:03,220: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:41:03.235849142Z [2024-06-18 23:41:03,225: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T23:41:03.235852842Z [2024-06-18 23:41:03,225: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-06-18T23:41:03.235856046Z [2024-06-18 23:41:03,225: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:41:03.235859054Z [2024-06-18 23:41:03,229: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-18T23:41:03.258894730Z [2024-06-18 23:41:03,251: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:41:03.290297036Z [2024-06-18 23:41:03,290: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T23:41:03.292040755Z [2024-06-18 23:41:03,291: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:41:03.292055205Z [2024-06-18 23:41:03,291: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:41:03.292380047Z [2024-06-18 23:41:03,291: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:41:03.292454606Z [2024-06-18 23:41:03,292: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-18T23:41:03.292669539Z [2024-06-18 23:41:03,292: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T23:41:03.292715693Z [2024-06-18 23:41:03,292: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:41:03.351996124Z [2024-06-18 23:41:03,350: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:41:03.412945726Z [2024-06-18 23:41:03,412: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:41:07.028790679Z [2024-06-18 23:41:07,028: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0ed2a359-ed3a-41db-979d-23f847c392b0] succeeded in 5.742398557999877s: None 2024-06-18T23:41:07.343114735Z [2024-06-18 23:41:07,342: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[014971c5-eeda-44f4-834c-9c3ec8109c44] succeeded in 6.0721051379996425s: None 2024-06-18T23:42:00.757149616Z [2024-06-18 23:42:00,756: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[70769c38-123f-4615-b067-07f01805fdf7] received 2024-06-18T23:42:00.766398115Z [2024-06-18 23:42:00,766: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aad6b968-b299-4412-9337-d42a30bbe32e] received 2024-06-18T23:42:00.768489418Z [2024-06-18 23:42:00,768: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cf67ab5d-eb05-4d2f-9b26-81fa7d3c1a5e] received 2024-06-18T23:42:00.770390950Z [2024-06-18 23:42:00,770: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[65dca280-88ac-4b37-bbbf-3d34ea24fbe2] received 2024-06-18T23:42:00.772677629Z [2024-06-18 23:42:00,772: INFO/ForkPoolWorker-15] [70769c38-123f-4615-b067-07f01805fdf7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T23:42:00.783811993Z [2024-06-18 23:42:00,783: INFO/ForkPoolWorker-16] [aad6b968-b299-4412-9337-d42a30bbe32e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-18T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-18T23:42:00.786387881Z [2024-06-18 23:42:00,786: INFO/ForkPoolWorker-1] [cf67ab5d-eb05-4d2f-9b26-81fa7d3c1a5e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T23:42:00.790046936Z [2024-06-18 23:42:00,789: INFO/ForkPoolWorker-2] [65dca280-88ac-4b37-bbbf-3d34ea24fbe2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T23:42:01.151035188Z [2024-06-18 23:42:01,146: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T23:42:01.204260031Z [2024-06-18 23:42:01,194: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T23:42:01.331217389Z [2024-06-18 23:42:01,327: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T23:42:01.447612302Z [2024-06-18 23:42:01,447: INFO/ForkPoolWorker-2] Getting SDNC list 2024-06-18T23:42:01.451571872Z [2024-06-18 23:42:01,451: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:42:01.456269728Z [2024-06-18 23:42:01,452: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-18T23:42:01.472004990Z [2024-06-18 23:42:01,471: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-18T23:42:01.473451170Z [2024-06-18 23:42:01,473: INFO/ForkPoolWorker-2] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T23:42:01.473485270Z [2024-06-18 23:42:01,473: INFO/ForkPoolWorker-2] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T23:42:01.473562187Z [2024-06-18 23:42:01,473: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-06-18T23:42:01.473815668Z [2024-06-18 23:42:01,473: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T23:42:01.576455804Z [2024-06-18 23:42:01,576: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:42:01.791019764Z [2024-06-18 23:42:01,790: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:42:02.342062116Z [2024-06-18 23:42:02,341: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[65dca280-88ac-4b37-bbbf-3d34ea24fbe2] succeeded in 1.5679219749999902s: None 2024-06-18T23:42:02.543216734Z [2024-06-18 23:42:02,542: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[aad6b968-b299-4412-9337-d42a30bbe32e] succeeded in 1.773433427000782s: None 2024-06-18T23:42:02.761789182Z [2024-06-18 23:42:02,761: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T23:42:02.765828955Z [2024-06-18 23:42:02,765: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:42:02.793800178Z [2024-06-18 23:42:02,793: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T23:42:02.795420842Z [2024-06-18 23:42:02,795: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:42:02.795444908Z [2024-06-18 23:42:02,795: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:42:02.795766951Z [2024-06-18 23:42:02,795: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:42:02.795882050Z [2024-06-18 23:42:02,795: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T23:42:02.796260731Z [2024-06-18 23:42:02,796: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-06-18T23:42:02.796280467Z [2024-06-18 23:42:02,796: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:42:02.839642985Z [2024-06-18 23:42:02,839: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-18T23:42:02.843073800Z [2024-06-18 23:42:02,842: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:42:02.865460450Z [2024-06-18 23:42:02,865: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T23:42:02.866831464Z [2024-06-18 23:42:02,866: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:42:02.866922754Z [2024-06-18 23:42:02,866: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:42:02.867086648Z [2024-06-18 23:42:02,866: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:42:02.867184615Z [2024-06-18 23:42:02,867: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-18T23:42:02.867507466Z [2024-06-18 23:42:02,867: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T23:42:02.867579117Z [2024-06-18 23:42:02,867: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:42:02.922025174Z [2024-06-18 23:42:02,921: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:42:02.954218689Z [2024-06-18 23:42:02,953: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:42:04.623968710Z [2024-06-18 23:42:04,623: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[cf67ab5d-eb05-4d2f-9b26-81fa7d3c1a5e] succeeded in 3.8536489080006504s: None 2024-06-18T23:42:05.650921919Z [2024-06-18 23:42:05,650: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[70769c38-123f-4615-b067-07f01805fdf7] succeeded in 4.88790876999974s: None 2024-06-18T23:43:01.168640170Z [2024-06-18 23:43:01,168: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e9c2b771-b4d6-4293-ba19-43b43059e73d] received 2024-06-18T23:43:01.174294009Z [2024-06-18 23:43:01,173: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e35d8cf9-f6b4-4f50-b8b4-db8f16c95872] received 2024-06-18T23:43:01.181050504Z [2024-06-18 23:43:01,180: INFO/ForkPoolWorker-15] [e9c2b771-b4d6-4293-ba19-43b43059e73d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T23:43:01.189404689Z [2024-06-18 23:43:01,188: INFO/ForkPoolWorker-16] [e35d8cf9-f6b4-4f50-b8b4-db8f16c95872] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T23:43:01.193780028Z [2024-06-18 23:43:01,193: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4399729f-57ba-4cea-8c34-ba65e5bde788] received 2024-06-18T23:43:01.226224774Z [2024-06-18 23:43:01,225: INFO/ForkPoolWorker-1] [4399729f-57ba-4cea-8c34-ba65e5bde788] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T23:43:01.509451566Z [2024-06-18 23:43:01,505: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T23:43:01.526383320Z [2024-06-18 23:43:01,522: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T23:43:01.550451724Z [2024-06-18 23:43:01,545: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T23:43:01.760143773Z [2024-06-18 23:43:01,759: INFO/ForkPoolWorker-16] Getting SDNC list 2024-06-18T23:43:01.767336481Z [2024-06-18 23:43:01,766: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:43:01.806098817Z [2024-06-18 23:43:01,805: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T23:43:01.807498320Z [2024-06-18 23:43:01,807: INFO/ForkPoolWorker-16] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T23:43:01.807845416Z [2024-06-18 23:43:01,807: INFO/ForkPoolWorker-16] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T23:43:01.808198220Z [2024-06-18 23:43:01,807: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-06-18T23:43:01.808592976Z [2024-06-18 23:43:01,808: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T23:43:01.920559567Z [2024-06-18 23:43:01,920: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:43:02.671720338Z [2024-06-18 23:43:02,671: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e35d8cf9-f6b4-4f50-b8b4-db8f16c95872] succeeded in 1.4939226559999952s: None 2024-06-18T23:43:02.936953870Z [2024-06-18 23:43:02,936: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T23:43:02.940594918Z [2024-06-18 23:43:02,940: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:43:02.945285527Z [2024-06-18 23:43:02,944: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-18T23:43:02.948585921Z [2024-06-18 23:43:02,948: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:43:02.961041968Z [2024-06-18 23:43:02,960: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T23:43:02.962352740Z [2024-06-18 23:43:02,962: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:43:02.962504723Z [2024-06-18 23:43:02,962: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:43:02.962688893Z [2024-06-18 23:43:02,962: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:43:02.962732119Z [2024-06-18 23:43:02,962: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T23:43:02.963135469Z [2024-06-18 23:43:02,962: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-06-18T23:43:02.963529245Z [2024-06-18 23:43:02,963: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:43:02.967335972Z [2024-06-18 23:43:02,967: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T23:43:02.968723175Z [2024-06-18 23:43:02,968: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:43:02.968734910Z [2024-06-18 23:43:02,968: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:43:02.968901163Z [2024-06-18 23:43:02,968: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:43:02.968944182Z [2024-06-18 23:43:02,968: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-18T23:43:02.969241235Z [2024-06-18 23:43:02,969: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T23:43:02.969277192Z [2024-06-18 23:43:02,969: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:43:03.047614138Z [2024-06-18 23:43:03,047: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:43:03.072118587Z [2024-06-18 23:43:03,071: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:43:05.113637846Z [2024-06-18 23:43:05,113: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4399729f-57ba-4cea-8c34-ba65e5bde788] succeeded in 3.91484946699984s: None 2024-06-18T23:43:05.494439515Z [2024-06-18 23:43:05,494: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e9c2b771-b4d6-4293-ba19-43b43059e73d] succeeded in 4.322139836000133s: None 2024-06-18T23:44:00.532954386Z [2024-06-18 23:44:00,532: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ac96dbbb-18f1-41a5-b249-c84f5cd7f316] received 2024-06-18T23:44:00.536843410Z [2024-06-18 23:44:00,536: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aeea46bd-75c3-4aa4-a78f-946dd0cb9e83] received 2024-06-18T23:44:00.546939350Z [2024-06-18 23:44:00,546: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[df86ea61-c1ee-4d73-b803-db814d161167] received 2024-06-18T23:44:00.548771267Z [2024-06-18 23:44:00,548: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[790b4e9d-9b51-42c0-b65a-3e7162abba9b] received 2024-06-18T23:44:00.553207873Z [2024-06-18 23:44:00,552: INFO/ForkPoolWorker-15] [ac96dbbb-18f1-41a5-b249-c84f5cd7f316] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-18T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-18T23:44:00.557542718Z [2024-06-18 23:44:00,557: INFO/ForkPoolWorker-1] [df86ea61-c1ee-4d73-b803-db814d161167] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T23:44:00.573626419Z [2024-06-18 23:44:00,571: INFO/ForkPoolWorker-16] [aeea46bd-75c3-4aa4-a78f-946dd0cb9e83] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T23:44:00.577655146Z [2024-06-18 23:44:00,576: INFO/ForkPoolWorker-2] [790b4e9d-9b51-42c0-b65a-3e7162abba9b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T23:44:00.902484950Z [2024-06-18 23:44:00,898: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T23:44:00.931622935Z [2024-06-18 23:44:00,926: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T23:44:01.004474638Z [2024-06-18 23:44:00,996: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-18T23:44:01.104934710Z [2024-06-18 23:44:01,104: INFO/ForkPoolWorker-1] Getting SDNC list 2024-06-18T23:44:01.109322847Z [2024-06-18 23:44:01,108: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:44:01.128670976Z [2024-06-18 23:44:01,124: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T23:44:01.153097078Z [2024-06-18 23:44:01,152: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T23:44:01.154928017Z [2024-06-18 23:44:01,154: INFO/ForkPoolWorker-1] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T23:44:01.155937885Z [2024-06-18 23:44:01,155: INFO/ForkPoolWorker-1] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T23:44:01.156350645Z [2024-06-18 23:44:01,155: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-06-18T23:44:01.157234538Z [2024-06-18 23:44:01,157: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T23:44:01.250873447Z [2024-06-18 23:44:01,250: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:44:01.324948789Z [2024-06-18 23:44:01,324: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:44:01.907515313Z [2024-06-18 23:44:01,907: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[df86ea61-c1ee-4d73-b803-db814d161167] succeeded in 1.358299681999597s: None 2024-06-18T23:44:02.026698422Z [2024-06-18 23:44:02,026: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ac96dbbb-18f1-41a5-b249-c84f5cd7f316] succeeded in 1.4856584689996453s: None 2024-06-18T23:44:02.309855096Z [2024-06-18 23:44:02,309: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-18T23:44:02.313389194Z [2024-06-18 23:44:02,312: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:44:02.381014119Z [2024-06-18 23:44:02,380: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-18T23:44:02.382618062Z [2024-06-18 23:44:02,382: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:44:02.382767872Z [2024-06-18 23:44:02,382: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:44:02.382991850Z [2024-06-18 23:44:02,382: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:44:02.383131210Z [2024-06-18 23:44:02,382: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-18T23:44:02.383432776Z [2024-06-18 23:44:02,383: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T23:44:02.383925093Z [2024-06-18 23:44:02,383: INFO/ForkPoolWorker-2] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:44:02.490985716Z [2024-06-18 23:44:02,490: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:44:02.680812177Z [2024-06-18 23:44:02,680: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-18T23:44:02.687099423Z [2024-06-18 23:44:02,686: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:44:02.710953022Z [2024-06-18 23:44:02,710: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T23:44:02.713271753Z [2024-06-18 23:44:02,712: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:44:02.713501768Z [2024-06-18 23:44:02,713: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:44:02.713789561Z [2024-06-18 23:44:02,713: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:44:02.714207285Z [2024-06-18 23:44:02,714: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-18T23:44:02.715312946Z [2024-06-18 23:44:02,715: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-18T23:44:02.715479599Z [2024-06-18 23:44:02,715: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:44:02.906141219Z [2024-06-18 23:44:02,905: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:44:04.134327119Z [2024-06-18 23:44:04,129: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[790b4e9d-9b51-42c0-b65a-3e7162abba9b] succeeded in 3.5789973439996174s: None 2024-06-18T23:44:04.769449530Z [2024-06-18 23:44:04,767: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[aeea46bd-75c3-4aa4-a78f-946dd0cb9e83] succeeded in 4.215794712000388s: None 2024-06-18T23:45:00.424162882Z [2024-06-18 23:45:00,423: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1018aad3-19f4-4e23-8f4c-a2126cb76477] received 2024-06-18T23:45:00.430648535Z [2024-06-18 23:45:00,430: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3ca9a0a0-ebc5-4352-bcce-f9855b152d06] received 2024-06-18T23:45:00.440793573Z [2024-06-18 23:45:00,439: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b01f2b95-284e-4d6e-a520-0ce1025a88c5] received 2024-06-18T23:45:00.442471527Z [2024-06-18 23:45:00,442: INFO/ForkPoolWorker-15] [1018aad3-19f4-4e23-8f4c-a2126cb76477] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T23:45:00.449754710Z [2024-06-18 23:45:00,449: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b37198e6-ab9f-49c7-995d-82afc024de81] received 2024-06-18T23:45:00.475262239Z [2024-06-18 23:45:00,474: INFO/ForkPoolWorker-1] [b01f2b95-284e-4d6e-a520-0ce1025a88c5] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T23:45:00.491607883Z [2024-06-18 23:45:00,487: INFO/ForkPoolWorker-2] [b37198e6-ab9f-49c7-995d-82afc024de81] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T23:45:00.495049036Z [2024-06-18 23:45:00,494: INFO/ForkPoolWorker-16] [3ca9a0a0-ebc5-4352-bcce-f9855b152d06] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-18T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-18T23:45:01.374502797Z [2024-06-18 23:45:01,363: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T23:45:01.674089065Z [2024-06-18 23:45:01,666: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T23:45:02.069525977Z [2024-06-18 23:45:02,056: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T23:45:02.145441120Z [2024-06-18 23:45:02,133: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T23:45:02.620087358Z [2024-06-18 23:45:02,619: INFO/ForkPoolWorker-1] Getting SDNC list 2024-06-18T23:45:02.624573421Z [2024-06-18 23:45:02,624: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:45:02.665589136Z [2024-06-18 23:45:02,665: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T23:45:02.667915967Z [2024-06-18 23:45:02,667: INFO/ForkPoolWorker-1] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T23:45:02.668269505Z [2024-06-18 23:45:02,667: INFO/ForkPoolWorker-1] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T23:45:02.668534262Z [2024-06-18 23:45:02,668: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-06-18T23:45:02.668873160Z [2024-06-18 23:45:02,668: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T23:45:02.786697794Z [2024-06-18 23:45:02,786: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:45:04.152605946Z [2024-06-18 23:45:04,151: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b01f2b95-284e-4d6e-a520-0ce1025a88c5] succeeded in 3.6901441589998285s: None 2024-06-18T23:45:04.608888601Z [2024-06-18 23:45:04,608: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-18T23:45:04.612529964Z [2024-06-18 23:45:04,612: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:45:04.704128094Z [2024-06-18 23:45:04,703: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-18T23:45:04.709261228Z [2024-06-18 23:45:04,708: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:45:04.709282588Z [2024-06-18 23:45:04,709: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:45:04.709371522Z [2024-06-18 23:45:04,709: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:45:04.709389667Z [2024-06-18 23:45:04,709: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-18T23:45:04.709641938Z [2024-06-18 23:45:04,709: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T23:45:04.709669957Z [2024-06-18 23:45:04,709: INFO/ForkPoolWorker-2] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:45:04.846800405Z [2024-06-18 23:45:04,843: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:45:05.109892431Z [2024-06-18 23:45:05,109: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T23:45:05.114067290Z [2024-06-18 23:45:05,113: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:45:05.160613014Z [2024-06-18 23:45:05,160: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T23:45:05.161899039Z [2024-06-18 23:45:05,161: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:45:05.161919597Z [2024-06-18 23:45:05,161: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:45:05.162153455Z [2024-06-18 23:45:05,161: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:45:05.162304570Z [2024-06-18 23:45:05,162: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T23:45:05.162781179Z [2024-06-18 23:45:05,162: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-06-18T23:45:05.162897931Z [2024-06-18 23:45:05,162: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:45:05.305858796Z [2024-06-18 23:45:05,305: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:45:05.613912443Z [2024-06-18 23:45:05,613: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-18T23:45:05.617523879Z [2024-06-18 23:45:05,617: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:45:05.695618336Z [2024-06-18 23:45:05,695: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T23:45:05.702836001Z [2024-06-18 23:45:05,702: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:45:05.702852900Z [2024-06-18 23:45:05,702: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:45:05.702976023Z [2024-06-18 23:45:05,702: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:45:05.707061271Z [2024-06-18 23:45:05,702: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-18T23:45:05.708436959Z [2024-06-18 23:45:05,708: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T23:45:05.708449945Z [2024-06-18 23:45:05,708: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:45:05.836025014Z [2024-06-18 23:45:05,835: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:45:06.411145820Z [2024-06-18 23:45:06,410: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b37198e6-ab9f-49c7-995d-82afc024de81] succeeded in 5.954034637999939s: None 2024-06-18T23:45:06.569717471Z [2024-06-18 23:45:06,569: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3ca9a0a0-ebc5-4352-bcce-f9855b152d06] succeeded in 6.134916734000399s: None 2024-06-18T23:45:07.013635504Z [2024-06-18 23:45:06,996: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a9e054d7-f2ee-4917-853a-942c9ab89ae8] received 2024-06-18T23:45:07.013662029Z [2024-06-18 23:45:07,010: INFO/ForkPoolWorker-16] [a9e054d7-f2ee-4917-853a-942c9ab89ae8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'split_metrics', 'scheduled__2024-06-18T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-18T23:45:07.355561171Z [2024-06-18 23:45:07,352: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T23:45:07.815930976Z [2024-06-18 23:45:07,815: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1018aad3-19f4-4e23-8f4c-a2126cb76477] succeeded in 7.388703139000427s: None 2024-06-18T23:45:08.657378256Z [2024-06-18 23:45:08,656: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-18T23:45:08.660708595Z [2024-06-18 23:45:08,660: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:45:08.685363663Z [2024-06-18 23:45:08,685: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T23:45:08.686660612Z [2024-06-18 23:45:08,686: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:45:08.686749826Z [2024-06-18 23:45:08,686: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:45:08.686863215Z [2024-06-18 23:45:08,686: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:45:08.686899966Z [2024-06-18 23:45:08,686: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-18T23:45:08.687146969Z [2024-06-18 23:45:08,687: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T23:45:08.687184519Z [2024-06-18 23:45:08,687: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:45:08.792912632Z [2024-06-18 23:45:08,792: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:45:09.468106199Z [2024-06-18 23:45:09,467: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a9e054d7-f2ee-4917-853a-942c9ab89ae8] succeeded in 2.466356277000159s: None 2024-06-18T23:45:09.481435486Z [2024-06-18 23:45:09,481: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6cc2f75b-d846-448f-b456-0f101759cd28] received 2024-06-18T23:45:09.491663001Z [2024-06-18 23:45:09,491: INFO/ForkPoolWorker-15] [6cc2f75b-d846-448f-b456-0f101759cd28] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'collect_metrics', 'scheduled__2024-06-18T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-18T23:45:09.806481170Z [2024-06-18 23:45:09,803: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T23:45:11.026375790Z [2024-06-18 23:45:11,026: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T23:45:11.030119472Z [2024-06-18 23:45:11,029: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:45:11.054530989Z [2024-06-18 23:45:11,054: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T23:45:11.058554453Z [2024-06-18 23:45:11,058: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:45:11.058791821Z [2024-06-18 23:45:11,058: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:45:11.059077130Z [2024-06-18 23:45:11,058: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:45:11.059275840Z [2024-06-18 23:45:11,059: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T23:45:11.059636307Z [2024-06-18 23:45:11,059: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T23:45:11.059892857Z [2024-06-18 23:45:11,059: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:45:11.180982754Z [2024-06-18 23:45:11,180: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:45:12.017862182Z [2024-06-18 23:45:12,017: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6cc2f75b-d846-448f-b456-0f101759cd28] succeeded in 2.533145978999528s: None 2024-06-18T23:45:12.360483927Z [2024-06-18 23:45:12,360: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[12853a9b-78bb-475a-981e-a36e8046b857] received 2024-06-18T23:45:12.401313689Z [2024-06-18 23:45:12,401: INFO/ForkPoolWorker-15] [12853a9b-78bb-475a-981e-a36e8046b857] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'send_prometheus', 'scheduled__2024-06-18T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-18T23:45:12.861991354Z [2024-06-18 23:45:12,857: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T23:45:14.289154792Z [2024-06-18 23:45:14,287: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T23:45:14.298626932Z [2024-06-18 23:45:14,296: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:45:14.324537189Z [2024-06-18 23:45:14,323: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T23:45:14.325757404Z [2024-06-18 23:45:14,325: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:45:14.326695782Z [2024-06-18 23:45:14,325: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:45:14.326718914Z [2024-06-18 23:45:14,325: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:45:14.326744931Z [2024-06-18 23:45:14,326: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T23:45:14.326748790Z [2024-06-18 23:45:14,326: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T23:45:14.326774343Z [2024-06-18 23:45:14,326: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:45:14.431897727Z [2024-06-18 23:45:14,430: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:45:15.080018339Z [2024-06-18 23:45:15,079: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[12853a9b-78bb-475a-981e-a36e8046b857] succeeded in 2.7019481079996694s: None 2024-06-18T23:46:00.636398545Z [2024-06-18 23:46:00,636: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7b2fd01c-cef7-4308-be4d-a51fe572eca3] received 2024-06-18T23:46:00.642159082Z [2024-06-18 23:46:00,641: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[01523097-1331-4d14-b1a0-95331beb09fe] received 2024-06-18T23:46:00.667129873Z [2024-06-18 23:46:00,666: INFO/ForkPoolWorker-16] [01523097-1331-4d14-b1a0-95331beb09fe] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T23:46:00.668047891Z [2024-06-18 23:46:00,667: INFO/ForkPoolWorker-15] [7b2fd01c-cef7-4308-be4d-a51fe572eca3] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-18T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-18T23:46:00.674322050Z [2024-06-18 23:46:00,674: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3c4767cc-0a50-4e18-bf8f-a98653de42bd] received 2024-06-18T23:46:00.678251123Z [2024-06-18 23:46:00,678: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c8141699-3e05-4fe6-82a1-8c1228eb4a4f] received 2024-06-18T23:46:00.684155212Z [2024-06-18 23:46:00,683: INFO/ForkPoolWorker-1] [3c4767cc-0a50-4e18-bf8f-a98653de42bd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T23:46:00.697342004Z [2024-06-18 23:46:00,695: INFO/ForkPoolWorker-2] [c8141699-3e05-4fe6-82a1-8c1228eb4a4f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T23:46:01.202561623Z [2024-06-18 23:46:01,184: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T23:46:01.363008018Z [2024-06-18 23:46:01,358: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-18T23:46:01.382543964Z [2024-06-18 23:46:01,378: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T23:46:01.513244497Z [2024-06-18 23:46:01,508: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T23:46:01.748148393Z [2024-06-18 23:46:01,747: INFO/ForkPoolWorker-2] Getting SDNC list 2024-06-18T23:46:01.753264147Z [2024-06-18 23:46:01,752: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:46:01.804635520Z [2024-06-18 23:46:01,804: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-18T23:46:01.805939686Z [2024-06-18 23:46:01,805: INFO/ForkPoolWorker-2] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T23:46:01.806111598Z [2024-06-18 23:46:01,805: INFO/ForkPoolWorker-2] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T23:46:01.806193091Z [2024-06-18 23:46:01,806: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-06-18T23:46:01.806455009Z [2024-06-18 23:46:01,806: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T23:46:01.812234109Z [2024-06-18 23:46:01,811: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:46:02.016048727Z [2024-06-18 23:46:02,015: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:46:03.261070703Z [2024-06-18 23:46:03,260: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7b2fd01c-cef7-4308-be4d-a51fe572eca3] succeeded in 2.6043672020005033s: None 2024-06-18T23:46:03.347537005Z [2024-06-18 23:46:03,345: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[c8141699-3e05-4fe6-82a1-8c1228eb4a4f] succeeded in 2.6661599600001864s: None 2024-06-18T23:46:03.729419601Z [2024-06-18 23:46:03,728: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-18T23:46:03.732684288Z [2024-06-18 23:46:03,732: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:46:03.755418988Z [2024-06-18 23:46:03,755: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T23:46:03.757676703Z [2024-06-18 23:46:03,757: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:46:03.757695281Z [2024-06-18 23:46:03,757: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:46:03.757868380Z [2024-06-18 23:46:03,757: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:46:03.757898455Z [2024-06-18 23:46:03,757: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-18T23:46:03.758240952Z [2024-06-18 23:46:03,758: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T23:46:03.758282351Z [2024-06-18 23:46:03,758: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:46:03.789105871Z [2024-06-18 23:46:03,788: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-18T23:46:03.792646597Z [2024-06-18 23:46:03,792: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:46:03.827839129Z [2024-06-18 23:46:03,827: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T23:46:03.829260331Z [2024-06-18 23:46:03,829: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:46:03.829462857Z [2024-06-18 23:46:03,829: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:46:03.829681322Z [2024-06-18 23:46:03,829: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:46:03.831799092Z [2024-06-18 23:46:03,829: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-18T23:46:03.832156619Z [2024-06-18 23:46:03,831: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-18T23:46:03.832167243Z [2024-06-18 23:46:03,832: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:46:03.866193761Z [2024-06-18 23:46:03,865: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:46:03.917183520Z [2024-06-18 23:46:03,916: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:46:05.470350096Z [2024-06-18 23:46:05,469: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3c4767cc-0a50-4e18-bf8f-a98653de42bd] succeeded in 4.793615838999358s: None 2024-06-18T23:46:06.108406115Z [2024-06-18 23:46:06,107: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[01523097-1331-4d14-b1a0-95331beb09fe] succeeded in 5.461842544999854s: None 2024-06-18T23:47:00.767070146Z [2024-06-18 23:47:00,766: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f4c13f0f-4e93-4980-8676-9bd5867d823e] received 2024-06-18T23:47:00.774828255Z [2024-06-18 23:47:00,773: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[201fb989-515b-492a-8238-c30d1ed4d585] received 2024-06-18T23:47:00.777687787Z [2024-06-18 23:47:00,777: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[38d27f73-0015-4578-990b-e24696bb0bbd] received 2024-06-18T23:47:00.788123206Z [2024-06-18 23:47:00,787: INFO/ForkPoolWorker-15] [f4c13f0f-4e93-4980-8676-9bd5867d823e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T23:47:00.800514677Z [2024-06-18 23:47:00,800: INFO/ForkPoolWorker-16] [201fb989-515b-492a-8238-c30d1ed4d585] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T23:47:00.800885814Z [2024-06-18 23:47:00,800: INFO/ForkPoolWorker-1] [38d27f73-0015-4578-990b-e24696bb0bbd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T23:47:01.108397378Z [2024-06-18 23:47:01,104: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T23:47:01.143954713Z [2024-06-18 23:47:01,140: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T23:47:01.256535305Z [2024-06-18 23:47:01,250: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T23:47:01.290503598Z [2024-06-18 23:47:01,290: INFO/ForkPoolWorker-16] Getting SDNC list 2024-06-18T23:47:01.295054285Z [2024-06-18 23:47:01,294: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:47:01.329208217Z [2024-06-18 23:47:01,328: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T23:47:01.330452245Z [2024-06-18 23:47:01,330: INFO/ForkPoolWorker-16] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T23:47:01.330588728Z [2024-06-18 23:47:01,330: INFO/ForkPoolWorker-16] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T23:47:01.330698798Z [2024-06-18 23:47:01,330: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-06-18T23:47:01.331158571Z [2024-06-18 23:47:01,330: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T23:47:01.453770665Z [2024-06-18 23:47:01,453: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:47:02.372839108Z [2024-06-18 23:47:02,372: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[201fb989-515b-492a-8238-c30d1ed4d585] succeeded in 1.5929814670007545s: None 2024-06-18T23:47:02.729066753Z [2024-06-18 23:47:02,728: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T23:47:02.732770613Z [2024-06-18 23:47:02,732: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:47:02.758466450Z [2024-06-18 23:47:02,757: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T23:47:02.760095802Z [2024-06-18 23:47:02,759: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:47:02.760310815Z [2024-06-18 23:47:02,760: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:47:02.760538693Z [2024-06-18 23:47:02,760: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:47:02.760710212Z [2024-06-18 23:47:02,760: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T23:47:02.761904503Z [2024-06-18 23:47:02,761: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T23:47:02.762052675Z [2024-06-18 23:47:02,761: INFO/ForkPoolWorker-15] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:47:02.798707626Z [2024-06-18 23:47:02,798: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-18T23:47:02.802326460Z [2024-06-18 23:47:02,801: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:47:02.835136704Z [2024-06-18 23:47:02,834: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T23:47:02.838246478Z [2024-06-18 23:47:02,837: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:47:02.838397754Z [2024-06-18 23:47:02,838: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:47:02.838644680Z [2024-06-18 23:47:02,838: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:47:02.838790251Z [2024-06-18 23:47:02,838: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-18T23:47:02.839381177Z [2024-06-18 23:47:02,839: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-06-18T23:47:02.839541987Z [2024-06-18 23:47:02,839: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:47:02.862153381Z [2024-06-18 23:47:02,861: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:47:02.936776559Z [2024-06-18 23:47:02,936: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:47:04.800564970Z [2024-06-18 23:47:04,800: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f4c13f0f-4e93-4980-8676-9bd5867d823e] succeeded in 4.028563990999828s: None 2024-06-18T23:47:05.544405307Z [2024-06-18 23:47:05,544: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[38d27f73-0015-4578-990b-e24696bb0bbd] succeeded in 4.757046976000311s: None 2024-06-18T23:48:00.845959625Z [2024-06-18 23:48:00,845: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[771c2bae-a85c-46ce-bf89-6f347450e3a4] received 2024-06-18T23:48:00.849934110Z [2024-06-18 23:48:00,849: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7fc70580-e331-4581-8031-7f00032d3e86] received 2024-06-18T23:48:00.859073371Z [2024-06-18 23:48:00,858: INFO/ForkPoolWorker-15] [771c2bae-a85c-46ce-bf89-6f347450e3a4] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-18T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-18T23:48:00.861813616Z [2024-06-18 23:48:00,861: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[832e9008-4afc-4559-b6b3-d3dd92ce900c] received 2024-06-18T23:48:00.870099679Z [2024-06-18 23:48:00,869: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e748aafe-668f-4e15-967f-e8e6d08e3bba] received 2024-06-18T23:48:00.870867833Z [2024-06-18 23:48:00,870: INFO/ForkPoolWorker-1] [832e9008-4afc-4559-b6b3-d3dd92ce900c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T23:48:00.872978764Z [2024-06-18 23:48:00,872: INFO/ForkPoolWorker-16] [7fc70580-e331-4581-8031-7f00032d3e86] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T23:48:00.886534217Z [2024-06-18 23:48:00,886: INFO/ForkPoolWorker-2] [e748aafe-668f-4e15-967f-e8e6d08e3bba] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T23:48:01.349997423Z [2024-06-18 23:48:01,342: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T23:48:01.374049748Z [2024-06-18 23:48:01,365: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T23:48:01.397641710Z [2024-06-18 23:48:01,391: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-18T23:48:01.498414657Z [2024-06-18 23:48:01,487: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T23:48:01.687428657Z [2024-06-18 23:48:01,686: INFO/ForkPoolWorker-16] Getting SDNC list 2024-06-18T23:48:01.697069156Z [2024-06-18 23:48:01,696: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:48:01.804880222Z [2024-06-18 23:48:01,804: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:48:01.811163072Z [2024-06-18 23:48:01,810: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T23:48:01.812754651Z [2024-06-18 23:48:01,812: INFO/ForkPoolWorker-16] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T23:48:01.812773512Z [2024-06-18 23:48:01,812: INFO/ForkPoolWorker-16] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T23:48:01.812798026Z [2024-06-18 23:48:01,812: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-06-18T23:48:01.812959823Z [2024-06-18 23:48:01,812: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T23:48:02.049207276Z [2024-06-18 23:48:02,046: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:48:02.938121766Z [2024-06-18 23:48:02,937: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[771c2bae-a85c-46ce-bf89-6f347450e3a4] succeeded in 2.088780200000656s: None 2024-06-18T23:48:03.117031455Z [2024-06-18 23:48:03,116: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7fc70580-e331-4581-8031-7f00032d3e86] succeeded in 2.2621744089992717s: None 2024-06-18T23:48:03.407295396Z [2024-06-18 23:48:03,406: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-18T23:48:03.424988531Z [2024-06-18 23:48:03,411: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:48:03.469892547Z [2024-06-18 23:48:03,469: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-18T23:48:03.472706746Z [2024-06-18 23:48:03,472: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:48:03.473125836Z [2024-06-18 23:48:03,472: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:48:03.473783897Z [2024-06-18 23:48:03,473: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:48:03.474092441Z [2024-06-18 23:48:03,473: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-18T23:48:03.474904468Z [2024-06-18 23:48:03,474: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-06-18T23:48:03.475452777Z [2024-06-18 23:48:03,475: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:48:03.584840852Z [2024-06-18 23:48:03,584: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:48:03.822174874Z [2024-06-18 23:48:03,821: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-18T23:48:03.827444372Z [2024-06-18 23:48:03,826: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:48:03.888271457Z [2024-06-18 23:48:03,887: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T23:48:03.891895825Z [2024-06-18 23:48:03,891: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:48:03.892160645Z [2024-06-18 23:48:03,891: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:48:03.892326348Z [2024-06-18 23:48:03,892: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:48:03.892441257Z [2024-06-18 23:48:03,892: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-18T23:48:03.892762341Z [2024-06-18 23:48:03,892: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T23:48:03.892875497Z [2024-06-18 23:48:03,892: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:48:04.052391047Z [2024-06-18 23:48:04,052: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:48:05.784433670Z [2024-06-18 23:48:05,783: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[832e9008-4afc-4559-b6b3-d3dd92ce900c] succeeded in 4.920188782999503s: None 2024-06-18T23:48:05.785000744Z [2024-06-18 23:48:05,784: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[e748aafe-668f-4e15-967f-e8e6d08e3bba] succeeded in 4.9110749709998345s: None 2024-06-18T23:49:00.653632864Z [2024-06-18 23:49:00,653: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[11b5198f-703c-4ce7-9e13-14b79dc0882b] received 2024-06-18T23:49:00.656751648Z [2024-06-18 23:49:00,656: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fb0a1c1c-4d6d-46da-a65b-c227bba974d7] received 2024-06-18T23:49:00.665169902Z [2024-06-18 23:49:00,664: INFO/ForkPoolWorker-15] [11b5198f-703c-4ce7-9e13-14b79dc0882b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T23:49:00.670477801Z [2024-06-18 23:49:00,670: INFO/ForkPoolWorker-16] [fb0a1c1c-4d6d-46da-a65b-c227bba974d7] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T23:49:00.673430454Z [2024-06-18 23:49:00,673: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ef6e15b0-19ef-4663-93c8-7dc2ac3a76db] received 2024-06-18T23:49:00.690910743Z [2024-06-18 23:49:00,690: INFO/ForkPoolWorker-1] [ef6e15b0-19ef-4663-93c8-7dc2ac3a76db] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T23:49:01.072288198Z [2024-06-18 23:49:01,066: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T23:49:01.119894404Z [2024-06-18 23:49:01,109: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T23:49:01.159110905Z [2024-06-18 23:49:01,153: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T23:49:01.312403130Z [2024-06-18 23:49:01,308: INFO/ForkPoolWorker-16] Getting SDNC list 2024-06-18T23:49:01.315853440Z [2024-06-18 23:49:01,312: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:49:01.352290928Z [2024-06-18 23:49:01,351: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T23:49:01.353967446Z [2024-06-18 23:49:01,353: INFO/ForkPoolWorker-16] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T23:49:01.354055511Z [2024-06-18 23:49:01,353: INFO/ForkPoolWorker-16] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T23:49:01.354105670Z [2024-06-18 23:49:01,354: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-06-18T23:49:01.354286330Z [2024-06-18 23:49:01,354: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T23:49:01.487733330Z [2024-06-18 23:49:01,487: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:49:02.093258776Z [2024-06-18 23:49:02,092: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[fb0a1c1c-4d6d-46da-a65b-c227bba974d7] succeeded in 1.4316947229999641s: None 2024-06-18T23:49:02.573333252Z [2024-06-18 23:49:02,571: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T23:49:02.575303139Z [2024-06-18 23:49:02,574: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:49:02.605369003Z [2024-06-18 23:49:02,605: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T23:49:02.607854993Z [2024-06-18 23:49:02,606: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:49:02.608427873Z [2024-06-18 23:49:02,606: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:49:02.608435745Z [2024-06-18 23:49:02,606: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:49:02.608451845Z [2024-06-18 23:49:02,607: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T23:49:02.608455095Z [2024-06-18 23:49:02,607: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T23:49:02.608458124Z [2024-06-18 23:49:02,607: INFO/ForkPoolWorker-15] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:49:02.729132619Z [2024-06-18 23:49:02,728: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:49:02.786615704Z [2024-06-18 23:49:02,786: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-18T23:49:02.789864378Z [2024-06-18 23:49:02,789: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:49:02.825712197Z [2024-06-18 23:49:02,825: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T23:49:02.829989875Z [2024-06-18 23:49:02,829: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:49:02.830252118Z [2024-06-18 23:49:02,829: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:49:02.830648351Z [2024-06-18 23:49:02,830: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:49:02.830851035Z [2024-06-18 23:49:02,830: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-18T23:49:02.831619626Z [2024-06-18 23:49:02,831: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-06-18T23:49:02.832630395Z [2024-06-18 23:49:02,832: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:49:02.941703989Z [2024-06-18 23:49:02,941: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:49:04.818070633Z [2024-06-18 23:49:04,817: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[11b5198f-703c-4ce7-9e13-14b79dc0882b] succeeded in 4.16106524099996s: None 2024-06-18T23:49:05.622557268Z [2024-06-18 23:49:05,621: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ef6e15b0-19ef-4663-93c8-7dc2ac3a76db] succeeded in 4.944230232999871s: None 2024-06-18T23:50:00.744034620Z [2024-06-18 23:50:00,743: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[44860d80-7516-43d1-9237-21b062965095] received 2024-06-18T23:50:00.752423948Z [2024-06-18 23:50:00,752: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[78b37f93-ac9b-46ce-855b-ca46d42c74e8] received 2024-06-18T23:50:00.759541569Z [2024-06-18 23:50:00,759: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f56831fc-a5f3-49c5-acc7-819aa2c1dce5] received 2024-06-18T23:50:00.759838313Z [2024-06-18 23:50:00,759: INFO/ForkPoolWorker-15] [44860d80-7516-43d1-9237-21b062965095] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T23:50:00.764811825Z [2024-06-18 23:50:00,764: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fbc44dd9-9655-40f8-b968-3cffab4c57a2] received 2024-06-18T23:50:00.767910983Z [2024-06-18 23:50:00,767: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d311d5c4-a591-4b86-bd51-9695269eb5d5] received 2024-06-18T23:50:00.768643519Z [2024-06-18 23:50:00,768: INFO/ForkPoolWorker-1] [f56831fc-a5f3-49c5-acc7-819aa2c1dce5] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T23:50:00.776622827Z [2024-06-18 23:50:00,776: INFO/ForkPoolWorker-16] [78b37f93-ac9b-46ce-855b-ca46d42c74e8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-18T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-18T23:50:00.782637470Z [2024-06-18 23:50:00,782: INFO/ForkPoolWorker-2] [fbc44dd9-9655-40f8-b968-3cffab4c57a2] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-18T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-18T23:50:00.790297355Z [2024-06-18 23:50:00,789: INFO/ForkPoolWorker-3] [d311d5c4-a591-4b86-bd51-9695269eb5d5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T23:50:01.110339092Z [2024-06-18 23:50:01,106: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-18T23:50:01.212980756Z [2024-06-18 23:50:01,209: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T23:50:01.216539016Z [2024-06-18 23:50:01,206: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T23:50:01.244672011Z [2024-06-18 23:50:01,240: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T23:50:01.327056330Z [2024-06-18 23:50:01,322: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T23:50:01.380718553Z [2024-06-18 23:50:01,380: INFO/ForkPoolWorker-1] Getting SDNC list 2024-06-18T23:50:01.384956353Z [2024-06-18 23:50:01,384: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:50:01.408073372Z [2024-06-18 23:50:01,407: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:50:01.409172617Z [2024-06-18 23:50:01,408: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T23:50:01.410177908Z [2024-06-18 23:50:01,409: INFO/ForkPoolWorker-1] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T23:50:01.410655262Z [2024-06-18 23:50:01,410: INFO/ForkPoolWorker-1] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T23:50:01.410755270Z [2024-06-18 23:50:01,410: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-06-18T23:50:01.410979573Z [2024-06-18 23:50:01,410: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T23:50:01.510202542Z [2024-06-18 23:50:01,509: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:50:02.395877170Z [2024-06-18 23:50:02,395: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[fbc44dd9-9655-40f8-b968-3cffab4c57a2] succeeded in 1.6277410270004111s: None 2024-06-18T23:50:02.459351096Z [2024-06-18 23:50:02,458: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f56831fc-a5f3-49c5-acc7-819aa2c1dce5] succeeded in 1.6979141460005849s: None 2024-06-18T23:50:02.966130843Z [2024-06-18 23:50:02,965: INFO/ForkPoolWorker-3] Getting VIM list 2024-06-18T23:50:02.969781828Z [2024-06-18 23:50:02,969: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:50:03.009328844Z [2024-06-18 23:50:03,009: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-06-18T23:50:03.011445849Z [2024-06-18 23:50:03,011: INFO/ForkPoolWorker-3] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:50:03.011682028Z [2024-06-18 23:50:03,011: INFO/ForkPoolWorker-3] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:50:03.011988412Z [2024-06-18 23:50:03,011: INFO/ForkPoolWorker-3] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:50:03.012130500Z [2024-06-18 23:50:03,011: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-06-18T23:50:03.012506624Z [2024-06-18 23:50:03,012: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-06-18T23:50:03.012678680Z [2024-06-18 23:50:03,012: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:50:03.058287588Z [2024-06-18 23:50:03,057: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T23:50:03.061992671Z [2024-06-18 23:50:03,061: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:50:03.102779622Z [2024-06-18 23:50:03,102: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T23:50:03.104724221Z [2024-06-18 23:50:03,104: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:50:03.104779926Z [2024-06-18 23:50:03,104: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:50:03.104954269Z [2024-06-18 23:50:03,104: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:50:03.105049134Z [2024-06-18 23:50:03,104: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T23:50:03.105356641Z [2024-06-18 23:50:03,105: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T23:50:03.105422058Z [2024-06-18 23:50:03,105: INFO/ForkPoolWorker-15] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:50:03.108412120Z [2024-06-18 23:50:03,107: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-18T23:50:03.112071566Z [2024-06-18 23:50:03,111: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:50:03.119992715Z [2024-06-18 23:50:03,119: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:50:03.137872390Z [2024-06-18 23:50:03,137: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T23:50:03.139447408Z [2024-06-18 23:50:03,139: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:50:03.139572065Z [2024-06-18 23:50:03,139: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:50:03.139866091Z [2024-06-18 23:50:03,139: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:50:03.140076377Z [2024-06-18 23:50:03,139: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-18T23:50:03.140506495Z [2024-06-18 23:50:03,140: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T23:50:03.140535334Z [2024-06-18 23:50:03,140: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:50:03.236903528Z [2024-06-18 23:50:03,236: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:50:03.310941801Z [2024-06-18 23:50:03,310: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:50:04.100332264Z [2024-06-18 23:50:04,098: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[78b37f93-ac9b-46ce-855b-ca46d42c74e8] succeeded in 3.340604744999837s: None 2024-06-18T23:50:04.415406388Z [2024-06-18 23:50:04,414: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[61187982-11bf-4032-b8f4-e493fcba3497] received 2024-06-18T23:50:04.422759015Z [2024-06-18 23:50:04,422: INFO/ForkPoolWorker-16] [61187982-11bf-4032-b8f4-e493fcba3497] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'split_metrics', 'scheduled__2024-06-18T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-18T23:50:04.720990888Z [2024-06-18 23:50:04,717: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T23:50:05.176625046Z [2024-06-18 23:50:05,176: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[44860d80-7516-43d1-9237-21b062965095] succeeded in 4.429863275000571s: None 2024-06-18T23:50:05.993668207Z [2024-06-18 23:50:05,993: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-18T23:50:05.997095021Z [2024-06-18 23:50:05,996: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:50:06.022086211Z [2024-06-18 23:50:06,021: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T23:50:06.023500802Z [2024-06-18 23:50:06,023: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:50:06.023519641Z [2024-06-18 23:50:06,023: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:50:06.023822058Z [2024-06-18 23:50:06,023: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:50:06.023898364Z [2024-06-18 23:50:06,023: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-18T23:50:06.024232177Z [2024-06-18 23:50:06,024: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T23:50:06.024382087Z [2024-06-18 23:50:06,024: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:50:06.134299551Z [2024-06-18 23:50:06,133: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:50:06.806273786Z [2024-06-18 23:50:06,805: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[d311d5c4-a591-4b86-bd51-9695269eb5d5] succeeded in 6.0282635080002365s: None 2024-06-18T23:50:06.961916922Z [2024-06-18 23:50:06,961: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[61187982-11bf-4032-b8f4-e493fcba3497] succeeded in 2.5446637760005615s: None 2024-06-18T23:50:08.033499388Z [2024-06-18 23:50:08,033: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fed677aa-84a3-42a3-8880-aa95e0f4b232] received 2024-06-18T23:50:08.044700823Z [2024-06-18 23:50:08,044: INFO/ForkPoolWorker-15] [fed677aa-84a3-42a3-8880-aa95e0f4b232] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'collect_metrics', 'scheduled__2024-06-18T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-18T23:50:08.319856982Z [2024-06-18 23:50:08,316: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T23:50:09.463639992Z [2024-06-18 23:50:09,462: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T23:50:09.466891883Z [2024-06-18 23:50:09,466: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:50:09.513719897Z [2024-06-18 23:50:09,513: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T23:50:09.523117010Z [2024-06-18 23:50:09,521: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:50:09.523156402Z [2024-06-18 23:50:09,522: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:50:09.523167489Z [2024-06-18 23:50:09,522: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:50:09.523176712Z [2024-06-18 23:50:09,522: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T23:50:09.523185386Z [2024-06-18 23:50:09,522: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T23:50:09.523348953Z [2024-06-18 23:50:09,522: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:50:09.674961376Z [2024-06-18 23:50:09,674: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:50:10.275036381Z [2024-06-18 23:50:10,274: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fed677aa-84a3-42a3-8880-aa95e0f4b232] succeeded in 2.2395086229998924s: None 2024-06-18T23:50:10.815345751Z [2024-06-18 23:50:10,815: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5a13b73e-98bb-4a6c-8587-fcea27ee3a81] received 2024-06-18T23:50:10.824582647Z [2024-06-18 23:50:10,824: INFO/ForkPoolWorker-15] [5a13b73e-98bb-4a6c-8587-fcea27ee3a81] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'send_prometheus', 'scheduled__2024-06-18T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-18T23:50:11.150655946Z [2024-06-18 23:50:11,147: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T23:50:12.356716628Z [2024-06-18 23:50:12,356: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T23:50:12.360763432Z [2024-06-18 23:50:12,359: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:50:12.385052036Z [2024-06-18 23:50:12,384: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T23:50:12.387510063Z [2024-06-18 23:50:12,387: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:50:12.387522599Z [2024-06-18 23:50:12,387: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:50:12.387818782Z [2024-06-18 23:50:12,387: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:50:12.387965359Z [2024-06-18 23:50:12,387: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T23:50:12.388314159Z [2024-06-18 23:50:12,388: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T23:50:12.388450500Z [2024-06-18 23:50:12,388: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:50:12.519731327Z [2024-06-18 23:50:12,519: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:50:13.232018338Z [2024-06-18 23:50:13,231: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5a13b73e-98bb-4a6c-8587-fcea27ee3a81] succeeded in 2.414531251999506s: None 2024-06-18T23:51:00.843488553Z [2024-06-18 23:51:00,840: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cc34825f-ddde-463c-b9e1-ceac76c4f472] received 2024-06-18T23:51:00.855580477Z [2024-06-18 23:51:00,854: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1c7e609c-57b7-4bc9-85d9-513e4a13faaa] received 2024-06-18T23:51:00.856253668Z [2024-06-18 23:51:00,855: INFO/ForkPoolWorker-15] [cc34825f-ddde-463c-b9e1-ceac76c4f472] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T23:51:00.864828914Z [2024-06-18 23:51:00,864: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[58f951df-bfe4-4f3a-abb6-74578a9adf6b] received 2024-06-18T23:51:00.881369548Z [2024-06-18 23:51:00,880: INFO/ForkPoolWorker-16] [1c7e609c-57b7-4bc9-85d9-513e4a13faaa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T23:51:00.887608878Z [2024-06-18 23:51:00,887: INFO/ForkPoolWorker-1] [58f951df-bfe4-4f3a-abb6-74578a9adf6b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T23:51:01.180534968Z [2024-06-18 23:51:01,176: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T23:51:01.229173313Z [2024-06-18 23:51:01,224: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T23:51:01.248047552Z [2024-06-18 23:51:01,242: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T23:51:01.408534245Z [2024-06-18 23:51:01,407: INFO/ForkPoolWorker-1] Getting SDNC list 2024-06-18T23:51:01.412974597Z [2024-06-18 23:51:01,412: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:51:01.455426300Z [2024-06-18 23:51:01,455: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T23:51:01.460600989Z [2024-06-18 23:51:01,460: INFO/ForkPoolWorker-1] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T23:51:01.461009658Z [2024-06-18 23:51:01,460: INFO/ForkPoolWorker-1] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T23:51:01.461706154Z [2024-06-18 23:51:01,461: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-06-18T23:51:01.462001719Z [2024-06-18 23:51:01,461: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T23:51:01.578975373Z [2024-06-18 23:51:01,578: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:51:02.361059513Z [2024-06-18 23:51:02,360: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[58f951df-bfe4-4f3a-abb6-74578a9adf6b] succeeded in 1.4931669569996302s: None 2024-06-18T23:51:02.610729435Z [2024-06-18 23:51:02,610: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T23:51:02.614391880Z [2024-06-18 23:51:02,613: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:51:02.636090247Z [2024-06-18 23:51:02,635: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T23:51:02.637920602Z [2024-06-18 23:51:02,637: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:51:02.638017303Z [2024-06-18 23:51:02,637: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:51:02.638274209Z [2024-06-18 23:51:02,637: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:51:02.638360541Z [2024-06-18 23:51:02,638: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T23:51:02.638726057Z [2024-06-18 23:51:02,638: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-06-18T23:51:02.638797418Z [2024-06-18 23:51:02,638: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:51:02.725547748Z [2024-06-18 23:51:02,725: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:51:02.768014010Z [2024-06-18 23:51:02,767: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-18T23:51:02.771985523Z [2024-06-18 23:51:02,771: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:51:02.791317846Z [2024-06-18 23:51:02,790: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T23:51:02.792633370Z [2024-06-18 23:51:02,792: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:51:02.792746733Z [2024-06-18 23:51:02,792: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:51:02.792771572Z [2024-06-18 23:51:02,792: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:51:02.792781872Z [2024-06-18 23:51:02,792: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-18T23:51:02.793067978Z [2024-06-18 23:51:02,792: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T23:51:02.793085872Z [2024-06-18 23:51:02,792: INFO/ForkPoolWorker-16] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:51:02.908870287Z [2024-06-18 23:51:02,908: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:51:04.912581715Z [2024-06-18 23:51:04,912: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1c7e609c-57b7-4bc9-85d9-513e4a13faaa] succeeded in 4.055135401000371s: None 2024-06-18T23:51:04.987352115Z [2024-06-18 23:51:04,986: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cc34825f-ddde-463c-b9e1-ceac76c4f472] succeeded in 4.141133715000251s: None 2024-06-18T23:52:00.749962452Z [2024-06-18 23:52:00,748: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[677f0edf-8ba3-46e8-b18a-e9c816502cdd] received 2024-06-18T23:52:00.760925531Z [2024-06-18 23:52:00,760: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[321a3925-83fd-41be-971e-6d8041934471] received 2024-06-18T23:52:00.766949945Z [2024-06-18 23:52:00,766: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ec7ab1b4-2630-4599-82d1-4b7916491ad2] received 2024-06-18T23:52:00.772655898Z [2024-06-18 23:52:00,772: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[04eb7014-c3db-4f0e-b4fa-e62ec79ccfe6] received 2024-06-18T23:52:00.778033837Z [2024-06-18 23:52:00,777: INFO/ForkPoolWorker-1] [ec7ab1b4-2630-4599-82d1-4b7916491ad2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T23:52:00.779442067Z [2024-06-18 23:52:00,774: INFO/ForkPoolWorker-15] [677f0edf-8ba3-46e8-b18a-e9c816502cdd] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-18T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-18T23:52:00.781882488Z [2024-06-18 23:52:00,781: INFO/ForkPoolWorker-16] [321a3925-83fd-41be-971e-6d8041934471] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T23:52:00.786840603Z [2024-06-18 23:52:00,786: INFO/ForkPoolWorker-2] [04eb7014-c3db-4f0e-b4fa-e62ec79ccfe6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T23:52:01.099942980Z [2024-06-18 23:52:01,095: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-18T23:52:01.108434516Z [2024-06-18 23:52:01,104: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T23:52:01.123995388Z [2024-06-18 23:52:01,119: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T23:52:01.137227564Z [2024-06-18 23:52:01,133: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T23:52:01.333525432Z [2024-06-18 23:52:01,333: INFO/ForkPoolWorker-16] Getting SDNC list 2024-06-18T23:52:01.342514868Z [2024-06-18 23:52:01,341: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:52:01.389950617Z [2024-06-18 23:52:01,389: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:52:01.413367598Z [2024-06-18 23:52:01,413: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T23:52:01.418372105Z [2024-06-18 23:52:01,418: INFO/ForkPoolWorker-16] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T23:52:01.418713337Z [2024-06-18 23:52:01,418: INFO/ForkPoolWorker-16] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T23:52:01.418765255Z [2024-06-18 23:52:01,418: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-06-18T23:52:01.420693822Z [2024-06-18 23:52:01,420: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T23:52:01.611075449Z [2024-06-18 23:52:01,610: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:52:02.174377692Z [2024-06-18 23:52:02,173: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[677f0edf-8ba3-46e8-b18a-e9c816502cdd] succeeded in 1.4133647179996842s: None 2024-06-18T23:52:02.361471097Z [2024-06-18 23:52:02,361: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[321a3925-83fd-41be-971e-6d8041934471] succeeded in 1.5920473980004317s: None 2024-06-18T23:52:02.720954670Z [2024-06-18 23:52:02,720: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-18T23:52:02.724309503Z [2024-06-18 23:52:02,723: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:52:02.749040754Z [2024-06-18 23:52:02,748: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-18T23:52:02.750336000Z [2024-06-18 23:52:02,750: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:52:02.750347316Z [2024-06-18 23:52:02,750: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:52:02.750488035Z [2024-06-18 23:52:02,750: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:52:02.750498124Z [2024-06-18 23:52:02,750: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-18T23:52:02.750967710Z [2024-06-18 23:52:02,750: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T23:52:02.750975720Z [2024-06-18 23:52:02,750: INFO/ForkPoolWorker-2] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:52:02.828065283Z [2024-06-18 23:52:02,827: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-18T23:52:02.831652753Z [2024-06-18 23:52:02,831: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:52:02.846994946Z [2024-06-18 23:52:02,846: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:52:02.856417982Z [2024-06-18 23:52:02,856: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T23:52:02.858156322Z [2024-06-18 23:52:02,857: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:52:02.858603099Z [2024-06-18 23:52:02,858: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:52:02.858863716Z [2024-06-18 23:52:02,858: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:52:02.859091394Z [2024-06-18 23:52:02,858: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-18T23:52:02.859463921Z [2024-06-18 23:52:02,859: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-06-18T23:52:02.859727128Z [2024-06-18 23:52:02,859: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:52:02.957272026Z [2024-06-18 23:52:02,956: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:52:04.501600668Z [2024-06-18 23:52:04,500: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[04eb7014-c3db-4f0e-b4fa-e62ec79ccfe6] succeeded in 3.72489659600069s: None 2024-06-18T23:52:05.016764032Z [2024-06-18 23:52:05,016: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ec7ab1b4-2630-4599-82d1-4b7916491ad2] succeeded in 4.247564754999985s: None 2024-06-18T23:53:00.582297733Z [2024-06-18 23:53:00,581: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6417906c-dc77-4190-a3a3-a9529f95d6b4] received 2024-06-18T23:53:00.584622625Z [2024-06-18 23:53:00,584: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e803c13d-52f1-440a-9fcd-19bdf05e622c] received 2024-06-18T23:53:00.594717642Z [2024-06-18 23:53:00,594: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4c978a1f-3a18-483f-bd8d-af58dc7d7aea] received 2024-06-18T23:53:00.599562580Z [2024-06-18 23:53:00,599: INFO/ForkPoolWorker-16] [e803c13d-52f1-440a-9fcd-19bdf05e622c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T23:53:00.599953664Z [2024-06-18 23:53:00,599: INFO/ForkPoolWorker-15] [6417906c-dc77-4190-a3a3-a9529f95d6b4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T23:53:00.607716341Z [2024-06-18 23:53:00,607: INFO/ForkPoolWorker-1] [4c978a1f-3a18-483f-bd8d-af58dc7d7aea] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T23:53:00.899843484Z [2024-06-18 23:53:00,896: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T23:53:00.912708051Z [2024-06-18 23:53:00,909: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T23:53:01.007151504Z [2024-06-18 23:53:01,001: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T23:53:01.188063920Z [2024-06-18 23:53:01,187: INFO/ForkPoolWorker-1] Getting SDNC list 2024-06-18T23:53:01.192644161Z [2024-06-18 23:53:01,192: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:53:01.224927609Z [2024-06-18 23:53:01,224: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T23:53:01.226411936Z [2024-06-18 23:53:01,226: INFO/ForkPoolWorker-1] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T23:53:01.226627512Z [2024-06-18 23:53:01,226: INFO/ForkPoolWorker-1] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T23:53:01.226771257Z [2024-06-18 23:53:01,226: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-06-18T23:53:01.227099301Z [2024-06-18 23:53:01,226: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T23:53:01.321770914Z [2024-06-18 23:53:01,321: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:53:01.968467792Z [2024-06-18 23:53:01,968: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4c978a1f-3a18-483f-bd8d-af58dc7d7aea] succeeded in 1.3690161659997102s: None 2024-06-18T23:53:02.077164694Z [2024-06-18 23:53:02,076: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-18T23:53:02.080456565Z [2024-06-18 23:53:02,080: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:53:02.104561794Z [2024-06-18 23:53:02,104: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T23:53:02.106056351Z [2024-06-18 23:53:02,105: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:53:02.106181679Z [2024-06-18 23:53:02,106: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:53:02.106366152Z [2024-06-18 23:53:02,106: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:53:02.106469649Z [2024-06-18 23:53:02,106: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-18T23:53:02.106756960Z [2024-06-18 23:53:02,106: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-18T23:53:02.106878186Z [2024-06-18 23:53:02,106: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:53:02.138379323Z [2024-06-18 23:53:02,137: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T23:53:02.141936650Z [2024-06-18 23:53:02,141: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:53:02.165988727Z [2024-06-18 23:53:02,165: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T23:53:02.167704662Z [2024-06-18 23:53:02,167: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:53:02.167720167Z [2024-06-18 23:53:02,167: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:53:02.167946588Z [2024-06-18 23:53:02,167: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:53:02.167978981Z [2024-06-18 23:53:02,167: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T23:53:02.168266651Z [2024-06-18 23:53:02,168: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T23:53:02.168681362Z [2024-06-18 23:53:02,168: INFO/ForkPoolWorker-15] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:53:02.189047873Z [2024-06-18 23:53:02,188: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:53:02.333776641Z [2024-06-18 23:53:02,333: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:53:03.971414296Z [2024-06-18 23:53:03,970: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6417906c-dc77-4190-a3a3-a9529f95d6b4] succeeded in 3.3840250740004194s: None 2024-06-18T23:53:04.298743606Z [2024-06-18 23:53:04,297: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e803c13d-52f1-440a-9fcd-19bdf05e622c] succeeded in 3.711333416999878s: None 2024-06-18T23:54:00.734984187Z [2024-06-18 23:54:00,734: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[974f08e2-b66e-494d-a28a-9798f2193f33] received 2024-06-18T23:54:00.741403681Z [2024-06-18 23:54:00,741: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[39cb66a3-f697-4479-be5a-6546c4dada69] received 2024-06-18T23:54:00.744353893Z [2024-06-18 23:54:00,744: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1fa5f236-285a-4f30-8aea-4152fff4dddf] received 2024-06-18T23:54:00.745922979Z [2024-06-18 23:54:00,745: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2399a748-f419-4818-ab33-e74ce294f6d3] received 2024-06-18T23:54:00.754409772Z [2024-06-18 23:54:00,753: INFO/ForkPoolWorker-16] [39cb66a3-f697-4479-be5a-6546c4dada69] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T23:54:00.761739529Z [2024-06-18 23:54:00,761: INFO/ForkPoolWorker-15] [974f08e2-b66e-494d-a28a-9798f2193f33] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-18T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-18T23:54:00.763212913Z [2024-06-18 23:54:00,761: INFO/ForkPoolWorker-1] [1fa5f236-285a-4f30-8aea-4152fff4dddf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T23:54:00.765414635Z [2024-06-18 23:54:00,765: INFO/ForkPoolWorker-2] [2399a748-f419-4818-ab33-e74ce294f6d3] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T23:54:01.036814918Z [2024-06-18 23:54:01,032: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T23:54:01.124743707Z [2024-06-18 23:54:01,120: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T23:54:01.138369805Z [2024-06-18 23:54:01,134: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T23:54:01.186758506Z [2024-06-18 23:54:01,182: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-18T23:54:01.317264793Z [2024-06-18 23:54:01,316: INFO/ForkPoolWorker-2] Getting SDNC list 2024-06-18T23:54:01.321395770Z [2024-06-18 23:54:01,320: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:54:01.353229311Z [2024-06-18 23:54:01,353: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-18T23:54:01.354922944Z [2024-06-18 23:54:01,354: INFO/ForkPoolWorker-2] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T23:54:01.355097385Z [2024-06-18 23:54:01,354: INFO/ForkPoolWorker-2] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T23:54:01.355162718Z [2024-06-18 23:54:01,355: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-06-18T23:54:01.355527859Z [2024-06-18 23:54:01,355: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T23:54:01.442955585Z [2024-06-18 23:54:01,442: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:54:01.514227367Z [2024-06-18 23:54:01,513: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:54:02.206315523Z [2024-06-18 23:54:02,205: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[974f08e2-b66e-494d-a28a-9798f2193f33] succeeded in 1.4654088770003s: None 2024-06-18T23:54:02.217444346Z [2024-06-18 23:54:02,212: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[2399a748-f419-4818-ab33-e74ce294f6d3] succeeded in 1.463905154000713s: None 2024-06-18T23:54:02.568825437Z [2024-06-18 23:54:02,568: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-18T23:54:02.572515244Z [2024-06-18 23:54:02,571: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:54:02.600874060Z [2024-06-18 23:54:02,600: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T23:54:02.602527852Z [2024-06-18 23:54:02,602: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:54:02.602593673Z [2024-06-18 23:54:02,602: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:54:02.602803405Z [2024-06-18 23:54:02,602: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:54:02.602858897Z [2024-06-18 23:54:02,602: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-18T23:54:02.603196909Z [2024-06-18 23:54:02,603: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T23:54:02.603314520Z [2024-06-18 23:54:02,603: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:54:02.610613523Z [2024-06-18 23:54:02,610: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-18T23:54:02.614652528Z [2024-06-18 23:54:02,614: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:54:02.656840657Z [2024-06-18 23:54:02,655: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T23:54:02.664367231Z [2024-06-18 23:54:02,664: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:54:02.664554828Z [2024-06-18 23:54:02,664: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:54:02.664887124Z [2024-06-18 23:54:02,664: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:54:02.664919489Z [2024-06-18 23:54:02,664: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-18T23:54:02.665349459Z [2024-06-18 23:54:02,665: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-18T23:54:02.665469018Z [2024-06-18 23:54:02,665: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:54:02.744341837Z [2024-06-18 23:54:02,743: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:54:02.802433695Z [2024-06-18 23:54:02,801: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:54:04.303286573Z [2024-06-18 23:54:04,302: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1fa5f236-285a-4f30-8aea-4152fff4dddf] succeeded in 3.556349888999648s: None 2024-06-18T23:54:04.700540694Z [2024-06-18 23:54:04,699: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[39cb66a3-f697-4479-be5a-6546c4dada69] succeeded in 3.9560050310001316s: None 2024-06-18T23:55:00.697706782Z [2024-06-18 23:55:00,696: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[670b5bb8-6078-4805-a976-0c18c0e2e87f] received 2024-06-18T23:55:00.702440366Z [2024-06-18 23:55:00,701: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1ac0ded0-c8e1-4891-9b44-64a0a1eefb77] received 2024-06-18T23:55:00.710994367Z [2024-06-18 23:55:00,710: INFO/ForkPoolWorker-15] [670b5bb8-6078-4805-a976-0c18c0e2e87f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-18T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-18T23:55:00.715158812Z [2024-06-18 23:55:00,714: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6397a76c-171a-4abe-a188-3d5a5985be56] received 2024-06-18T23:55:00.718657866Z [2024-06-18 23:55:00,718: INFO/ForkPoolWorker-16] [1ac0ded0-c8e1-4891-9b44-64a0a1eefb77] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T23:55:00.721113982Z [2024-06-18 23:55:00,720: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e5dd5968-185a-451d-b8f8-1c27d1752bf5] received 2024-06-18T23:55:00.733326406Z [2024-06-18 23:55:00,733: INFO/ForkPoolWorker-2] [e5dd5968-185a-451d-b8f8-1c27d1752bf5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T23:55:00.734087607Z [2024-06-18 23:55:00,733: INFO/ForkPoolWorker-1] [6397a76c-171a-4abe-a188-3d5a5985be56] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T23:55:01.054733680Z [2024-06-18 23:55:01,050: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T23:55:01.056116349Z [2024-06-18 23:55:01,051: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T23:55:01.062329243Z [2024-06-18 23:55:01,059: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T23:55:01.146347303Z [2024-06-18 23:55:01,142: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T23:55:01.221044364Z [2024-06-18 23:55:01,220: INFO/ForkPoolWorker-1] Getting SDNC list 2024-06-18T23:55:01.225424111Z [2024-06-18 23:55:01,224: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:55:01.254786921Z [2024-06-18 23:55:01,254: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T23:55:01.256959683Z [2024-06-18 23:55:01,256: INFO/ForkPoolWorker-1] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T23:55:01.257121155Z [2024-06-18 23:55:01,256: INFO/ForkPoolWorker-1] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T23:55:01.257275426Z [2024-06-18 23:55:01,257: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-06-18T23:55:01.257633322Z [2024-06-18 23:55:01,257: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T23:55:01.399331804Z [2024-06-18 23:55:01,398: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:55:02.073101210Z [2024-06-18 23:55:02,072: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6397a76c-171a-4abe-a188-3d5a5985be56] succeeded in 1.3555434859999878s: None 2024-06-18T23:55:02.812013537Z [2024-06-18 23:55:02,811: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-18T23:55:02.815489085Z [2024-06-18 23:55:02,815: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:55:02.863734454Z [2024-06-18 23:55:02,863: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-18T23:55:02.865878730Z [2024-06-18 23:55:02,865: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:55:02.865902612Z [2024-06-18 23:55:02,865: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:55:02.866084408Z [2024-06-18 23:55:02,865: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:55:02.866141962Z [2024-06-18 23:55:02,866: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-18T23:55:02.866417031Z [2024-06-18 23:55:02,866: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T23:55:02.866483461Z [2024-06-18 23:55:02,866: INFO/ForkPoolWorker-2] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:55:03.008196951Z [2024-06-18 23:55:03,007: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-18T23:55:03.015924442Z [2024-06-18 23:55:03,011: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:55:03.022223897Z [2024-06-18 23:55:03,021: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:55:03.081090519Z [2024-06-18 23:55:03,080: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T23:55:03.085419867Z [2024-06-18 23:55:03,085: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:55:03.085889714Z [2024-06-18 23:55:03,085: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:55:03.086060742Z [2024-06-18 23:55:03,085: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:55:03.086112242Z [2024-06-18 23:55:03,086: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-18T23:55:03.086396685Z [2024-06-18 23:55:03,086: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-18T23:55:03.086450319Z [2024-06-18 23:55:03,086: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:55:03.141592954Z [2024-06-18 23:55:03,141: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T23:55:03.146855543Z [2024-06-18 23:55:03,146: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:55:03.187557409Z [2024-06-18 23:55:03,187: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T23:55:03.191332713Z [2024-06-18 23:55:03,191: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:55:03.191598967Z [2024-06-18 23:55:03,191: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:55:03.191906129Z [2024-06-18 23:55:03,191: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:55:03.192173523Z [2024-06-18 23:55:03,191: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T23:55:03.192539319Z [2024-06-18 23:55:03,192: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T23:55:03.192717130Z [2024-06-18 23:55:03,192: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:55:03.195350822Z [2024-06-18 23:55:03,195: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:55:03.321591376Z [2024-06-18 23:55:03,321: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:55:04.157273593Z [2024-06-18 23:55:04,156: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[670b5bb8-6078-4805-a976-0c18c0e2e87f] succeeded in 3.455595424999956s: None 2024-06-18T23:55:04.491236472Z [2024-06-18 23:55:04,490: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[397f5ea3-2e2b-44ab-aafc-69c1ea33d101] received 2024-06-18T23:55:04.497869566Z [2024-06-18 23:55:04,497: INFO/ForkPoolWorker-15] [397f5ea3-2e2b-44ab-aafc-69c1ea33d101] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'split_metrics', 'scheduled__2024-06-18T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-18T23:55:04.808044814Z [2024-06-18 23:55:04,804: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T23:55:04.835275038Z [2024-06-18 23:55:04,834: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[e5dd5968-185a-451d-b8f8-1c27d1752bf5] succeeded in 4.109998531999736s: None 2024-06-18T23:55:05.496821323Z [2024-06-18 23:55:05,496: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1ac0ded0-c8e1-4891-9b44-64a0a1eefb77] succeeded in 4.791541782999957s: None 2024-06-18T23:55:06.005732730Z [2024-06-18 23:55:06,003: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T23:55:06.007800862Z [2024-06-18 23:55:06,007: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:55:06.031464067Z [2024-06-18 23:55:06,031: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T23:55:06.032843277Z [2024-06-18 23:55:06,032: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:55:06.032914273Z [2024-06-18 23:55:06,032: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:55:06.033002773Z [2024-06-18 23:55:06,032: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:55:06.033067187Z [2024-06-18 23:55:06,032: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T23:55:06.033447031Z [2024-06-18 23:55:06,033: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T23:55:06.033462179Z [2024-06-18 23:55:06,033: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:55:06.121632650Z [2024-06-18 23:55:06,121: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:55:06.919111521Z [2024-06-18 23:55:06,918: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[397f5ea3-2e2b-44ab-aafc-69c1ea33d101] succeeded in 2.425818026000343s: None 2024-06-18T23:55:07.233729500Z [2024-06-18 23:55:07,233: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5e885c99-72b9-4fa7-8275-3ca4997b15da] received 2024-06-18T23:55:07.244410963Z [2024-06-18 23:55:07,244: INFO/ForkPoolWorker-15] [5e885c99-72b9-4fa7-8275-3ca4997b15da] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'collect_metrics', 'scheduled__2024-06-18T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-18T23:55:07.538171681Z [2024-06-18 23:55:07,534: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T23:55:08.680482098Z [2024-06-18 23:55:08,680: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T23:55:08.683763518Z [2024-06-18 23:55:08,683: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:55:08.705568908Z [2024-06-18 23:55:08,705: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T23:55:08.707347084Z [2024-06-18 23:55:08,707: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:55:08.707366832Z [2024-06-18 23:55:08,707: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:55:08.707433557Z [2024-06-18 23:55:08,707: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:55:08.707451925Z [2024-06-18 23:55:08,707: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T23:55:08.707773336Z [2024-06-18 23:55:08,707: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T23:55:08.707792726Z [2024-06-18 23:55:08,707: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:55:08.855310839Z [2024-06-18 23:55:08,854: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:55:09.616802614Z [2024-06-18 23:55:09,616: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5e885c99-72b9-4fa7-8275-3ca4997b15da] succeeded in 2.3803109320006115s: None 2024-06-18T23:55:09.636286632Z [2024-06-18 23:55:09,636: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0d09ce8a-eed1-487c-b5d6-d320243a1e64] received 2024-06-18T23:55:09.645470056Z [2024-06-18 23:55:09,645: INFO/ForkPoolWorker-15] [0d09ce8a-eed1-487c-b5d6-d320243a1e64] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'send_prometheus', 'scheduled__2024-06-18T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-18T23:55:09.936056847Z [2024-06-18 23:55:09,932: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-18T23:55:11.086283131Z [2024-06-18 23:55:11,085: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T23:55:11.090005956Z [2024-06-18 23:55:11,089: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:55:11.115205466Z [2024-06-18 23:55:11,114: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T23:55:11.116921378Z [2024-06-18 23:55:11,116: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:55:11.116938482Z [2024-06-18 23:55:11,116: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:55:11.117194161Z [2024-06-18 23:55:11,116: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:55:11.117316998Z [2024-06-18 23:55:11,117: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T23:55:11.120509050Z [2024-06-18 23:55:11,120: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-18T23:55:11.120532095Z [2024-06-18 23:55:11,120: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:55:11.216342219Z [2024-06-18 23:55:11,215: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:55:11.888494821Z [2024-06-18 23:55:11,885: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0d09ce8a-eed1-487c-b5d6-d320243a1e64] succeeded in 2.246072773000378s: None 2024-06-18T23:56:00.874217851Z [2024-06-18 23:56:00,873: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b87b3b90-4f0f-4e6d-9c5e-466d77403a10] received 2024-06-18T23:56:00.882790939Z [2024-06-18 23:56:00,882: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8ba5a99f-7fc2-4e6e-a107-69b072882baf] received 2024-06-18T23:56:00.885707295Z [2024-06-18 23:56:00,885: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[698775d0-1f32-4155-8fa7-d712f08fd04d] received 2024-06-18T23:56:00.890989401Z [2024-06-18 23:56:00,890: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8f19305b-4683-4dfd-8308-14794fd6627b] received 2024-06-18T23:56:00.904581406Z [2024-06-18 23:56:00,904: INFO/ForkPoolWorker-1] [698775d0-1f32-4155-8fa7-d712f08fd04d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T23:56:00.906788315Z [2024-06-18 23:56:00,906: INFO/ForkPoolWorker-15] [b87b3b90-4f0f-4e6d-9c5e-466d77403a10] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-18T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-18T23:56:00.906910363Z [2024-06-18 23:56:00,906: INFO/ForkPoolWorker-2] [8f19305b-4683-4dfd-8308-14794fd6627b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T23:56:00.910662051Z [2024-06-18 23:56:00,910: INFO/ForkPoolWorker-16] [8ba5a99f-7fc2-4e6e-a107-69b072882baf] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T23:56:01.403474771Z [2024-06-18 23:56:01,396: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-18T23:56:01.469356351Z [2024-06-18 23:56:01,458: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T23:56:01.527247172Z [2024-06-18 23:56:01,518: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T23:56:01.565319760Z [2024-06-18 23:56:01,559: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T23:56:01.729842777Z [2024-06-18 23:56:01,729: INFO/ForkPoolWorker-16] Getting SDNC list 2024-06-18T23:56:01.734624750Z [2024-06-18 23:56:01,734: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:56:01.747403190Z [2024-06-18 23:56:01,747: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:56:01.768104116Z [2024-06-18 23:56:01,767: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T23:56:01.772657865Z [2024-06-18 23:56:01,772: INFO/ForkPoolWorker-16] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T23:56:01.772796296Z [2024-06-18 23:56:01,772: INFO/ForkPoolWorker-16] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T23:56:01.772883758Z [2024-06-18 23:56:01,772: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-06-18T23:56:01.773460789Z [2024-06-18 23:56:01,773: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T23:56:01.923660700Z [2024-06-18 23:56:01,923: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:56:02.445627874Z [2024-06-18 23:56:02,445: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b87b3b90-4f0f-4e6d-9c5e-466d77403a10] succeeded in 1.5647743599993191s: None 2024-06-18T23:56:02.611364013Z [2024-06-18 23:56:02,610: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8ba5a99f-7fc2-4e6e-a107-69b072882baf] succeeded in 1.7214308500006155s: None 2024-06-18T23:56:02.946760562Z [2024-06-18 23:56:02,946: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-18T23:56:02.950228695Z [2024-06-18 23:56:02,949: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:56:02.974641348Z [2024-06-18 23:56:02,974: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-18T23:56:02.976609608Z [2024-06-18 23:56:02,976: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:56:02.976799863Z [2024-06-18 23:56:02,976: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:56:02.977047230Z [2024-06-18 23:56:02,976: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:56:02.977222959Z [2024-06-18 23:56:02,976: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-18T23:56:02.977612764Z [2024-06-18 23:56:02,977: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-06-18T23:56:02.977828533Z [2024-06-18 23:56:02,977: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:56:02.980120596Z [2024-06-18 23:56:02,979: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-18T23:56:02.983621811Z [2024-06-18 23:56:02,983: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:56:03.008294783Z [2024-06-18 23:56:03,008: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T23:56:03.009980819Z [2024-06-18 23:56:03,009: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:56:03.010221875Z [2024-06-18 23:56:03,010: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:56:03.010443434Z [2024-06-18 23:56:03,010: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:56:03.010517544Z [2024-06-18 23:56:03,010: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-18T23:56:03.010905833Z [2024-06-18 23:56:03,010: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T23:56:03.011356407Z [2024-06-18 23:56:03,011: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:56:03.090699239Z [2024-06-18 23:56:03,090: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:56:03.118925368Z [2024-06-18 23:56:03,118: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:56:04.672046006Z [2024-06-18 23:56:04,671: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[698775d0-1f32-4155-8fa7-d712f08fd04d] succeeded in 3.7824167290000332s: None 2024-06-18T23:56:04.963399512Z [2024-06-18 23:56:04,962: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[8f19305b-4683-4dfd-8308-14794fd6627b] succeeded in 4.068954244999986s: None 2024-06-18T23:57:00.476952663Z [2024-06-18 23:57:00,476: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9442bf3c-d569-45d6-be5e-224ef82190cd] received 2024-06-18T23:57:00.480172073Z [2024-06-18 23:57:00,479: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[703c0a08-0c49-4dee-bd6b-c896eee0d8c6] received 2024-06-18T23:57:00.486029600Z [2024-06-18 23:57:00,485: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f84ef77b-fdc0-44f8-9741-a82013cd0f26] received 2024-06-18T23:57:00.495609372Z [2024-06-18 23:57:00,495: INFO/ForkPoolWorker-15] [9442bf3c-d569-45d6-be5e-224ef82190cd] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T23:57:00.501498666Z [2024-06-18 23:57:00,500: INFO/ForkPoolWorker-16] [703c0a08-0c49-4dee-bd6b-c896eee0d8c6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T23:57:00.503762383Z [2024-06-18 23:57:00,503: INFO/ForkPoolWorker-1] [f84ef77b-fdc0-44f8-9741-a82013cd0f26] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T23:57:00.809418920Z [2024-06-18 23:57:00,805: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T23:57:00.814836509Z [2024-06-18 23:57:00,810: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T23:57:00.816192181Z [2024-06-18 23:57:00,812: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T23:57:00.975075099Z [2024-06-18 23:57:00,974: INFO/ForkPoolWorker-15] Getting SDNC list 2024-06-18T23:57:00.979135181Z [2024-06-18 23:57:00,978: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:57:01.023793887Z [2024-06-18 23:57:01,021: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T23:57:01.025455500Z [2024-06-18 23:57:01,025: INFO/ForkPoolWorker-15] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T23:57:01.025603182Z [2024-06-18 23:57:01,025: INFO/ForkPoolWorker-15] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T23:57:01.025676384Z [2024-06-18 23:57:01,025: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-06-18T23:57:01.026081412Z [2024-06-18 23:57:01,025: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T23:57:01.144311869Z [2024-06-18 23:57:01,143: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:57:01.817074689Z [2024-06-18 23:57:01,816: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9442bf3c-d569-45d6-be5e-224ef82190cd] succeeded in 1.3377129489999788s: None 2024-06-18T23:57:02.025756167Z [2024-06-18 23:57:02,025: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-18T23:57:02.029332658Z [2024-06-18 23:57:02,028: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:57:02.039869337Z [2024-06-18 23:57:02,039: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-18T23:57:02.044440951Z [2024-06-18 23:57:02,044: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:57:02.050811191Z [2024-06-18 23:57:02,050: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T23:57:02.053120782Z [2024-06-18 23:57:02,052: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:57:02.053337362Z [2024-06-18 23:57:02,053: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:57:02.053555081Z [2024-06-18 23:57:02,053: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:57:02.053710185Z [2024-06-18 23:57:02,053: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-18T23:57:02.054070114Z [2024-06-18 23:57:02,053: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-06-18T23:57:02.054223393Z [2024-06-18 23:57:02,054: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:57:02.070535671Z [2024-06-18 23:57:02,070: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T23:57:02.072172080Z [2024-06-18 23:57:02,071: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:57:02.072293808Z [2024-06-18 23:57:02,072: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:57:02.072521431Z [2024-06-18 23:57:02,072: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:57:02.072529693Z [2024-06-18 23:57:02,072: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-18T23:57:02.072819004Z [2024-06-18 23:57:02,072: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T23:57:02.072926281Z [2024-06-18 23:57:02,072: INFO/ForkPoolWorker-16] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:57:02.142916018Z [2024-06-18 23:57:02,142: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:57:02.167751470Z [2024-06-18 23:57:02,167: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:57:03.819887220Z [2024-06-18 23:57:03,819: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[703c0a08-0c49-4dee-bd6b-c896eee0d8c6] succeeded in 3.3361552829992434s: None 2024-06-18T23:57:04.109101305Z [2024-06-18 23:57:04,108: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f84ef77b-fdc0-44f8-9741-a82013cd0f26] succeeded in 3.619995929999277s: None 2024-06-18T23:58:00.953669437Z [2024-06-18 23:58:00,952: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4d5943ce-92e3-40d6-8cde-42381106ea27] received 2024-06-18T23:58:00.958438748Z [2024-06-18 23:58:00,958: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fdb53a8d-8366-4d92-9ade-a9c9e03d72aa] received 2024-06-18T23:58:00.961940466Z [2024-06-18 23:58:00,961: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[025a9646-ea92-4757-b015-3a8eb71e34bb] received 2024-06-18T23:58:00.973731651Z [2024-06-18 23:58:00,973: INFO/ForkPoolWorker-1] [025a9646-ea92-4757-b015-3a8eb71e34bb] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-18T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-18T23:58:00.973840357Z [2024-06-18 23:58:00,973: INFO/ForkPoolWorker-16] [fdb53a8d-8366-4d92-9ade-a9c9e03d72aa] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T23:58:00.980366334Z [2024-06-18 23:58:00,980: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a3b27f44-cd7f-4f4c-bbb9-bee87cec54ad] received 2024-06-18T23:58:00.982028323Z [2024-06-18 23:58:00,981: INFO/ForkPoolWorker-15] [4d5943ce-92e3-40d6-8cde-42381106ea27] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T23:58:00.997272460Z [2024-06-18 23:58:00,996: INFO/ForkPoolWorker-2] [a3b27f44-cd7f-4f4c-bbb9-bee87cec54ad] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T23:58:01.337939867Z [2024-06-18 23:58:01,331: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T23:58:01.342969309Z [2024-06-18 23:58:01,338: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T23:58:01.364122118Z [2024-06-18 23:58:01,360: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T23:58:01.489229286Z [2024-06-18 23:58:01,484: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-18T23:58:01.515961007Z [2024-06-18 23:58:01,515: INFO/ForkPoolWorker-16] Getting SDNC list 2024-06-18T23:58:01.520380719Z [2024-06-18 23:58:01,519: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:58:01.554299968Z [2024-06-18 23:58:01,554: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T23:58:01.555500616Z [2024-06-18 23:58:01,555: INFO/ForkPoolWorker-16] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T23:58:01.555680513Z [2024-06-18 23:58:01,555: INFO/ForkPoolWorker-16] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T23:58:01.555854424Z [2024-06-18 23:58:01,555: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-06-18T23:58:01.556122736Z [2024-06-18 23:58:01,555: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T23:58:01.694376289Z [2024-06-18 23:58:01,694: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:58:01.818095401Z [2024-06-18 23:58:01,817: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:58:02.629391831Z [2024-06-18 23:58:02,628: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[fdb53a8d-8366-4d92-9ade-a9c9e03d72aa] succeeded in 1.6673625229996105s: None 2024-06-18T23:58:02.637475022Z [2024-06-18 23:58:02,636: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[025a9646-ea92-4757-b015-3a8eb71e34bb] succeeded in 1.6722575199992207s: None 2024-06-18T23:58:02.702190167Z [2024-06-18 23:58:02,701: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T23:58:02.705805126Z [2024-06-18 23:58:02,705: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:58:02.725753561Z [2024-06-18 23:58:02,725: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T23:58:02.726869383Z [2024-06-18 23:58:02,726: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:58:02.726915504Z [2024-06-18 23:58:02,726: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:58:02.727066768Z [2024-06-18 23:58:02,726: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:58:02.727152146Z [2024-06-18 23:58:02,727: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T23:58:02.727387811Z [2024-06-18 23:58:02,727: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-06-18T23:58:02.727440084Z [2024-06-18 23:58:02,727: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:58:02.809732508Z [2024-06-18 23:58:02,809: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-18T23:58:02.812865223Z [2024-06-18 23:58:02,812: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:58:02.820759965Z [2024-06-18 23:58:02,820: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:58:02.835839999Z [2024-06-18 23:58:02,835: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-18T23:58:02.837818230Z [2024-06-18 23:58:02,837: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:58:02.837843771Z [2024-06-18 23:58:02,837: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:58:02.837999330Z [2024-06-18 23:58:02,837: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:58:02.838067619Z [2024-06-18 23:58:02,837: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-18T23:58:02.838607752Z [2024-06-18 23:58:02,838: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T23:58:02.838647529Z [2024-06-18 23:58:02,838: INFO/ForkPoolWorker-2] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:58:02.948134541Z [2024-06-18 23:58:02,947: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:58:04.723105129Z [2024-06-18 23:58:04,722: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a3b27f44-cd7f-4f4c-bbb9-bee87cec54ad] succeeded in 3.738861650999752s: None 2024-06-18T23:58:05.197198081Z [2024-06-18 23:58:05,196: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4d5943ce-92e3-40d6-8cde-42381106ea27] succeeded in 4.238470753999536s: None 2024-06-18T23:59:00.661014295Z [2024-06-18 23:59:00,660: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[acaf895f-56b0-43ed-a2bd-4c3088b7fcff] received 2024-06-18T23:59:00.666404046Z [2024-06-18 23:59:00,666: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5ecf0aee-a688-46cf-9ee1-abeb6e6f04a3] received 2024-06-18T23:59:00.668400242Z [2024-06-18 23:59:00,668: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[18dccb92-d793-4839-98c7-6c2c5b584420] received 2024-06-18T23:59:00.678303452Z [2024-06-18 23:59:00,677: INFO/ForkPoolWorker-15] [acaf895f-56b0-43ed-a2bd-4c3088b7fcff] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-18T23:59:00.678913941Z [2024-06-18 23:59:00,678: INFO/ForkPoolWorker-16] [5ecf0aee-a688-46cf-9ee1-abeb6e6f04a3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-18T23:59:00.688653887Z [2024-06-18 23:59:00,688: INFO/ForkPoolWorker-1] [18dccb92-d793-4839-98c7-6c2c5b584420] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-18T23:59:00.997165783Z [2024-06-18 23:59:00,993: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-18T23:59:01.037817591Z [2024-06-18 23:59:01,028: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-18T23:59:01.044499456Z [2024-06-18 23:59:01,039: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-18T23:59:01.167326518Z [2024-06-18 23:59:01,166: INFO/ForkPoolWorker-1] Getting SDNC list 2024-06-18T23:59:01.171680238Z [2024-06-18 23:59:01,171: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:59:01.200496202Z [2024-06-18 23:59:01,200: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-18T23:59:01.201872819Z [2024-06-18 23:59:01,201: INFO/ForkPoolWorker-1] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-18T23:59:01.202151803Z [2024-06-18 23:59:01,201: INFO/ForkPoolWorker-1] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-18T23:59:01.202304293Z [2024-06-18 23:59:01,202: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-06-18T23:59:01.203027364Z [2024-06-18 23:59:01,202: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-18T23:59:01.310600931Z [2024-06-18 23:59:01,310: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:59:01.901799514Z [2024-06-18 23:59:01,900: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[18dccb92-d793-4839-98c7-6c2c5b584420] succeeded in 1.2276942779999445s: None 2024-06-18T23:59:02.517867430Z [2024-06-18 23:59:02,517: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-18T23:59:02.521413946Z [2024-06-18 23:59:02,520: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:59:02.528665070Z [2024-06-18 23:59:02,528: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-18T23:59:02.532707337Z [2024-06-18 23:59:02,532: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-18T23:59:02.546853099Z [2024-06-18 23:59:02,546: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-18T23:59:02.548748856Z [2024-06-18 23:59:02,548: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:59:02.548774921Z [2024-06-18 23:59:02,548: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:59:02.548993375Z [2024-06-18 23:59:02,548: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:59:02.549007786Z [2024-06-18 23:59:02,548: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-18T23:59:02.549355287Z [2024-06-18 23:59:02,549: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-06-18T23:59:02.549371988Z [2024-06-18 23:59:02,549: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:59:02.571028769Z [2024-06-18 23:59:02,570: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-18T23:59:02.574131444Z [2024-06-18 23:59:02,573: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-18T23:59:02.574416238Z [2024-06-18 23:59:02,573: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-18T23:59:02.574687224Z [2024-06-18 23:59:02,574: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-18T23:59:02.574898050Z [2024-06-18 23:59:02,574: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-18T23:59:02.575413400Z [2024-06-18 23:59:02,575: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-06-18T23:59:02.576168469Z [2024-06-18 23:59:02,575: INFO/ForkPoolWorker-16] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-18T23:59:02.668739003Z [2024-06-18 23:59:02,662: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:59:02.694053424Z [2024-06-18 23:59:02,693: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-18T23:59:04.370225625Z [2024-06-18 23:59:04,369: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5ecf0aee-a688-46cf-9ee1-abeb6e6f04a3] succeeded in 3.7013691089996428s: None 2024-06-18T23:59:04.559892464Z [2024-06-18 23:59:04,559: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[acaf895f-56b0-43ed-a2bd-4c3088b7fcff] succeeded in 3.8966435390002516s: None 2024-06-19T00:00:00.650452296Z [2024-06-19 00:00:00,650: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7ae3dc20-3c15-425a-911c-f73f94728f55] received 2024-06-19T00:00:00.660981335Z [2024-06-19 00:00:00,656: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[72e78bab-2937-4976-a40f-47a9422b9869] received 2024-06-19T00:00:00.665868468Z [2024-06-19 00:00:00,665: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[69074d44-f1ca-4ac4-b299-abdf5b79876d] received 2024-06-19T00:00:00.669388216Z [2024-06-19 00:00:00,669: INFO/ForkPoolWorker-15] [7ae3dc20-3c15-425a-911c-f73f94728f55] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T00:00:00.683818687Z [2024-06-19 00:00:00,683: INFO/ForkPoolWorker-1] [69074d44-f1ca-4ac4-b299-abdf5b79876d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T00:00:00.690458688Z [2024-06-19 00:00:00,689: INFO/ForkPoolWorker-16] [72e78bab-2937-4976-a40f-47a9422b9869] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-18T23:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T00:00:00.691040411Z [2024-06-19 00:00:00,690: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2c98cae7-3be8-4820-8034-1b539c1cd178] received 2024-06-19T00:00:00.700885926Z [2024-06-19 00:00:00,700: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f94d0596-43e9-415a-bf89-eda9d7085dae] received 2024-06-19T00:00:00.717833537Z [2024-06-19 00:00:00,717: INFO/ForkPoolWorker-3] [f94d0596-43e9-415a-bf89-eda9d7085dae] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-18T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-19T00:00:00.722076220Z [2024-06-19 00:00:00,721: INFO/ForkPoolWorker-2] [2c98cae7-3be8-4820-8034-1b539c1cd178] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-18T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T00:00:01.007193711Z [2024-06-19 00:00:01,003: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T00:00:01.091442860Z [2024-06-19 00:00:01,087: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T00:00:01.100677898Z [2024-06-19 00:00:01,096: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T00:00:01.173005328Z [2024-06-19 00:00:01,172: INFO/ForkPoolWorker-16] Getting SDNC list 2024-06-19T00:00:01.177346522Z [2024-06-19 00:00:01,176: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:00:01.218995422Z [2024-06-19 00:00:01,218: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T00:00:01.220511417Z [2024-06-19 00:00:01,220: INFO/ForkPoolWorker-16] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T00:00:01.220617310Z [2024-06-19 00:00:01,220: INFO/ForkPoolWorker-16] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T00:00:01.220725326Z [2024-06-19 00:00:01,220: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-06-19T00:00:01.221106267Z [2024-06-19 00:00:01,220: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T00:00:01.308779738Z [2024-06-19 00:00:01,304: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-19T00:00:01.343183378Z [2024-06-19 00:00:01,302: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T00:00:01.383835562Z [2024-06-19 00:00:01,383: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:00:01.596935106Z [2024-06-19 00:00:01,596: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:00:02.219841726Z [2024-06-19 00:00:02,214: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[f94d0596-43e9-415a-bf89-eda9d7085dae] succeeded in 1.5114376849996916s: None 2024-06-19T00:00:02.281495798Z [2024-06-19 00:00:02,279: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[72e78bab-2937-4976-a40f-47a9422b9869] succeeded in 1.6141544749998502s: None 2024-06-19T00:00:02.811125202Z [2024-06-19 00:00:02,810: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-19T00:00:02.814547343Z [2024-06-19 00:00:02,814: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:00:02.837128274Z [2024-06-19 00:00:02,836: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T00:00:02.840111306Z [2024-06-19 00:00:02,838: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:00:02.840169721Z [2024-06-19 00:00:02,838: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:00:02.840176630Z [2024-06-19 00:00:02,838: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:00:02.840181451Z [2024-06-19 00:00:02,839: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-19T00:00:02.840185089Z [2024-06-19 00:00:02,839: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T00:00:02.840189104Z [2024-06-19 00:00:02,840: INFO/ForkPoolWorker-2] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:00:02.925537518Z [2024-06-19 00:00:02,925: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:00:03.161130649Z [2024-06-19 00:00:03,160: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T00:00:03.164740402Z [2024-06-19 00:00:03,164: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:00:03.192658847Z [2024-06-19 00:00:03,192: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T00:00:03.194036762Z [2024-06-19 00:00:03,193: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:00:03.194102070Z [2024-06-19 00:00:03,193: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:00:03.194182538Z [2024-06-19 00:00:03,194: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:00:03.194205802Z [2024-06-19 00:00:03,194: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T00:00:03.194444725Z [2024-06-19 00:00:03,194: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T00:00:03.194480469Z [2024-06-19 00:00:03,194: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:00:03.267708201Z [2024-06-19 00:00:03,267: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T00:00:03.271333077Z [2024-06-19 00:00:03,270: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:00:03.310599665Z [2024-06-19 00:00:03,310: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T00:00:03.312893899Z [2024-06-19 00:00:03,312: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:00:03.313248008Z [2024-06-19 00:00:03,312: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:00:03.313656533Z [2024-06-19 00:00:03,313: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:00:03.313723441Z [2024-06-19 00:00:03,313: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:00:03.314007101Z [2024-06-19 00:00:03,313: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T00:00:03.314613964Z [2024-06-19 00:00:03,314: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-06-19T00:00:03.316074847Z [2024-06-19 00:00:03,315: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:00:03.459836807Z [2024-06-19 00:00:03,459: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:00:03.630802109Z [2024-06-19 00:00:03,630: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[2c98cae7-3be8-4820-8034-1b539c1cd178] succeeded in 2.9268831330000467s: None 2024-06-19T00:00:03.920507898Z [2024-06-19 00:00:03,920: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a2a8cd42-d601-4f45-9660-6d6f3f73f75d] received 2024-06-19T00:00:03.940730105Z [2024-06-19 00:00:03,940: INFO/ForkPoolWorker-16] [a2a8cd42-d601-4f45-9660-6d6f3f73f75d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'split_metrics', 'scheduled__2024-06-18T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T00:00:04.390991125Z [2024-06-19 00:00:04,387: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T00:00:05.038971132Z [2024-06-19 00:00:05,038: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[69074d44-f1ca-4ac4-b299-abdf5b79876d] succeeded in 4.369917591000558s: None 2024-06-19T00:00:05.383927006Z [2024-06-19 00:00:05,383: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7ae3dc20-3c15-425a-911c-f73f94728f55] succeeded in 4.730150008000237s: None 2024-06-19T00:00:05.601828043Z [2024-06-19 00:00:05,601: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T00:00:05.605259377Z [2024-06-19 00:00:05,604: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:00:05.624569388Z [2024-06-19 00:00:05,624: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T00:00:05.628213219Z [2024-06-19 00:00:05,627: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:00:05.628548099Z [2024-06-19 00:00:05,628: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:00:05.628679540Z [2024-06-19 00:00:05,628: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:00:05.628738262Z [2024-06-19 00:00:05,628: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T00:00:05.628996013Z [2024-06-19 00:00:05,628: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T00:00:05.629006105Z [2024-06-19 00:00:05,628: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:00:05.733742312Z [2024-06-19 00:00:05,733: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:00:06.421228350Z [2024-06-19 00:00:06,420: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a2a8cd42-d601-4f45-9660-6d6f3f73f75d] succeeded in 2.4924506900006236s: None 2024-06-19T00:00:07.513908936Z [2024-06-19 00:00:07,513: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8a8e4d68-287b-4f45-a97b-a40c2fc0f768] received 2024-06-19T00:00:07.523972724Z [2024-06-19 00:00:07,523: INFO/ForkPoolWorker-15] [8a8e4d68-287b-4f45-a97b-a40c2fc0f768] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'collect_metrics', 'scheduled__2024-06-18T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-19T00:00:07.812794163Z [2024-06-19 00:00:07,809: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T00:00:08.906725243Z [2024-06-19 00:00:08,906: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T00:00:08.910011221Z [2024-06-19 00:00:08,909: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:00:08.933754430Z [2024-06-19 00:00:08,933: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T00:00:08.935615489Z [2024-06-19 00:00:08,935: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:00:08.935666956Z [2024-06-19 00:00:08,935: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:00:08.935883421Z [2024-06-19 00:00:08,935: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:00:08.935900598Z [2024-06-19 00:00:08,935: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T00:00:08.936079557Z [2024-06-19 00:00:08,935: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T00:00:08.936194040Z [2024-06-19 00:00:08,935: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:00:09.051294798Z [2024-06-19 00:00:09,050: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:00:09.706607295Z [2024-06-19 00:00:09,705: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8a8e4d68-287b-4f45-a97b-a40c2fc0f768] succeeded in 2.1909061910000673s: None 2024-06-19T00:00:09.755320442Z [2024-06-19 00:00:09,754: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8b723940-078e-40c9-976d-ea377ce7c13e] received 2024-06-19T00:00:09.767482445Z [2024-06-19 00:00:09,767: INFO/ForkPoolWorker-15] [8b723940-078e-40c9-976d-ea377ce7c13e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'send_prometheus', 'scheduled__2024-06-18T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T00:00:10.047322368Z [2024-06-19 00:00:10,043: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T00:00:11.173152529Z [2024-06-19 00:00:11,172: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T00:00:11.176727931Z [2024-06-19 00:00:11,176: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:00:11.196681047Z [2024-06-19 00:00:11,196: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T00:00:11.197982750Z [2024-06-19 00:00:11,197: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:00:11.198051046Z [2024-06-19 00:00:11,197: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:00:11.198181774Z [2024-06-19 00:00:11,198: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:00:11.198208332Z [2024-06-19 00:00:11,198: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T00:00:11.198473923Z [2024-06-19 00:00:11,198: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T00:00:11.198579816Z [2024-06-19 00:00:11,198: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:00:11.294353514Z [2024-06-19 00:00:11,293: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:00:11.964235683Z [2024-06-19 00:00:11,963: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8b723940-078e-40c9-976d-ea377ce7c13e] succeeded in 2.204554496000128s: None 2024-06-19T00:01:00.380431614Z [2024-06-19 00:01:00,380: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8789660c-9006-4abd-a2df-76ead9c9d60c] received 2024-06-19T00:01:00.382170649Z [2024-06-19 00:01:00,381: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[30a4c93e-f99b-4751-91c2-9e4564fca438] received 2024-06-19T00:01:00.389479287Z [2024-06-19 00:01:00,389: INFO/ForkPoolWorker-15] [8789660c-9006-4abd-a2df-76ead9c9d60c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T00:01:00.391896246Z [2024-06-19 00:01:00,391: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7d5d2b9c-b6dd-4112-a62e-051643558781] received 2024-06-19T00:01:00.395862656Z [2024-06-19 00:01:00,395: INFO/ForkPoolWorker-16] [30a4c93e-f99b-4751-91c2-9e4564fca438] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T00:01:00.400967671Z [2024-06-19 00:01:00,400: INFO/ForkPoolWorker-1] [7d5d2b9c-b6dd-4112-a62e-051643558781] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T00:01:00.688431395Z [2024-06-19 00:01:00,685: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T00:01:00.714811232Z [2024-06-19 00:01:00,711: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T00:01:00.715475719Z [2024-06-19 00:01:00,712: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T00:01:00.904998670Z [2024-06-19 00:01:00,904: INFO/ForkPoolWorker-15] Getting SDNC list 2024-06-19T00:01:00.909160202Z [2024-06-19 00:01:00,908: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:01:00.936972561Z [2024-06-19 00:01:00,936: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T00:01:00.938345482Z [2024-06-19 00:01:00,938: INFO/ForkPoolWorker-15] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T00:01:00.938515599Z [2024-06-19 00:01:00,938: INFO/ForkPoolWorker-15] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T00:01:00.938637731Z [2024-06-19 00:01:00,938: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-06-19T00:01:00.938898031Z [2024-06-19 00:01:00,938: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T00:01:01.050937682Z [2024-06-19 00:01:01,050: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:01:01.633615405Z [2024-06-19 00:01:01,633: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8789660c-9006-4abd-a2df-76ead9c9d60c] succeeded in 1.2511808120007117s: None 2024-06-19T00:01:01.863818830Z [2024-06-19 00:01:01,863: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T00:01:01.867025614Z [2024-06-19 00:01:01,866: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:01:01.889571067Z [2024-06-19 00:01:01,889: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T00:01:01.892150984Z [2024-06-19 00:01:01,890: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:01:01.892181948Z [2024-06-19 00:01:01,891: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:01:01.892190901Z [2024-06-19 00:01:01,891: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:01:01.892199013Z [2024-06-19 00:01:01,891: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T00:01:01.892206183Z [2024-06-19 00:01:01,891: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T00:01:01.892213138Z [2024-06-19 00:01:01,891: INFO/ForkPoolWorker-16] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:01:01.989368700Z [2024-06-19 00:01:01,989: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:01:02.021353750Z [2024-06-19 00:01:02,020: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T00:01:02.024528057Z [2024-06-19 00:01:02,024: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:01:02.052697051Z [2024-06-19 00:01:02,052: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T00:01:02.054409771Z [2024-06-19 00:01:02,054: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:01:02.054425381Z [2024-06-19 00:01:02,054: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:01:02.054566509Z [2024-06-19 00:01:02,054: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:01:02.054576156Z [2024-06-19 00:01:02,054: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T00:01:02.054866355Z [2024-06-19 00:01:02,054: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-06-19T00:01:02.054873424Z [2024-06-19 00:01:02,054: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:01:02.161392893Z [2024-06-19 00:01:02,161: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:01:03.539344790Z [2024-06-19 00:01:03,538: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[30a4c93e-f99b-4751-91c2-9e4564fca438] succeeded in 3.154141003999939s: None 2024-06-19T00:01:04.219964639Z [2024-06-19 00:01:04,219: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7d5d2b9c-b6dd-4112-a62e-051643558781] succeeded in 3.8259871339996607s: None 2024-06-19T00:02:00.689058670Z [2024-06-19 00:02:00,688: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a6a18842-c71e-4ad3-b942-97ec7e402b1c] received 2024-06-19T00:02:00.693685344Z [2024-06-19 00:02:00,693: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b3c77c01-c0fa-4d03-925d-3994524580a8] received 2024-06-19T00:02:00.699655970Z [2024-06-19 00:02:00,699: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1f201d64-b2a0-49dd-8401-c59453eaee4a] received 2024-06-19T00:02:00.703326382Z [2024-06-19 00:02:00,702: INFO/ForkPoolWorker-15] [a6a18842-c71e-4ad3-b942-97ec7e402b1c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T00:02:00.708521625Z [2024-06-19 00:02:00,708: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b99ba931-6752-499b-906c-234f1be3cbdd] received 2024-06-19T00:02:00.710623300Z [2024-06-19 00:02:00,710: INFO/ForkPoolWorker-16] [b3c77c01-c0fa-4d03-925d-3994524580a8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T00:02:00.719758702Z [2024-06-19 00:02:00,719: INFO/ForkPoolWorker-1] [1f201d64-b2a0-49dd-8401-c59453eaee4a] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-19T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-19T00:02:00.732261715Z [2024-06-19 00:02:00,731: INFO/ForkPoolWorker-2] [b99ba931-6752-499b-906c-234f1be3cbdd] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T00:02:01.023742431Z [2024-06-19 00:02:01,020: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T00:02:01.052641178Z [2024-06-19 00:02:01,049: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T00:02:01.174932054Z [2024-06-19 00:02:01,170: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-19T00:02:01.271627421Z [2024-06-19 00:02:01,267: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T00:02:01.425055745Z [2024-06-19 00:02:01,424: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:02:01.472491436Z [2024-06-19 00:02:01,472: INFO/ForkPoolWorker-2] Getting SDNC list 2024-06-19T00:02:01.478299973Z [2024-06-19 00:02:01,477: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:02:01.518644640Z [2024-06-19 00:02:01,518: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T00:02:01.524694655Z [2024-06-19 00:02:01,524: INFO/ForkPoolWorker-2] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T00:02:01.524802332Z [2024-06-19 00:02:01,524: INFO/ForkPoolWorker-2] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T00:02:01.524921631Z [2024-06-19 00:02:01,524: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-06-19T00:02:01.525202598Z [2024-06-19 00:02:01,525: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T00:02:01.656257228Z [2024-06-19 00:02:01,655: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:02:01.999523475Z [2024-06-19 00:02:01,999: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1f201d64-b2a0-49dd-8401-c59453eaee4a] succeeded in 1.29640165300043s: None 2024-06-19T00:02:02.369843800Z [2024-06-19 00:02:02,369: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T00:02:02.374247525Z [2024-06-19 00:02:02,373: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:02:02.400383220Z [2024-06-19 00:02:02,400: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T00:02:02.403439522Z [2024-06-19 00:02:02,402: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:02:02.403454397Z [2024-06-19 00:02:02,403: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:02:02.403488275Z [2024-06-19 00:02:02,403: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b99ba931-6752-499b-906c-234f1be3cbdd] succeeded in 1.685825207000562s: None 2024-06-19T00:02:02.404327993Z [2024-06-19 00:02:02,403: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:02:02.404492283Z [2024-06-19 00:02:02,404: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T00:02:02.404768531Z [2024-06-19 00:02:02,404: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T00:02:02.405201972Z [2024-06-19 00:02:02,405: INFO/ForkPoolWorker-15] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:02:02.506116306Z [2024-06-19 00:02:02,505: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:02:02.517120237Z [2024-06-19 00:02:02,516: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T00:02:02.520472156Z [2024-06-19 00:02:02,519: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:02:02.559992388Z [2024-06-19 00:02:02,559: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T00:02:02.561677868Z [2024-06-19 00:02:02,561: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:02:02.561694163Z [2024-06-19 00:02:02,561: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:02:02.561851756Z [2024-06-19 00:02:02,561: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:02:02.561879535Z [2024-06-19 00:02:02,561: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T00:02:02.562178375Z [2024-06-19 00:02:02,562: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-19T00:02:02.562342988Z [2024-06-19 00:02:02,562: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:02:02.718817991Z [2024-06-19 00:02:02,718: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:02:04.097362123Z [2024-06-19 00:02:04,096: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a6a18842-c71e-4ad3-b942-97ec7e402b1c] succeeded in 3.405899123999916s: None 2024-06-19T00:02:04.725691826Z [2024-06-19 00:02:04,724: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b3c77c01-c0fa-4d03-925d-3994524580a8] succeeded in 4.0282504249998965s: None 2024-06-19T00:03:00.770891633Z [2024-06-19 00:03:00,770: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[42e0bd18-c6d9-43be-b0d7-211bccd30512] received 2024-06-19T00:03:00.779516135Z [2024-06-19 00:03:00,779: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[76398118-30e8-4e76-9cfb-8c58af678618] received 2024-06-19T00:03:00.796620029Z [2024-06-19 00:03:00,796: INFO/ForkPoolWorker-15] [42e0bd18-c6d9-43be-b0d7-211bccd30512] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T00:03:00.798089269Z [2024-06-19 00:03:00,797: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dc416159-50b1-4476-8781-fe5f954fe039] received 2024-06-19T00:03:00.800405354Z [2024-06-19 00:03:00,800: INFO/ForkPoolWorker-16] [76398118-30e8-4e76-9cfb-8c58af678618] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T00:03:00.832175668Z [2024-06-19 00:03:00,831: INFO/ForkPoolWorker-1] [dc416159-50b1-4476-8781-fe5f954fe039] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T00:03:01.109598363Z [2024-06-19 00:03:01,104: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T00:03:01.144169636Z [2024-06-19 00:03:01,138: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T00:03:01.178219460Z [2024-06-19 00:03:01,173: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T00:03:01.337806436Z [2024-06-19 00:03:01,337: INFO/ForkPoolWorker-15] Getting SDNC list 2024-06-19T00:03:01.342958366Z [2024-06-19 00:03:01,342: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:03:01.367867309Z [2024-06-19 00:03:01,367: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T00:03:01.369532131Z [2024-06-19 00:03:01,369: INFO/ForkPoolWorker-15] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T00:03:01.369698987Z [2024-06-19 00:03:01,369: INFO/ForkPoolWorker-15] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T00:03:01.369834956Z [2024-06-19 00:03:01,369: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-06-19T00:03:01.370573927Z [2024-06-19 00:03:01,370: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T00:03:01.518684694Z [2024-06-19 00:03:01,518: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:03:02.269402304Z [2024-06-19 00:03:02,268: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[42e0bd18-c6d9-43be-b0d7-211bccd30512] succeeded in 1.495330230000036s: None 2024-06-19T00:03:02.521944992Z [2024-06-19 00:03:02,521: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T00:03:02.525207935Z [2024-06-19 00:03:02,524: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:03:02.554002648Z [2024-06-19 00:03:02,553: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T00:03:02.555942609Z [2024-06-19 00:03:02,555: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:03:02.555958887Z [2024-06-19 00:03:02,555: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:03:02.556126428Z [2024-06-19 00:03:02,555: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:03:02.556141684Z [2024-06-19 00:03:02,556: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T00:03:02.556466469Z [2024-06-19 00:03:02,556: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-19T00:03:02.556482333Z [2024-06-19 00:03:02,556: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:03:02.614914815Z [2024-06-19 00:03:02,614: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T00:03:02.618430192Z [2024-06-19 00:03:02,617: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:03:02.656183819Z [2024-06-19 00:03:02,655: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:03:02.660403211Z [2024-06-19 00:03:02,660: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T00:03:02.661982800Z [2024-06-19 00:03:02,661: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:03:02.662097641Z [2024-06-19 00:03:02,661: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:03:02.662273748Z [2024-06-19 00:03:02,662: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:03:02.662365304Z [2024-06-19 00:03:02,662: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T00:03:02.662739124Z [2024-06-19 00:03:02,662: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T00:03:02.662864182Z [2024-06-19 00:03:02,662: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:03:02.750457853Z [2024-06-19 00:03:02,748: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:03:04.957195849Z [2024-06-19 00:03:04,956: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[dc416159-50b1-4476-8781-fe5f954fe039] succeeded in 4.154695561000153s: None 2024-06-19T00:03:05.458510136Z [2024-06-19 00:03:05,457: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[76398118-30e8-4e76-9cfb-8c58af678618] succeeded in 4.672324070999821s: None 2024-06-19T00:04:00.754974634Z [2024-06-19 00:04:00,754: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a9b45f1c-a3ac-45d2-8951-fc33ab59b86a] received 2024-06-19T00:04:00.760110001Z [2024-06-19 00:04:00,759: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aae3b7da-d03c-41ed-a914-141d26222ba2] received 2024-06-19T00:04:00.765220915Z [2024-06-19 00:04:00,764: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2861d832-37b5-46af-8523-0806e776efd4] received 2024-06-19T00:04:00.767498428Z [2024-06-19 00:04:00,767: INFO/ForkPoolWorker-15] [a9b45f1c-a3ac-45d2-8951-fc33ab59b86a] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-19T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-19T00:04:00.776058540Z [2024-06-19 00:04:00,775: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f3212afb-3bec-4779-b5ba-829d7460b5cc] received 2024-06-19T00:04:00.785356257Z [2024-06-19 00:04:00,784: INFO/ForkPoolWorker-1] [2861d832-37b5-46af-8523-0806e776efd4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T00:04:00.785676687Z [2024-06-19 00:04:00,785: INFO/ForkPoolWorker-16] [aae3b7da-d03c-41ed-a914-141d26222ba2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T00:04:00.797734350Z [2024-06-19 00:04:00,797: INFO/ForkPoolWorker-2] [f3212afb-3bec-4779-b5ba-829d7460b5cc] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T00:04:01.163421403Z [2024-06-19 00:04:01,158: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T00:04:01.184853043Z [2024-06-19 00:04:01,180: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T00:04:01.186872017Z [2024-06-19 00:04:01,181: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-19T00:04:01.257563558Z [2024-06-19 00:04:01,252: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T00:04:01.445346788Z [2024-06-19 00:04:01,444: INFO/ForkPoolWorker-2] Getting SDNC list 2024-06-19T00:04:01.449632514Z [2024-06-19 00:04:01,449: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:04:01.495309034Z [2024-06-19 00:04:01,495: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T00:04:01.499664559Z [2024-06-19 00:04:01,499: INFO/ForkPoolWorker-2] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T00:04:01.499737836Z [2024-06-19 00:04:01,499: INFO/ForkPoolWorker-2] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T00:04:01.499800639Z [2024-06-19 00:04:01,499: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-06-19T00:04:01.500016812Z [2024-06-19 00:04:01,499: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T00:04:01.563525503Z [2024-06-19 00:04:01,563: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:04:01.659405533Z [2024-06-19 00:04:01,659: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:04:02.591217232Z [2024-06-19 00:04:02,590: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a9b45f1c-a3ac-45d2-8951-fc33ab59b86a] succeeded in 1.8332659620000413s: None 2024-06-19T00:04:02.721417544Z [2024-06-19 00:04:02,720: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[f3212afb-3bec-4779-b5ba-829d7460b5cc] succeeded in 1.9383544699994673s: None 2024-06-19T00:04:03.113035710Z [2024-06-19 00:04:03,112: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T00:04:03.117032103Z [2024-06-19 00:04:03,116: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:04:03.149876708Z [2024-06-19 00:04:03,149: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T00:04:03.151443088Z [2024-06-19 00:04:03,151: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:04:03.151457902Z [2024-06-19 00:04:03,151: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:04:03.151824499Z [2024-06-19 00:04:03,151: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:04:03.151837087Z [2024-06-19 00:04:03,151: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T00:04:03.152225657Z [2024-06-19 00:04:03,152: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T00:04:03.152234737Z [2024-06-19 00:04:03,152: INFO/ForkPoolWorker-16] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:04:03.223573307Z [2024-06-19 00:04:03,223: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T00:04:03.228214977Z [2024-06-19 00:04:03,227: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:04:03.254207269Z [2024-06-19 00:04:03,253: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:04:03.254362791Z [2024-06-19 00:04:03,254: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T00:04:03.255963029Z [2024-06-19 00:04:03,255: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:04:03.256066816Z [2024-06-19 00:04:03,255: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:04:03.256326707Z [2024-06-19 00:04:03,256: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:04:03.256464137Z [2024-06-19 00:04:03,256: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T00:04:03.257171047Z [2024-06-19 00:04:03,256: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-06-19T00:04:03.257330323Z [2024-06-19 00:04:03,257: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:04:03.364092125Z [2024-06-19 00:04:03,363: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:04:04.920477239Z [2024-06-19 00:04:04,919: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[aae3b7da-d03c-41ed-a914-141d26222ba2] succeeded in 4.157405588000074s: None 2024-06-19T00:04:05.252954041Z [2024-06-19 00:04:05,252: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2861d832-37b5-46af-8523-0806e776efd4] succeeded in 4.484435671999563s: None 2024-06-19T00:05:00.478827181Z [2024-06-19 00:05:00,477: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[10b67d73-e09a-44a6-a9a8-476943621dcb] received 2024-06-19T00:05:00.492850777Z [2024-06-19 00:05:00,492: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1594f579-893e-437a-95dc-7eeb26f67cb1] received 2024-06-19T00:05:00.502211576Z [2024-06-19 00:05:00,501: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7bc36c5a-1840-455e-b0f8-bb11e9255e29] received 2024-06-19T00:05:00.506432879Z [2024-06-19 00:05:00,506: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d2bbf0e0-1f74-48e8-b5e8-2428bb3d54f9] received 2024-06-19T00:05:00.516346659Z [2024-06-19 00:05:00,515: INFO/ForkPoolWorker-16] [1594f579-893e-437a-95dc-7eeb26f67cb1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T00:05:00.520146917Z [2024-06-19 00:05:00,519: INFO/ForkPoolWorker-1] [7bc36c5a-1840-455e-b0f8-bb11e9255e29] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T00:05:00.522085985Z [2024-06-19 00:05:00,521: INFO/ForkPoolWorker-15] [10b67d73-e09a-44a6-a9a8-476943621dcb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-19T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T00:05:00.522574631Z [2024-06-19 00:05:00,522: INFO/ForkPoolWorker-2] [d2bbf0e0-1f74-48e8-b5e8-2428bb3d54f9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T00:05:01.028211825Z [2024-06-19 00:05:01,023: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T00:05:01.066598095Z [2024-06-19 00:05:01,062: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T00:05:01.067452078Z [2024-06-19 00:05:01,057: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T00:05:01.271063913Z [2024-06-19 00:05:01,266: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T00:05:01.455388400Z [2024-06-19 00:05:01,454: INFO/ForkPoolWorker-2] Getting SDNC list 2024-06-19T00:05:01.461361456Z [2024-06-19 00:05:01,460: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:05:01.522859406Z [2024-06-19 00:05:01,522: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T00:05:01.527679747Z [2024-06-19 00:05:01,527: INFO/ForkPoolWorker-2] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T00:05:01.527839522Z [2024-06-19 00:05:01,527: INFO/ForkPoolWorker-2] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T00:05:01.527896789Z [2024-06-19 00:05:01,527: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-06-19T00:05:01.528256409Z [2024-06-19 00:05:01,528: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T00:05:01.743732889Z [2024-06-19 00:05:01,743: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:05:02.773242218Z [2024-06-19 00:05:02,772: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d2bbf0e0-1f74-48e8-b5e8-2428bb3d54f9] succeeded in 2.2618322240005s: None 2024-06-19T00:05:02.775375718Z [2024-06-19 00:05:02,775: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T00:05:02.779449646Z [2024-06-19 00:05:02,778: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:05:02.827500058Z [2024-06-19 00:05:02,827: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T00:05:02.833864656Z [2024-06-19 00:05:02,833: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:05:02.833939890Z [2024-06-19 00:05:02,833: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:05:02.834133039Z [2024-06-19 00:05:02,833: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:05:02.834527831Z [2024-06-19 00:05:02,834: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T00:05:02.834826529Z [2024-06-19 00:05:02,834: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T00:05:02.834876703Z [2024-06-19 00:05:02,834: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:05:02.953509734Z [2024-06-19 00:05:02,953: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:05:03.390588950Z [2024-06-19 00:05:03,390: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T00:05:03.401082407Z [2024-06-19 00:05:03,400: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:05:03.432222333Z [2024-06-19 00:05:03,431: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T00:05:03.434909150Z [2024-06-19 00:05:03,434: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:05:03.435362752Z [2024-06-19 00:05:03,435: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:05:03.435609550Z [2024-06-19 00:05:03,435: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:05:03.435835117Z [2024-06-19 00:05:03,435: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T00:05:03.436412804Z [2024-06-19 00:05:03,436: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-19T00:05:03.436555276Z [2024-06-19 00:05:03,436: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:05:03.590904414Z [2024-06-19 00:05:03,587: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:05:03.733570240Z [2024-06-19 00:05:03,733: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[10b67d73-e09a-44a6-a9a8-476943621dcb] succeeded in 3.238074134999806s: None 2024-06-19T00:05:03.783658024Z [2024-06-19 00:05:03,783: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T00:05:03.787285054Z [2024-06-19 00:05:03,786: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:05:03.843347722Z [2024-06-19 00:05:03,843: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T00:05:03.845472949Z [2024-06-19 00:05:03,845: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:05:03.845580485Z [2024-06-19 00:05:03,845: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:05:03.845879000Z [2024-06-19 00:05:03,845: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:05:03.846025750Z [2024-06-19 00:05:03,845: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T00:05:03.846396106Z [2024-06-19 00:05:03,846: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T00:05:03.846556140Z [2024-06-19 00:05:03,846: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:05:03.971538617Z [2024-06-19 00:05:03,971: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:05:04.315155068Z [2024-06-19 00:05:04,314: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4933d35f-1416-46af-8666-8d834e98f45a] received 2024-06-19T00:05:04.325719954Z [2024-06-19 00:05:04,325: INFO/ForkPoolWorker-15] [4933d35f-1416-46af-8666-8d834e98f45a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'split_metrics', 'scheduled__2024-06-19T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T00:05:04.700160694Z [2024-06-19 00:05:04,696: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T00:05:05.689276381Z [2024-06-19 00:05:05,688: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1594f579-893e-437a-95dc-7eeb26f67cb1] succeeded in 5.188480190000519s: None 2024-06-19T00:05:05.738272403Z [2024-06-19 00:05:05,737: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7bc36c5a-1840-455e-b0f8-bb11e9255e29] succeeded in 5.2329578480002965s: None 2024-06-19T00:05:06.022172619Z [2024-06-19 00:05:06,021: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T00:05:06.025387508Z [2024-06-19 00:05:06,024: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:05:06.049680052Z [2024-06-19 00:05:06,049: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T00:05:06.051300520Z [2024-06-19 00:05:06,050: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:05:06.051318895Z [2024-06-19 00:05:06,051: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:05:06.051512993Z [2024-06-19 00:05:06,051: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:05:06.051531078Z [2024-06-19 00:05:06,051: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T00:05:06.051927015Z [2024-06-19 00:05:06,051: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T00:05:06.051948241Z [2024-06-19 00:05:06,051: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:05:06.179488432Z [2024-06-19 00:05:06,179: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:05:06.909444324Z [2024-06-19 00:05:06,908: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4933d35f-1416-46af-8666-8d834e98f45a] succeeded in 2.588502346000496s: None 2024-06-19T00:05:07.394636972Z [2024-06-19 00:05:07,394: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[561c2ffc-906c-406a-b2af-5f17ff2b5035] received 2024-06-19T00:05:07.408213282Z [2024-06-19 00:05:07,407: INFO/ForkPoolWorker-15] [561c2ffc-906c-406a-b2af-5f17ff2b5035] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'collect_metrics', 'scheduled__2024-06-19T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-19T00:05:07.695064110Z [2024-06-19 00:05:07,692: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T00:05:08.960576384Z [2024-06-19 00:05:08,959: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T00:05:08.964084275Z [2024-06-19 00:05:08,963: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:05:08.991942429Z [2024-06-19 00:05:08,991: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T00:05:08.994495501Z [2024-06-19 00:05:08,994: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:05:08.994517111Z [2024-06-19 00:05:08,994: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:05:08.994819869Z [2024-06-19 00:05:08,994: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:05:08.994950421Z [2024-06-19 00:05:08,994: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T00:05:08.995492293Z [2024-06-19 00:05:08,995: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T00:05:08.995640763Z [2024-06-19 00:05:08,995: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:05:09.106794555Z [2024-06-19 00:05:09,106: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:05:09.727985411Z [2024-06-19 00:05:09,724: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[748588d0-d4e3-465d-aa70-ce52f075476e] received 2024-06-19T00:05:09.743567148Z [2024-06-19 00:05:09,743: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[561c2ffc-906c-406a-b2af-5f17ff2b5035] succeeded in 2.346385053000631s: None 2024-06-19T00:05:09.748368531Z [2024-06-19 00:05:09,748: INFO/ForkPoolWorker-16] [748588d0-d4e3-465d-aa70-ce52f075476e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'send_prometheus', 'scheduled__2024-06-19T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T00:05:10.059815835Z [2024-06-19 00:05:10,056: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T00:05:11.160420051Z [2024-06-19 00:05:11,159: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T00:05:11.164000135Z [2024-06-19 00:05:11,163: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:05:11.188551407Z [2024-06-19 00:05:11,188: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T00:05:11.190204833Z [2024-06-19 00:05:11,189: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:05:11.190224145Z [2024-06-19 00:05:11,190: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:05:11.190608936Z [2024-06-19 00:05:11,190: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:05:11.190878833Z [2024-06-19 00:05:11,190: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T00:05:11.191533744Z [2024-06-19 00:05:11,191: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T00:05:11.191782682Z [2024-06-19 00:05:11,191: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:05:11.296856219Z [2024-06-19 00:05:11,296: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:05:12.023561871Z [2024-06-19 00:05:12,022: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[748588d0-d4e3-465d-aa70-ce52f075476e] succeeded in 2.2890630739993867s: None 2024-06-19T00:06:00.789739313Z [2024-06-19 00:06:00,788: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2e3ef63b-7af9-4bd2-a353-38262ac7fe92] received 2024-06-19T00:06:00.794330142Z [2024-06-19 00:06:00,794: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d6957886-1904-4f3b-92c7-ec0e6267fff4] received 2024-06-19T00:06:00.802626502Z [2024-06-19 00:06:00,802: INFO/ForkPoolWorker-15] [2e3ef63b-7af9-4bd2-a353-38262ac7fe92] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-19T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-19T00:06:00.803319765Z [2024-06-19 00:06:00,803: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[59b722e8-d9df-41b6-8f74-78319275dd8a] received 2024-06-19T00:06:00.807218666Z [2024-06-19 00:06:00,806: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[27c649ec-c106-435c-a6a7-be73163876d0] received 2024-06-19T00:06:00.811749344Z [2024-06-19 00:06:00,811: INFO/ForkPoolWorker-16] [d6957886-1904-4f3b-92c7-ec0e6267fff4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T00:06:00.820984083Z [2024-06-19 00:06:00,820: INFO/ForkPoolWorker-2] [27c649ec-c106-435c-a6a7-be73163876d0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T00:06:00.833167558Z [2024-06-19 00:06:00,832: INFO/ForkPoolWorker-1] [59b722e8-d9df-41b6-8f74-78319275dd8a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T00:06:01.270746075Z [2024-06-19 00:06:01,266: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T00:06:01.291919712Z [2024-06-19 00:06:01,288: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T00:06:01.306233399Z [2024-06-19 00:06:01,299: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T00:06:01.308141109Z [2024-06-19 00:06:01,303: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-19T00:06:01.507440532Z [2024-06-19 00:06:01,506: INFO/ForkPoolWorker-1] Getting SDNC list 2024-06-19T00:06:01.512643909Z [2024-06-19 00:06:01,511: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:06:01.550912660Z [2024-06-19 00:06:01,550: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T00:06:01.552537335Z [2024-06-19 00:06:01,552: INFO/ForkPoolWorker-1] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T00:06:01.552681110Z [2024-06-19 00:06:01,552: INFO/ForkPoolWorker-1] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T00:06:01.552740497Z [2024-06-19 00:06:01,552: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-06-19T00:06:01.552924351Z [2024-06-19 00:06:01,552: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T00:06:01.583768904Z [2024-06-19 00:06:01,583: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:06:01.698434072Z [2024-06-19 00:06:01,698: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:06:02.412778499Z [2024-06-19 00:06:02,412: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2e3ef63b-7af9-4bd2-a353-38262ac7fe92] succeeded in 1.6185535619997609s: None 2024-06-19T00:06:02.577767204Z [2024-06-19 00:06:02,577: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[59b722e8-d9df-41b6-8f74-78319275dd8a] succeeded in 1.768610572000398s: None 2024-06-19T00:06:03.021324647Z [2024-06-19 00:06:03,020: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T00:06:03.024784634Z [2024-06-19 00:06:03,024: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:06:03.039007011Z [2024-06-19 00:06:03,038: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-19T00:06:03.043197747Z [2024-06-19 00:06:03,042: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:06:03.054473946Z [2024-06-19 00:06:03,054: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T00:06:03.057330987Z [2024-06-19 00:06:03,057: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:06:03.057584328Z [2024-06-19 00:06:03,057: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:06:03.058237595Z [2024-06-19 00:06:03,057: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:06:03.058411876Z [2024-06-19 00:06:03,058: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T00:06:03.058843080Z [2024-06-19 00:06:03,058: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T00:06:03.059029514Z [2024-06-19 00:06:03,058: INFO/ForkPoolWorker-16] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:06:03.075245541Z [2024-06-19 00:06:03,074: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T00:06:03.076932983Z [2024-06-19 00:06:03,076: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:06:03.076953424Z [2024-06-19 00:06:03,076: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:06:03.077106898Z [2024-06-19 00:06:03,076: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:06:03.077257307Z [2024-06-19 00:06:03,077: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-19T00:06:03.077524450Z [2024-06-19 00:06:03,077: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-06-19T00:06:03.077538994Z [2024-06-19 00:06:03,077: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:06:03.155467647Z [2024-06-19 00:06:03,155: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:06:03.173904865Z [2024-06-19 00:06:03,173: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:06:04.915264408Z [2024-06-19 00:06:04,914: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d6957886-1904-4f3b-92c7-ec0e6267fff4] succeeded in 4.117983049000031s: None 2024-06-19T00:06:06.065522169Z [2024-06-19 00:06:06,064: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[27c649ec-c106-435c-a6a7-be73163876d0] succeeded in 5.255670038999597s: None 2024-06-19T00:07:00.677475751Z [2024-06-19 00:07:00,677: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f7dbb6fd-cf76-42ff-a185-a070e3a4a936] received 2024-06-19T00:07:00.688921783Z [2024-06-19 00:07:00,688: INFO/ForkPoolWorker-15] [f7dbb6fd-cf76-42ff-a185-a070e3a4a936] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T00:07:00.689074907Z [2024-06-19 00:07:00,688: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[83bf5783-836d-4a0c-ad5b-59ded00ac41f] received 2024-06-19T00:07:00.690850595Z [2024-06-19 00:07:00,690: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4a59e6ce-f93b-433a-9705-1b9e9950776b] received 2024-06-19T00:07:00.703885578Z [2024-06-19 00:07:00,703: INFO/ForkPoolWorker-16] [83bf5783-836d-4a0c-ad5b-59ded00ac41f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T00:07:00.710705934Z [2024-06-19 00:07:00,710: INFO/ForkPoolWorker-1] [4a59e6ce-f93b-433a-9705-1b9e9950776b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T00:07:00.979304912Z [2024-06-19 00:07:00,970: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T00:07:01.038894247Z [2024-06-19 00:07:01,034: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T00:07:01.118878766Z [2024-06-19 00:07:01,113: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T00:07:01.152102805Z [2024-06-19 00:07:01,151: INFO/ForkPoolWorker-15] Getting SDNC list 2024-06-19T00:07:01.156997600Z [2024-06-19 00:07:01,156: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:07:01.179060943Z [2024-06-19 00:07:01,178: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T00:07:01.181326645Z [2024-06-19 00:07:01,180: INFO/ForkPoolWorker-15] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T00:07:01.181766081Z [2024-06-19 00:07:01,181: INFO/ForkPoolWorker-15] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T00:07:01.181880938Z [2024-06-19 00:07:01,181: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-06-19T00:07:01.182128218Z [2024-06-19 00:07:01,182: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T00:07:01.309877040Z [2024-06-19 00:07:01,309: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:07:01.963435676Z [2024-06-19 00:07:01,962: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f7dbb6fd-cf76-42ff-a185-a070e3a4a936] succeeded in 1.2825843390000955s: None 2024-06-19T00:07:02.423573357Z [2024-06-19 00:07:02,423: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T00:07:02.427382885Z [2024-06-19 00:07:02,426: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:07:02.448074717Z [2024-06-19 00:07:02,447: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T00:07:02.449348434Z [2024-06-19 00:07:02,449: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:07:02.449367520Z [2024-06-19 00:07:02,449: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:07:02.449476962Z [2024-06-19 00:07:02,449: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:07:02.449531746Z [2024-06-19 00:07:02,449: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T00:07:02.449745011Z [2024-06-19 00:07:02,449: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-19T00:07:02.449822140Z [2024-06-19 00:07:02,449: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:07:02.524855312Z [2024-06-19 00:07:02,524: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T00:07:02.528943361Z [2024-06-19 00:07:02,527: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:07:02.541330621Z [2024-06-19 00:07:02,540: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:07:02.563558264Z [2024-06-19 00:07:02,563: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T00:07:02.566179958Z [2024-06-19 00:07:02,565: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:07:02.566288260Z [2024-06-19 00:07:02,566: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:07:02.566475130Z [2024-06-19 00:07:02,566: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:07:02.566559323Z [2024-06-19 00:07:02,566: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T00:07:02.566866079Z [2024-06-19 00:07:02,566: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T00:07:02.567011553Z [2024-06-19 00:07:02,566: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:07:02.660554725Z [2024-06-19 00:07:02,660: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:07:04.347267444Z [2024-06-19 00:07:04,346: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4a59e6ce-f93b-433a-9705-1b9e9950776b] succeeded in 3.652451216999907s: None 2024-06-19T00:07:04.705814044Z [2024-06-19 00:07:04,705: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[83bf5783-836d-4a0c-ad5b-59ded00ac41f] succeeded in 4.013185186000555s: None 2024-06-19T00:08:00.324760630Z [2024-06-19 00:08:00,324: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6496af1b-140a-409d-b1b3-f181d3725047] received 2024-06-19T00:08:00.331864025Z [2024-06-19 00:08:00,331: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6926ed9e-ae5d-42d9-80c7-27672843c490] received 2024-06-19T00:08:00.332959346Z [2024-06-19 00:08:00,332: INFO/ForkPoolWorker-15] [6496af1b-140a-409d-b1b3-f181d3725047] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-19T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-19T00:08:00.342944560Z [2024-06-19 00:08:00,342: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cc950b73-68cb-454c-b867-89af87d13836] received 2024-06-19T00:08:00.351457626Z [2024-06-19 00:08:00,348: INFO/ForkPoolWorker-16] [6926ed9e-ae5d-42d9-80c7-27672843c490] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T00:08:00.360327965Z [2024-06-19 00:08:00,358: INFO/ForkPoolWorker-1] [cc950b73-68cb-454c-b867-89af87d13836] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T00:08:00.373529575Z [2024-06-19 00:08:00,373: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[99e79ca5-3a23-47d7-8137-52d5e9bb542c] received 2024-06-19T00:08:00.396360877Z [2024-06-19 00:08:00,396: INFO/ForkPoolWorker-2] [99e79ca5-3a23-47d7-8137-52d5e9bb542c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T00:08:00.689572534Z [2024-06-19 00:08:00,686: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-19T00:08:00.717210796Z [2024-06-19 00:08:00,713: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T00:08:00.737761222Z [2024-06-19 00:08:00,733: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T00:08:00.796370918Z [2024-06-19 00:08:00,790: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T00:08:00.906788732Z [2024-06-19 00:08:00,906: INFO/ForkPoolWorker-1] Getting SDNC list 2024-06-19T00:08:00.913641943Z [2024-06-19 00:08:00,913: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:08:00.953249091Z [2024-06-19 00:08:00,953: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T00:08:00.962119767Z [2024-06-19 00:08:00,961: INFO/ForkPoolWorker-1] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T00:08:00.963163090Z [2024-06-19 00:08:00,962: INFO/ForkPoolWorker-1] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T00:08:00.963371654Z [2024-06-19 00:08:00,963: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-06-19T00:08:00.964581136Z [2024-06-19 00:08:00,964: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T00:08:01.002222447Z [2024-06-19 00:08:01,001: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:08:01.122233472Z [2024-06-19 00:08:01,121: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:08:01.669076941Z [2024-06-19 00:08:01,668: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6496af1b-140a-409d-b1b3-f181d3725047] succeeded in 1.3424698819999321s: None 2024-06-19T00:08:01.868531242Z [2024-06-19 00:08:01,867: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[cc950b73-68cb-454c-b867-89af87d13836] succeeded in 1.5221766340000613s: None 2024-06-19T00:08:02.137794794Z [2024-06-19 00:08:02,137: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-19T00:08:02.141191506Z [2024-06-19 00:08:02,140: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:08:02.174159879Z [2024-06-19 00:08:02,173: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T00:08:02.177869977Z [2024-06-19 00:08:02,177: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:08:02.180361234Z [2024-06-19 00:08:02,180: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:08:02.181279531Z [2024-06-19 00:08:02,180: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:08:02.181388684Z [2024-06-19 00:08:02,181: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-19T00:08:02.182050236Z [2024-06-19 00:08:02,181: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-06-19T00:08:02.182203239Z [2024-06-19 00:08:02,182: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:08:02.230982991Z [2024-06-19 00:08:02,213: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T00:08:02.242358934Z [2024-06-19 00:08:02,235: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:08:02.302332803Z [2024-06-19 00:08:02,302: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:08:02.321791224Z [2024-06-19 00:08:02,321: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T00:08:02.325728525Z [2024-06-19 00:08:02,325: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:08:02.325949492Z [2024-06-19 00:08:02,325: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:08:02.326172369Z [2024-06-19 00:08:02,325: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:08:02.326335254Z [2024-06-19 00:08:02,326: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T00:08:02.326709047Z [2024-06-19 00:08:02,326: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T00:08:02.327348254Z [2024-06-19 00:08:02,327: INFO/ForkPoolWorker-16] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:08:02.434132817Z [2024-06-19 00:08:02,433: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:08:03.899846006Z [2024-06-19 00:08:03,899: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6926ed9e-ae5d-42d9-80c7-27672843c490] succeeded in 3.5647936129998925s: None 2024-06-19T00:08:04.554101895Z [2024-06-19 00:08:04,553: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[99e79ca5-3a23-47d7-8137-52d5e9bb542c] succeeded in 4.174329046000821s: None 2024-06-19T00:09:00.622147382Z [2024-06-19 00:09:00,621: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6f76406c-dc1f-4d83-b0ef-97cf31b17b8c] received 2024-06-19T00:09:00.628555326Z [2024-06-19 00:09:00,627: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aeeaa7b7-7a40-4d9b-b41b-c5ca6dad20e4] received 2024-06-19T00:09:00.636641806Z [2024-06-19 00:09:00,636: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[060e7a00-ffba-4ce9-a302-e871b9b188e6] received 2024-06-19T00:09:00.640056315Z [2024-06-19 00:09:00,638: INFO/ForkPoolWorker-15] [6f76406c-dc1f-4d83-b0ef-97cf31b17b8c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T00:09:00.659871765Z [2024-06-19 00:09:00,654: INFO/ForkPoolWorker-1] [060e7a00-ffba-4ce9-a302-e871b9b188e6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T00:09:00.668877255Z [2024-06-19 00:09:00,667: INFO/ForkPoolWorker-16] [aeeaa7b7-7a40-4d9b-b41b-c5ca6dad20e4] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T00:09:01.030349943Z [2024-06-19 00:09:01,026: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T00:09:01.062870868Z [2024-06-19 00:09:01,058: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T00:09:01.072591904Z [2024-06-19 00:09:01,068: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T00:09:01.257096941Z [2024-06-19 00:09:01,256: INFO/ForkPoolWorker-16] Getting SDNC list 2024-06-19T00:09:01.262075108Z [2024-06-19 00:09:01,261: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:09:01.301011492Z [2024-06-19 00:09:01,300: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T00:09:01.304880223Z [2024-06-19 00:09:01,304: INFO/ForkPoolWorker-16] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T00:09:01.305008474Z [2024-06-19 00:09:01,304: INFO/ForkPoolWorker-16] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T00:09:01.305132888Z [2024-06-19 00:09:01,305: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-06-19T00:09:01.305426905Z [2024-06-19 00:09:01,305: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T00:09:01.428033071Z [2024-06-19 00:09:01,427: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:09:02.106922217Z [2024-06-19 00:09:02,106: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[aeeaa7b7-7a40-4d9b-b41b-c5ca6dad20e4] succeeded in 1.4683596880004188s: None 2024-06-19T00:09:02.326861242Z [2024-06-19 00:09:02,326: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T00:09:02.330393487Z [2024-06-19 00:09:02,329: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:09:02.387307949Z [2024-06-19 00:09:02,387: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T00:09:02.391400209Z [2024-06-19 00:09:02,391: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T00:09:02.392444272Z [2024-06-19 00:09:02,392: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:09:02.392485431Z [2024-06-19 00:09:02,392: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:09:02.392760450Z [2024-06-19 00:09:02,392: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:09:02.392781856Z [2024-06-19 00:09:02,392: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T00:09:02.393033422Z [2024-06-19 00:09:02,392: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-06-19T00:09:02.393522866Z [2024-06-19 00:09:02,393: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:09:02.394818508Z [2024-06-19 00:09:02,394: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:09:02.439068163Z [2024-06-19 00:09:02,438: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T00:09:02.451984869Z [2024-06-19 00:09:02,441: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:09:02.452014484Z [2024-06-19 00:09:02,442: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:09:02.452024709Z [2024-06-19 00:09:02,442: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:09:02.452032546Z [2024-06-19 00:09:02,442: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T00:09:02.452039317Z [2024-06-19 00:09:02,442: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T00:09:02.452046244Z [2024-06-19 00:09:02,442: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:09:02.511212884Z [2024-06-19 00:09:02,510: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:09:02.545522380Z [2024-06-19 00:09:02,545: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:09:04.098625622Z [2024-06-19 00:09:04,097: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[060e7a00-ffba-4ce9-a302-e871b9b188e6] succeeded in 3.4533608520005146s: None 2024-06-19T00:09:04.442086479Z [2024-06-19 00:09:04,441: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6f76406c-dc1f-4d83-b0ef-97cf31b17b8c] succeeded in 3.8148466960001315s: None 2024-06-19T00:10:01.020045253Z [2024-06-19 00:10:01,019: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[81e6ca92-6130-420c-8375-035b4732d73a] received 2024-06-19T00:10:01.023260345Z [2024-06-19 00:10:01,022: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[79e4be17-4b4b-413d-9ef1-277e6b5eb5c5] received 2024-06-19T00:10:01.030837669Z [2024-06-19 00:10:01,030: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[de1776d4-4684-49d6-b8ef-c13139ce69de] received 2024-06-19T00:10:01.034618264Z [2024-06-19 00:10:01,034: INFO/ForkPoolWorker-16] [79e4be17-4b4b-413d-9ef1-277e6b5eb5c5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T00:10:01.035064859Z [2024-06-19 00:10:01,034: INFO/ForkPoolWorker-15] [81e6ca92-6130-420c-8375-035b4732d73a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T00:10:01.042702758Z [2024-06-19 00:10:01,042: INFO/ForkPoolWorker-1] [de1776d4-4684-49d6-b8ef-c13139ce69de] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T00:10:01.044455307Z [2024-06-19 00:10:01,043: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9bcf8ceb-6d99-4ae4-8387-0a465e09ad0d] received 2024-06-19T00:10:01.072089797Z [2024-06-19 00:10:01,071: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[68209378-0ca4-4ea9-8f27-37296cf5ea1d] received 2024-06-19T00:10:01.089594166Z [2024-06-19 00:10:01,089: INFO/ForkPoolWorker-3] [68209378-0ca4-4ea9-8f27-37296cf5ea1d] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-19T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-19T00:10:01.090633115Z [2024-06-19 00:10:01,090: INFO/ForkPoolWorker-2] [9bcf8ceb-6d99-4ae4-8387-0a465e09ad0d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-19T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T00:10:01.345934389Z [2024-06-19 00:10:01,341: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T00:10:01.364651232Z [2024-06-19 00:10:01,361: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T00:10:01.567989619Z [2024-06-19 00:10:01,567: INFO/ForkPoolWorker-1] Getting SDNC list 2024-06-19T00:10:01.573265523Z [2024-06-19 00:10:01,572: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:10:01.604061028Z [2024-06-19 00:10:01,599: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T00:10:01.635195381Z [2024-06-19 00:10:01,634: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T00:10:01.637216673Z [2024-06-19 00:10:01,636: INFO/ForkPoolWorker-1] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T00:10:01.637460845Z [2024-06-19 00:10:01,637: INFO/ForkPoolWorker-1] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T00:10:01.637590628Z [2024-06-19 00:10:01,637: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-06-19T00:10:01.637968567Z [2024-06-19 00:10:01,637: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T00:10:01.683856871Z [2024-06-19 00:10:01,679: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-19T00:10:01.845026332Z [2024-06-19 00:10:01,843: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:10:01.872147661Z [2024-06-19 00:10:01,857: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T00:10:02.129524445Z [2024-06-19 00:10:02,129: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:10:02.686095635Z [2024-06-19 00:10:02,685: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[de1776d4-4684-49d6-b8ef-c13139ce69de] succeeded in 1.6529117549998773s: None 2024-06-19T00:10:02.953485586Z [2024-06-19 00:10:02,953: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[68209378-0ca4-4ea9-8f27-37296cf5ea1d] succeeded in 1.8756270200001381s: None 2024-06-19T00:10:03.317296743Z [2024-06-19 00:10:03,316: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T00:10:03.321025077Z [2024-06-19 00:10:03,320: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:10:03.346879522Z [2024-06-19 00:10:03,346: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T00:10:03.348939934Z [2024-06-19 00:10:03,348: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:10:03.349093609Z [2024-06-19 00:10:03,348: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:10:03.349372607Z [2024-06-19 00:10:03,349: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:10:03.349541770Z [2024-06-19 00:10:03,349: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T00:10:03.349907190Z [2024-06-19 00:10:03,349: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-06-19T00:10:03.350376581Z [2024-06-19 00:10:03,349: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:10:03.352768703Z [2024-06-19 00:10:03,352: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-19T00:10:03.356154771Z [2024-06-19 00:10:03,355: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:10:03.384338109Z [2024-06-19 00:10:03,384: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T00:10:03.385684774Z [2024-06-19 00:10:03,385: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:10:03.385710540Z [2024-06-19 00:10:03,385: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:10:03.385891267Z [2024-06-19 00:10:03,385: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:10:03.385945571Z [2024-06-19 00:10:03,385: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-19T00:10:03.386236880Z [2024-06-19 00:10:03,386: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T00:10:03.386266358Z [2024-06-19 00:10:03,386: INFO/ForkPoolWorker-2] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:10:03.447120307Z [2024-06-19 00:10:03,446: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:10:03.475376621Z [2024-06-19 00:10:03,475: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:10:03.569846948Z [2024-06-19 00:10:03,569: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T00:10:03.573484794Z [2024-06-19 00:10:03,573: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:10:03.618289187Z [2024-06-19 00:10:03,617: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T00:10:03.619942175Z [2024-06-19 00:10:03,619: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:10:03.620173677Z [2024-06-19 00:10:03,619: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:10:03.620407531Z [2024-06-19 00:10:03,620: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:10:03.620555229Z [2024-06-19 00:10:03,620: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T00:10:03.620888334Z [2024-06-19 00:10:03,620: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T00:10:03.621057740Z [2024-06-19 00:10:03,620: INFO/ForkPoolWorker-16] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:10:03.712799452Z [2024-06-19 00:10:03,712: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:10:04.152902635Z [2024-06-19 00:10:04,152: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[9bcf8ceb-6d99-4ae4-8387-0a465e09ad0d] succeeded in 3.1021400130002803s: None 2024-06-19T00:10:04.329686373Z [2024-06-19 00:10:04,329: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9e445988-8ef9-40ed-893f-57e736c7523a] received 2024-06-19T00:10:04.340814240Z [2024-06-19 00:10:04,340: INFO/ForkPoolWorker-1] [9e445988-8ef9-40ed-893f-57e736c7523a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'split_metrics', 'scheduled__2024-06-19T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T00:10:04.656572530Z [2024-06-19 00:10:04,653: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T00:10:05.346510282Z [2024-06-19 00:10:05,346: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[79e4be17-4b4b-413d-9ef1-277e6b5eb5c5] succeeded in 4.321371699999872s: None 2024-06-19T00:10:05.360076539Z [2024-06-19 00:10:05,359: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[81e6ca92-6130-420c-8375-035b4732d73a] succeeded in 4.334996743000374s: None 2024-06-19T00:10:05.825646724Z [2024-06-19 00:10:05,824: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T00:10:05.829029349Z [2024-06-19 00:10:05,828: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:10:05.849855087Z [2024-06-19 00:10:05,849: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T00:10:05.851376444Z [2024-06-19 00:10:05,851: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:10:05.851561147Z [2024-06-19 00:10:05,851: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:10:05.851867400Z [2024-06-19 00:10:05,851: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:10:05.852024177Z [2024-06-19 00:10:05,851: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T00:10:05.852624351Z [2024-06-19 00:10:05,852: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T00:10:05.852829104Z [2024-06-19 00:10:05,852: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:10:05.970507489Z [2024-06-19 00:10:05,970: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:10:06.704109564Z [2024-06-19 00:10:06,703: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9e445988-8ef9-40ed-893f-57e736c7523a] succeeded in 2.370990866000284s: None 2024-06-19T00:10:06.720484817Z [2024-06-19 00:10:06,720: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[da409b05-bc1b-426d-a645-a80cfb6cf2a9] received 2024-06-19T00:10:06.729832071Z [2024-06-19 00:10:06,729: INFO/ForkPoolWorker-15] [da409b05-bc1b-426d-a645-a80cfb6cf2a9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'collect_metrics', 'scheduled__2024-06-19T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-19T00:10:07.072421098Z [2024-06-19 00:10:07,065: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T00:10:08.398411976Z [2024-06-19 00:10:08,397: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T00:10:08.401825566Z [2024-06-19 00:10:08,401: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:10:08.427781141Z [2024-06-19 00:10:08,427: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T00:10:08.429566960Z [2024-06-19 00:10:08,429: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:10:08.429628059Z [2024-06-19 00:10:08,429: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:10:08.429898411Z [2024-06-19 00:10:08,429: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:10:08.429959139Z [2024-06-19 00:10:08,429: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T00:10:08.430606504Z [2024-06-19 00:10:08,430: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T00:10:08.430620298Z [2024-06-19 00:10:08,430: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:10:08.547223483Z [2024-06-19 00:10:08,546: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:10:09.216078460Z [2024-06-19 00:10:09,215: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[da409b05-bc1b-426d-a645-a80cfb6cf2a9] succeeded in 2.4926669429996764s: None 2024-06-19T00:10:09.340023452Z [2024-06-19 00:10:09,339: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a2c07170-8b25-46c3-a9a9-5d853a512aaf] received 2024-06-19T00:10:09.354041389Z [2024-06-19 00:10:09,353: INFO/ForkPoolWorker-15] [a2c07170-8b25-46c3-a9a9-5d853a512aaf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'send_prometheus', 'scheduled__2024-06-19T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T00:10:09.666420022Z [2024-06-19 00:10:09,662: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T00:10:10.869867588Z [2024-06-19 00:10:10,869: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T00:10:10.873658898Z [2024-06-19 00:10:10,872: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:10:10.908089770Z [2024-06-19 00:10:10,907: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T00:10:10.910880514Z [2024-06-19 00:10:10,910: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:10:10.911158876Z [2024-06-19 00:10:10,910: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:10:10.911516551Z [2024-06-19 00:10:10,911: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:10:10.911901084Z [2024-06-19 00:10:10,911: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T00:10:10.912270304Z [2024-06-19 00:10:10,912: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T00:10:10.912476875Z [2024-06-19 00:10:10,912: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:10:11.038192508Z [2024-06-19 00:10:11,037: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:10:11.753872243Z [2024-06-19 00:10:11,753: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a2c07170-8b25-46c3-a9a9-5d853a512aaf] succeeded in 2.4096229650003806s: None 2024-06-19T00:11:01.214990742Z [2024-06-19 00:11:01,214: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[057f4c28-12bf-46ff-822e-e6c435a45724] received 2024-06-19T00:11:01.226046098Z [2024-06-19 00:11:01,225: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6913b387-58ae-49c5-806d-91926e490140] received 2024-06-19T00:11:01.229040200Z [2024-06-19 00:11:01,228: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3050f14d-e11c-435b-ae7a-a9a43113c5d6] received 2024-06-19T00:11:01.241885936Z [2024-06-19 00:11:01,241: INFO/ForkPoolWorker-16] [6913b387-58ae-49c5-806d-91926e490140] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T00:11:01.243115233Z [2024-06-19 00:11:01,242: INFO/ForkPoolWorker-15] [057f4c28-12bf-46ff-822e-e6c435a45724] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T00:11:01.250169692Z [2024-06-19 00:11:01,249: INFO/ForkPoolWorker-1] [3050f14d-e11c-435b-ae7a-a9a43113c5d6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T00:11:01.527182268Z [2024-06-19 00:11:01,523: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T00:11:01.601850371Z [2024-06-19 00:11:01,598: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T00:11:01.625552463Z [2024-06-19 00:11:01,621: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T00:11:01.687177717Z [2024-06-19 00:11:01,686: INFO/ForkPoolWorker-15] Getting SDNC list 2024-06-19T00:11:01.691281901Z [2024-06-19 00:11:01,690: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:11:01.713234041Z [2024-06-19 00:11:01,713: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T00:11:01.714577884Z [2024-06-19 00:11:01,714: INFO/ForkPoolWorker-15] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T00:11:01.714617059Z [2024-06-19 00:11:01,714: INFO/ForkPoolWorker-15] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T00:11:01.714693262Z [2024-06-19 00:11:01,714: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-06-19T00:11:01.715359461Z [2024-06-19 00:11:01,715: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T00:11:01.838442718Z [2024-06-19 00:11:01,838: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:11:02.611391080Z [2024-06-19 00:11:02,610: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[057f4c28-12bf-46ff-822e-e6c435a45724] succeeded in 1.3916613189994678s: None 2024-06-19T00:11:02.972970889Z [2024-06-19 00:11:02,969: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T00:11:02.977246624Z [2024-06-19 00:11:02,976: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:11:03.006981811Z [2024-06-19 00:11:03,006: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T00:11:03.011036091Z [2024-06-19 00:11:03,009: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:11:03.011060717Z [2024-06-19 00:11:03,009: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:11:03.011066523Z [2024-06-19 00:11:03,009: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:11:03.011071339Z [2024-06-19 00:11:03,009: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T00:11:03.011075675Z [2024-06-19 00:11:03,009: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-06-19T00:11:03.011080057Z [2024-06-19 00:11:03,009: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:11:03.098950557Z [2024-06-19 00:11:03,098: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:11:03.102353706Z [2024-06-19 00:11:03,101: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T00:11:03.107382623Z [2024-06-19 00:11:03,105: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:11:03.132709347Z [2024-06-19 00:11:03,126: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T00:11:03.132726788Z [2024-06-19 00:11:03,127: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:11:03.132736105Z [2024-06-19 00:11:03,127: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:11:03.132745082Z [2024-06-19 00:11:03,127: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:11:03.132753625Z [2024-06-19 00:11:03,128: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T00:11:03.132761189Z [2024-06-19 00:11:03,128: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T00:11:03.132769624Z [2024-06-19 00:11:03,128: INFO/ForkPoolWorker-16] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:11:03.216992742Z [2024-06-19 00:11:03,216: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:11:05.574715098Z [2024-06-19 00:11:05,573: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6913b387-58ae-49c5-806d-91926e490140] succeeded in 4.345158772000104s: None 2024-06-19T00:11:05.962069490Z [2024-06-19 00:11:05,961: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3050f14d-e11c-435b-ae7a-a9a43113c5d6] succeeded in 4.7302793840008235s: None 2024-06-19T00:12:00.346977324Z [2024-06-19 00:12:00,346: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2eb76213-24d5-4f27-b894-e9d95611e1be] received 2024-06-19T00:12:00.350235399Z [2024-06-19 00:12:00,349: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8b69f789-b83c-4919-87bc-969a4c566731] received 2024-06-19T00:12:00.362891135Z [2024-06-19 00:12:00,362: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a676e4bf-a19a-4f42-adb5-78b4099d0529] received 2024-06-19T00:12:00.363634600Z [2024-06-19 00:12:00,363: INFO/ForkPoolWorker-15] [2eb76213-24d5-4f27-b894-e9d95611e1be] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-19T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-19T00:12:00.369113197Z [2024-06-19 00:12:00,368: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9e447025-fc05-4d4d-a06f-5a92cd0c21c8] received 2024-06-19T00:12:00.378971632Z [2024-06-19 00:12:00,378: INFO/ForkPoolWorker-16] [8b69f789-b83c-4919-87bc-969a4c566731] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T00:12:00.384503015Z [2024-06-19 00:12:00,384: INFO/ForkPoolWorker-1] [a676e4bf-a19a-4f42-adb5-78b4099d0529] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T00:12:00.384529361Z [2024-06-19 00:12:00,384: INFO/ForkPoolWorker-2] [9e447025-fc05-4d4d-a06f-5a92cd0c21c8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T00:12:00.713181735Z [2024-06-19 00:12:00,709: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T00:12:00.747950030Z [2024-06-19 00:12:00,742: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T00:12:00.848160202Z [2024-06-19 00:12:00,833: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T00:12:00.885666358Z [2024-06-19 00:12:00,885: INFO/ForkPoolWorker-16] Getting SDNC list 2024-06-19T00:12:00.889787530Z [2024-06-19 00:12:00,889: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:12:00.925856377Z [2024-06-19 00:12:00,925: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T00:12:00.928221856Z [2024-06-19 00:12:00,927: INFO/ForkPoolWorker-16] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T00:12:00.928264308Z [2024-06-19 00:12:00,928: INFO/ForkPoolWorker-16] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T00:12:00.928318200Z [2024-06-19 00:12:00,928: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-06-19T00:12:00.928521338Z [2024-06-19 00:12:00,928: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T00:12:01.060380724Z [2024-06-19 00:12:01,056: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-19T00:12:01.089963752Z [2024-06-19 00:12:01,089: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:12:01.380892896Z [2024-06-19 00:12:01,380: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:12:01.685797879Z [2024-06-19 00:12:01,685: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8b69f789-b83c-4919-87bc-969a4c566731] succeeded in 1.3279197800002294s: None 2024-06-19T00:12:01.979268045Z [2024-06-19 00:12:01,978: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2eb76213-24d5-4f27-b894-e9d95611e1be] succeeded in 1.6274153530002877s: None 2024-06-19T00:12:02.538890124Z [2024-06-19 00:12:02,538: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T00:12:02.543492222Z [2024-06-19 00:12:02,542: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:12:02.585582538Z [2024-06-19 00:12:02,585: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T00:12:02.587307570Z [2024-06-19 00:12:02,587: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:12:02.587520362Z [2024-06-19 00:12:02,587: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:12:02.587925439Z [2024-06-19 00:12:02,587: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:12:02.588132160Z [2024-06-19 00:12:02,587: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T00:12:02.588492360Z [2024-06-19 00:12:02,588: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-06-19T00:12:02.588647310Z [2024-06-19 00:12:02,588: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:12:02.697665306Z [2024-06-19 00:12:02,697: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:12:02.716375429Z [2024-06-19 00:12:02,715: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-19T00:12:02.719742972Z [2024-06-19 00:12:02,719: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:12:02.748357672Z [2024-06-19 00:12:02,748: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T00:12:02.751413957Z [2024-06-19 00:12:02,751: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:12:02.751498680Z [2024-06-19 00:12:02,751: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:12:02.751777215Z [2024-06-19 00:12:02,751: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:12:02.751965777Z [2024-06-19 00:12:02,751: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-19T00:12:02.752290201Z [2024-06-19 00:12:02,752: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T00:12:02.752441179Z [2024-06-19 00:12:02,752: INFO/ForkPoolWorker-2] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:12:02.874750628Z [2024-06-19 00:12:02,874: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:12:04.821516648Z [2024-06-19 00:12:04,820: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[9e447025-fc05-4d4d-a06f-5a92cd0c21c8] succeeded in 4.450216127999738s: None 2024-06-19T00:12:05.170960933Z [2024-06-19 00:12:05,170: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a676e4bf-a19a-4f42-adb5-78b4099d0529] succeeded in 4.802333739999995s: None 2024-06-19T00:13:01.316219684Z [2024-06-19 00:13:01,313: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[54e0143d-9ae3-4ef5-a3c8-81c46ea34c27] received 2024-06-19T00:13:01.331014834Z [2024-06-19 00:13:01,330: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6563f657-e41c-43b2-8633-9224911280da] received 2024-06-19T00:13:01.341401028Z [2024-06-19 00:13:01,340: INFO/ForkPoolWorker-15] [54e0143d-9ae3-4ef5-a3c8-81c46ea34c27] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T00:13:01.348089604Z [2024-06-19 00:13:01,347: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2ff71689-605f-42a3-a4e3-040d9752696d] received 2024-06-19T00:13:01.362951052Z [2024-06-19 00:13:01,362: INFO/ForkPoolWorker-16] [6563f657-e41c-43b2-8633-9224911280da] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T00:13:01.373547415Z [2024-06-19 00:13:01,373: INFO/ForkPoolWorker-1] [2ff71689-605f-42a3-a4e3-040d9752696d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T00:13:01.663789551Z [2024-06-19 00:13:01,659: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T00:13:01.665756966Z [2024-06-19 00:13:01,661: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T00:13:01.706725848Z [2024-06-19 00:13:01,701: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T00:13:01.933333864Z [2024-06-19 00:13:01,932: INFO/ForkPoolWorker-16] Getting SDNC list 2024-06-19T00:13:01.937615329Z [2024-06-19 00:13:01,937: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:13:01.985044385Z [2024-06-19 00:13:01,984: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T00:13:01.988092211Z [2024-06-19 00:13:01,987: INFO/ForkPoolWorker-16] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T00:13:01.988345353Z [2024-06-19 00:13:01,987: INFO/ForkPoolWorker-16] Read SDNC 5d4ac1b1-3758-4beb-ade3-990f7ac3c17c (epa_03) 2024-06-19T00:13:01.988633545Z [2024-06-19 00:13:01,988: INFO/ForkPoolWorker-16] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}, {'_id': '5d4ac1b1-3758-4beb-ade3-990f7ac3c17c', 'name': 'epa_03', 'type': 'onos_vpls'}] 2024-06-19T00:13:01.988872357Z [2024-06-19 00:13:01,988: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-06-19T00:13:01.989234450Z [2024-06-19 00:13:01,989: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T00:13:01.998169811Z [2024-06-19 00:13:01,997: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_5d4ac1b1-3758-4beb-ade3-990f7ac3c17c 2024-06-19T00:13:02.106694171Z [2024-06-19 00:13:02,106: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:13:02.837606255Z [2024-06-19 00:13:02,837: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6563f657-e41c-43b2-8633-9224911280da] succeeded in 1.4948613039996417s: None 2024-06-19T00:13:02.956001514Z [2024-06-19 00:13:02,955: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T00:13:02.959242444Z [2024-06-19 00:13:02,958: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:13:03.027975804Z [2024-06-19 00:13:03,027: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T00:13:03.029210724Z [2024-06-19 00:13:03,029: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:13:03.029248638Z [2024-06-19 00:13:03,029: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:13:03.029372656Z [2024-06-19 00:13:03,029: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:13:03.029407355Z [2024-06-19 00:13:03,029: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T00:13:03.029639737Z [2024-06-19 00:13:03,029: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T00:13:03.029674015Z [2024-06-19 00:13:03,029: INFO/ForkPoolWorker-15] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:13:03.107717713Z [2024-06-19 00:13:03,107: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:13:03.147525552Z [2024-06-19 00:13:03,147: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T00:13:03.151129899Z [2024-06-19 00:13:03,150: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:13:03.192260393Z [2024-06-19 00:13:03,191: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T00:13:03.194351434Z [2024-06-19 00:13:03,194: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:13:03.194672766Z [2024-06-19 00:13:03,194: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:13:03.195027537Z [2024-06-19 00:13:03,194: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:13:03.195251935Z [2024-06-19 00:13:03,195: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T00:13:03.195714181Z [2024-06-19 00:13:03,195: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-06-19T00:13:03.196479445Z [2024-06-19 00:13:03,196: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:13:03.308687713Z [2024-06-19 00:13:03,308: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:13:04.831791905Z [2024-06-19 00:13:04,831: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[54e0143d-9ae3-4ef5-a3c8-81c46ea34c27] succeeded in 3.5108326350000425s: None 2024-06-19T00:13:05.332479438Z [2024-06-19 00:13:05,332: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2ff71689-605f-42a3-a4e3-040d9752696d] succeeded in 3.9763813400004437s: None 2024-06-19T00:13:13.206414868Z [2024-06-19 00:13:13,205: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6f5a411c-7c89-4b4f-a1b1-511c29659b91] received 2024-06-19T00:13:13.230313625Z [2024-06-19 00:13:13,229: INFO/ForkPoolWorker-15] [6f5a411c-7c89-4b4f-a1b1-511c29659b91] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_5d4ac1b1-3758-4beb-ade3-990f7ac3c17c', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T00:13:13.526096273Z [2024-06-19 00:13:13,522: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T00:13:13.678903855Z [2024-06-19 00:13:13,678: INFO/ForkPoolWorker-15] Getting SDNC list 2024-06-19T00:13:13.682644182Z [2024-06-19 00:13:13,682: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:13:13.707803850Z [2024-06-19 00:13:13,707: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T00:13:13.709100908Z [2024-06-19 00:13:13,708: INFO/ForkPoolWorker-15] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T00:13:13.709185800Z [2024-06-19 00:13:13,709: INFO/ForkPoolWorker-15] Read SDNC 5d4ac1b1-3758-4beb-ade3-990f7ac3c17c (epa_03) 2024-06-19T00:13:13.709454998Z [2024-06-19 00:13:13,709: INFO/ForkPoolWorker-15] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}, {'_id': '5d4ac1b1-3758-4beb-ade3-990f7ac3c17c', 'name': 'epa_03', 'type': 'onos_vpls'}] 2024-06-19T00:13:13.709548749Z [2024-06-19 00:13:13,709: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-06-19T00:13:13.709982649Z [2024-06-19 00:13:13,709: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T00:13:13.718560844Z [2024-06-19 00:13:13,718: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_5d4ac1b1-3758-4beb-ade3-990f7ac3c17c 2024-06-19T00:13:13.832235212Z [2024-06-19 00:13:13,831: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:13:14.443052142Z [2024-06-19 00:13:14,442: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6f5a411c-7c89-4b4f-a1b1-511c29659b91] succeeded in 1.233261582000523s: None 2024-06-19T00:14:00.360979994Z [2024-06-19 00:14:00,360: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3ccc456a-902a-4463-af18-e7debc1ec7fc] received 2024-06-19T00:14:00.367903126Z [2024-06-19 00:14:00,367: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c715a5cb-5bfe-4482-977b-2dac72a56d60] received 2024-06-19T00:14:00.370036617Z [2024-06-19 00:14:00,369: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[96842907-0369-410d-b66d-3d10f32c3eee] received 2024-06-19T00:14:00.378566083Z [2024-06-19 00:14:00,378: INFO/ForkPoolWorker-15] [3ccc456a-902a-4463-af18-e7debc1ec7fc] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-19T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-19T00:14:00.381088864Z [2024-06-19 00:14:00,380: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[df7c1a1f-84f8-406c-b82d-81537b5f2eba] received 2024-06-19T00:14:00.382066129Z [2024-06-19 00:14:00,381: INFO/ForkPoolWorker-1] [96842907-0369-410d-b66d-3d10f32c3eee] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_5d4ac1b1-3758-4beb-ade3-990f7ac3c17c', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T00:14:00.394892740Z [2024-06-19 00:14:00,394: INFO/ForkPoolWorker-16] [c715a5cb-5bfe-4482-977b-2dac72a56d60] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T00:14:00.401873725Z [2024-06-19 00:14:00,401: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e0655e50-6413-4b26-8081-a65b7e17c8e4] received 2024-06-19T00:14:00.419503319Z [2024-06-19 00:14:00,419: INFO/ForkPoolWorker-2] [df7c1a1f-84f8-406c-b82d-81537b5f2eba] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T00:14:00.423583505Z [2024-06-19 00:14:00,423: INFO/ForkPoolWorker-3] [e0655e50-6413-4b26-8081-a65b7e17c8e4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T00:14:00.715431243Z [2024-06-19 00:14:00,712: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-19T00:14:00.868791970Z [2024-06-19 00:14:00,864: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T00:14:00.915774646Z [2024-06-19 00:14:00,912: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T00:14:00.956675951Z [2024-06-19 00:14:00,956: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:14:01.026835425Z [2024-06-19 00:14:01,022: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T00:14:01.073464012Z [2024-06-19 00:14:01,069: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T00:14:01.087437996Z [2024-06-19 00:14:01,086: INFO/ForkPoolWorker-16] Getting SDNC list 2024-06-19T00:14:01.096001284Z [2024-06-19 00:14:01,091: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:14:01.151078352Z [2024-06-19 00:14:01,150: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T00:14:01.161197188Z [2024-06-19 00:14:01,160: INFO/ForkPoolWorker-16] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T00:14:01.161433382Z [2024-06-19 00:14:01,161: INFO/ForkPoolWorker-16] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T00:14:01.161966507Z [2024-06-19 00:14:01,161: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-06-19T00:14:01.162331327Z [2024-06-19 00:14:01,162: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T00:14:01.296674475Z [2024-06-19 00:14:01,296: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:14:01.407676760Z [2024-06-19 00:14:01,407: INFO/ForkPoolWorker-1] Getting SDNC list 2024-06-19T00:14:01.412333514Z [2024-06-19 00:14:01,411: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:14:01.441942894Z [2024-06-19 00:14:01,441: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T00:14:01.443821907Z [2024-06-19 00:14:01,443: INFO/ForkPoolWorker-1] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T00:14:01.444038904Z [2024-06-19 00:14:01,443: INFO/ForkPoolWorker-1] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T00:14:01.444129102Z [2024-06-19 00:14:01,444: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-06-19T00:14:01.444636691Z [2024-06-19 00:14:01,444: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T00:14:01.457185569Z [2024-06-19 00:14:01,456: WARNING/ForkPoolWorker-1] Dag 'sdnc_status_5d4ac1b1-3758-4beb-ade3-990f7ac3c17c' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T00:14:01.457513626Z [2024-06-19 00:14:01,457: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T00:14:01.458348102Z [2024-06-19 00:14:01,458: INFO/ForkPoolWorker-1] Getting SDNC list 2024-06-19T00:14:01.461041423Z [2024-06-19 00:14:01,460: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:14:01.488678274Z [2024-06-19 00:14:01,488: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T00:14:01.495273606Z [2024-06-19 00:14:01,493: INFO/ForkPoolWorker-1] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T00:14:01.495506432Z [2024-06-19 00:14:01,495: INFO/ForkPoolWorker-1] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T00:14:01.495606630Z [2024-06-19 00:14:01,495: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-06-19T00:14:01.495947340Z [2024-06-19 00:14:01,495: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T00:14:01.499633504Z [2024-06-19 00:14:01,498: ERROR/ForkPoolWorker-1] [96842907-0369-410d-b66d-3d10f32c3eee] Failed to execute task Dag 'sdnc_status_5d4ac1b1-3758-4beb-ade3-990f7ac3c17c' could not be found; either it does not exist or it failed to parse.. 2024-06-19T00:14:01.499647917Z Traceback (most recent call last): 2024-06-19T00:14:01.499652029Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-06-19T00:14:01.499660354Z args.func(args) 2024-06-19T00:14:01.499678762Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-06-19T00:14:01.499711293Z return func(*args, **kwargs) 2024-06-19T00:14:01.499716042Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-06-19T00:14:01.499719205Z return f(*args, **kwargs) 2024-06-19T00:14:01.499722281Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-06-19T00:14:01.499725509Z dag = get_dag(args.subdir, args.dag_id) 2024-06-19T00:14:01.499728491Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-06-19T00:14:01.499732021Z raise AirflowException( 2024-06-19T00:14:01.499735575Z airflow.exceptions.AirflowException: Dag 'sdnc_status_5d4ac1b1-3758-4beb-ade3-990f7ac3c17c' could not be found; either it does not exist or it failed to parse. 2024-06-19T00:14:01.536414200Z [2024-06-19 00:14:01,535: ERROR/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[96842907-0369-410d-b66d-3d10f32c3eee] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 96842907-0369-410d-b66d-3d10f32c3eee') 2024-06-19T00:14:01.536440394Z Traceback (most recent call last): 2024-06-19T00:14:01.536444984Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-06-19T00:14:01.536448404Z R = retval = fun(*args, **kwargs) 2024-06-19T00:14:01.536451599Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-06-19T00:14:01.536455433Z return self.run(*args, **kwargs) 2024-06-19T00:14:01.536460790Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-06-19T00:14:01.536483827Z _execute_in_fork(command_to_exec, celery_task_id) 2024-06-19T00:14:01.536487168Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-06-19T00:14:01.536492293Z raise AirflowException(msg) 2024-06-19T00:14:01.536496245Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 96842907-0369-410d-b66d-3d10f32c3eee 2024-06-19T00:14:01.783211719Z [2024-06-19 00:14:01,782: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3ccc456a-902a-4463-af18-e7debc1ec7fc] succeeded in 1.417006345000118s: None 2024-06-19T00:14:02.147727970Z [2024-06-19 00:14:02,147: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c715a5cb-5bfe-4482-977b-2dac72a56d60] succeeded in 1.7757423439998092s: None 2024-06-19T00:14:02.490995138Z [2024-06-19 00:14:02,490: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-19T00:14:02.494483499Z [2024-06-19 00:14:02,493: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:14:02.525865404Z [2024-06-19 00:14:02,525: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T00:14:02.527430742Z [2024-06-19 00:14:02,527: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:14:02.527573435Z [2024-06-19 00:14:02,527: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:14:02.527852127Z [2024-06-19 00:14:02,527: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:14:02.527981425Z [2024-06-19 00:14:02,527: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-19T00:14:02.528312800Z [2024-06-19 00:14:02,528: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T00:14:02.528782226Z [2024-06-19 00:14:02,528: INFO/ForkPoolWorker-2] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:14:02.531509578Z [2024-06-19 00:14:02,531: INFO/ForkPoolWorker-3] Getting VIM list 2024-06-19T00:14:02.534703478Z [2024-06-19 00:14:02,534: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:14:02.565656848Z [2024-06-19 00:14:02,565: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-06-19T00:14:02.567398696Z [2024-06-19 00:14:02,567: INFO/ForkPoolWorker-3] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:14:02.567531538Z [2024-06-19 00:14:02,567: INFO/ForkPoolWorker-3] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:14:02.570065015Z [2024-06-19 00:14:02,567: INFO/ForkPoolWorker-3] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:14:02.570273341Z [2024-06-19 00:14:02,570: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-06-19T00:14:02.570703779Z [2024-06-19 00:14:02,570: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-06-19T00:14:02.570916793Z [2024-06-19 00:14:02,570: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:14:02.659804524Z [2024-06-19 00:14:02,659: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:14:02.717231504Z [2024-06-19 00:14:02,716: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:14:04.514146253Z [2024-06-19 00:14:04,513: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[df7c1a1f-84f8-406c-b82d-81537b5f2eba] succeeded in 4.1096927449998475s: None 2024-06-19T00:14:05.116207664Z [2024-06-19 00:14:05,115: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[e0655e50-6413-4b26-8081-a65b7e17c8e4] succeeded in 4.712215868000385s: None 2024-06-19T00:14:13.065375310Z [2024-06-19 00:14:13,064: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[75c16503-9aee-4b70-890d-d7dfd2e8ed18] received 2024-06-19T00:14:13.077925970Z [2024-06-19 00:14:13,077: INFO/ForkPoolWorker-15] [75c16503-9aee-4b70-890d-d7dfd2e8ed18] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_5d4ac1b1-3758-4beb-ade3-990f7ac3c17c', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T00:14:13.393501326Z [2024-06-19 00:14:13,389: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T00:14:13.548536223Z [2024-06-19 00:14:13,548: INFO/ForkPoolWorker-15] Getting SDNC list 2024-06-19T00:14:13.554028529Z [2024-06-19 00:14:13,553: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:14:13.581114242Z [2024-06-19 00:14:13,580: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T00:14:13.582336667Z [2024-06-19 00:14:13,582: INFO/ForkPoolWorker-15] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T00:14:13.582590659Z [2024-06-19 00:14:13,582: INFO/ForkPoolWorker-15] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T00:14:13.582747660Z [2024-06-19 00:14:13,582: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-06-19T00:14:13.583037775Z [2024-06-19 00:14:13,582: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T00:14:13.593790540Z [2024-06-19 00:14:13,593: WARNING/ForkPoolWorker-15] Dag 'sdnc_status_5d4ac1b1-3758-4beb-ade3-990f7ac3c17c' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T00:14:13.594245894Z [2024-06-19 00:14:13,594: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T00:14:13.595166138Z [2024-06-19 00:14:13,594: INFO/ForkPoolWorker-15] Getting SDNC list 2024-06-19T00:14:13.598034297Z [2024-06-19 00:14:13,597: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:14:13.615376244Z [2024-06-19 00:14:13,615: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T00:14:13.617166506Z [2024-06-19 00:14:13,616: INFO/ForkPoolWorker-15] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T00:14:13.617445877Z [2024-06-19 00:14:13,617: INFO/ForkPoolWorker-15] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T00:14:13.617653820Z [2024-06-19 00:14:13,617: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-06-19T00:14:13.618037540Z [2024-06-19 00:14:13,617: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T00:14:13.622548077Z [2024-06-19 00:14:13,621: ERROR/ForkPoolWorker-15] [75c16503-9aee-4b70-890d-d7dfd2e8ed18] Failed to execute task Dag 'sdnc_status_5d4ac1b1-3758-4beb-ade3-990f7ac3c17c' could not be found; either it does not exist or it failed to parse.. 2024-06-19T00:14:13.622564029Z Traceback (most recent call last): 2024-06-19T00:14:13.622568307Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-06-19T00:14:13.622572399Z args.func(args) 2024-06-19T00:14:13.622576809Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-06-19T00:14:13.622580619Z return func(*args, **kwargs) 2024-06-19T00:14:13.622583764Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-06-19T00:14:13.622587007Z return f(*args, **kwargs) 2024-06-19T00:14:13.622590259Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-06-19T00:14:13.622593211Z dag = get_dag(args.subdir, args.dag_id) 2024-06-19T00:14:13.622596413Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-06-19T00:14:13.622599662Z raise AirflowException( 2024-06-19T00:14:13.622603293Z airflow.exceptions.AirflowException: Dag 'sdnc_status_5d4ac1b1-3758-4beb-ade3-990f7ac3c17c' could not be found; either it does not exist or it failed to parse. 2024-06-19T00:14:13.660796768Z [2024-06-19 00:14:13,660: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[75c16503-9aee-4b70-890d-d7dfd2e8ed18] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 75c16503-9aee-4b70-890d-d7dfd2e8ed18') 2024-06-19T00:14:13.660830303Z Traceback (most recent call last): 2024-06-19T00:14:13.660836067Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-06-19T00:14:13.660840579Z R = retval = fun(*args, **kwargs) 2024-06-19T00:14:13.660844939Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-06-19T00:14:13.660850348Z return self.run(*args, **kwargs) 2024-06-19T00:14:13.660855573Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-06-19T00:14:13.660860513Z _execute_in_fork(command_to_exec, celery_task_id) 2024-06-19T00:14:13.660864679Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-06-19T00:14:13.660869594Z raise AirflowException(msg) 2024-06-19T00:14:13.660875287Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 75c16503-9aee-4b70-890d-d7dfd2e8ed18 2024-06-19T00:15:00.486986059Z [2024-06-19 00:15:00,486: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e9f96ac5-745d-4e83-a211-c95ee6d24611] received 2024-06-19T00:15:00.492466220Z [2024-06-19 00:15:00,492: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8ed81571-5afb-423b-ac20-7e393dde89b8] received 2024-06-19T00:15:00.498156884Z [2024-06-19 00:15:00,497: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0a711b1d-f57d-4ce3-96a4-db0f39e7b557] received 2024-06-19T00:15:00.503531634Z [2024-06-19 00:15:00,503: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f48a8f36-f8a3-4d2a-9443-87b73530c285] received 2024-06-19T00:15:00.504375382Z [2024-06-19 00:15:00,503: INFO/ForkPoolWorker-16] [8ed81571-5afb-423b-ac20-7e393dde89b8] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T00:15:00.514844044Z [2024-06-19 00:15:00,514: INFO/ForkPoolWorker-1] [0a711b1d-f57d-4ce3-96a4-db0f39e7b557] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T00:15:00.514982082Z [2024-06-19 00:15:00,513: INFO/ForkPoolWorker-2] [f48a8f36-f8a3-4d2a-9443-87b73530c285] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_5d4ac1b1-3758-4beb-ade3-990f7ac3c17c', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T00:15:00.516558124Z [2024-06-19 00:15:00,516: INFO/ForkPoolWorker-15] [e9f96ac5-745d-4e83-a211-c95ee6d24611] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-19T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T00:15:00.521176031Z [2024-06-19 00:15:00,520: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[66820287-7c0e-47ae-98aa-4a2d6485562b] received 2024-06-19T00:15:00.537925283Z [2024-06-19 00:15:00,537: INFO/ForkPoolWorker-3] [66820287-7c0e-47ae-98aa-4a2d6485562b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T00:15:00.850157084Z [2024-06-19 00:15:00,845: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T00:15:00.895005389Z [2024-06-19 00:15:00,891: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T00:15:00.941988082Z [2024-06-19 00:15:00,937: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T00:15:01.078573070Z [2024-06-19 00:15:01,078: INFO/ForkPoolWorker-16] Getting SDNC list 2024-06-19T00:15:01.079979523Z [2024-06-19 00:15:01,079: INFO/ForkPoolWorker-2] Getting SDNC list 2024-06-19T00:15:01.082646712Z [2024-06-19 00:15:01,082: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:15:01.084653532Z [2024-06-19 00:15:01,084: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:15:01.097515032Z [2024-06-19 00:15:01,089: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T00:15:01.107627548Z [2024-06-19 00:15:01,093: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T00:15:01.114916489Z [2024-06-19 00:15:01,114: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T00:15:01.116324646Z [2024-06-19 00:15:01,116: INFO/ForkPoolWorker-2] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T00:15:01.116388309Z [2024-06-19 00:15:01,116: INFO/ForkPoolWorker-2] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T00:15:01.116411118Z [2024-06-19 00:15:01,116: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-06-19T00:15:01.116614529Z [2024-06-19 00:15:01,116: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T00:15:01.124467546Z [2024-06-19 00:15:01,123: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T00:15:01.126205010Z [2024-06-19 00:15:01,125: INFO/ForkPoolWorker-16] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T00:15:01.126315722Z [2024-06-19 00:15:01,126: INFO/ForkPoolWorker-16] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T00:15:01.126321471Z [2024-06-19 00:15:01,126: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-06-19T00:15:01.126714495Z [2024-06-19 00:15:01,126: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T00:15:01.128848257Z [2024-06-19 00:15:01,128: WARNING/ForkPoolWorker-2] Dag 'sdnc_status_5d4ac1b1-3758-4beb-ade3-990f7ac3c17c' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T00:15:01.129081088Z [2024-06-19 00:15:01,128: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T00:15:01.129836875Z [2024-06-19 00:15:01,129: INFO/ForkPoolWorker-2] Getting SDNC list 2024-06-19T00:15:01.138507760Z [2024-06-19 00:15:01,138: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:15:01.176840757Z [2024-06-19 00:15:01,176: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T00:15:01.180914924Z [2024-06-19 00:15:01,180: INFO/ForkPoolWorker-2] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T00:15:01.180966793Z [2024-06-19 00:15:01,180: INFO/ForkPoolWorker-2] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T00:15:01.181040745Z [2024-06-19 00:15:01,180: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-06-19T00:15:01.181219093Z [2024-06-19 00:15:01,181: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T00:15:01.187480896Z [2024-06-19 00:15:01,186: ERROR/ForkPoolWorker-2] [f48a8f36-f8a3-4d2a-9443-87b73530c285] Failed to execute task Dag 'sdnc_status_5d4ac1b1-3758-4beb-ade3-990f7ac3c17c' could not be found; either it does not exist or it failed to parse.. 2024-06-19T00:15:01.187510142Z Traceback (most recent call last): 2024-06-19T00:15:01.187514258Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-06-19T00:15:01.187532860Z args.func(args) 2024-06-19T00:15:01.187537031Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-06-19T00:15:01.187540871Z return func(*args, **kwargs) 2024-06-19T00:15:01.187544059Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-06-19T00:15:01.187546934Z return f(*args, **kwargs) 2024-06-19T00:15:01.187549834Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-06-19T00:15:01.187552776Z dag = get_dag(args.subdir, args.dag_id) 2024-06-19T00:15:01.187555661Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-06-19T00:15:01.187558528Z raise AirflowException( 2024-06-19T00:15:01.187562603Z airflow.exceptions.AirflowException: Dag 'sdnc_status_5d4ac1b1-3758-4beb-ade3-990f7ac3c17c' could not be found; either it does not exist or it failed to parse. 2024-06-19T00:15:01.211362004Z [2024-06-19 00:15:01,210: ERROR/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[f48a8f36-f8a3-4d2a-9443-87b73530c285] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id f48a8f36-f8a3-4d2a-9443-87b73530c285') 2024-06-19T00:15:01.211384258Z Traceback (most recent call last): 2024-06-19T00:15:01.211389960Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-06-19T00:15:01.211393068Z R = retval = fun(*args, **kwargs) 2024-06-19T00:15:01.211396322Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-06-19T00:15:01.211399470Z return self.run(*args, **kwargs) 2024-06-19T00:15:01.211415940Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-06-19T00:15:01.211420134Z _execute_in_fork(command_to_exec, celery_task_id) 2024-06-19T00:15:01.211423515Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-06-19T00:15:01.211428702Z raise AirflowException(msg) 2024-06-19T00:15:01.211433040Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id f48a8f36-f8a3-4d2a-9443-87b73530c285 2024-06-19T00:15:01.269991798Z [2024-06-19 00:15:01,269: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:15:01.916150231Z [2024-06-19 00:15:01,915: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8ed81571-5afb-423b-ac20-7e393dde89b8] succeeded in 1.4203528379994168s: None 2024-06-19T00:15:02.290331524Z [2024-06-19 00:15:02,273: INFO/ForkPoolWorker-3] Getting VIM list 2024-06-19T00:15:02.304656154Z [2024-06-19 00:15:02,303: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:15:02.348365630Z [2024-06-19 00:15:02,348: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-06-19T00:15:02.389595639Z [2024-06-19 00:15:02,389: INFO/ForkPoolWorker-3] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:15:02.389631510Z [2024-06-19 00:15:02,389: INFO/ForkPoolWorker-3] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:15:02.389683729Z [2024-06-19 00:15:02,389: INFO/ForkPoolWorker-3] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:15:02.389745442Z [2024-06-19 00:15:02,389: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-06-19T00:15:02.389961283Z [2024-06-19 00:15:02,389: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-06-19T00:15:02.389975477Z [2024-06-19 00:15:02,389: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:15:02.490284991Z [2024-06-19 00:15:02,490: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:15:02.606301281Z [2024-06-19 00:15:02,605: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T00:15:02.610149952Z [2024-06-19 00:15:02,609: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:15:02.619680012Z [2024-06-19 00:15:02,619: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T00:15:02.623174721Z [2024-06-19 00:15:02,622: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:15:02.642649699Z [2024-06-19 00:15:02,642: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T00:15:02.645750015Z [2024-06-19 00:15:02,645: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:15:02.646453949Z [2024-06-19 00:15:02,646: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:15:02.646710188Z [2024-06-19 00:15:02,646: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:15:02.646945557Z [2024-06-19 00:15:02,646: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T00:15:02.647298675Z [2024-06-19 00:15:02,647: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T00:15:02.647510249Z [2024-06-19 00:15:02,647: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:15:02.650951020Z [2024-06-19 00:15:02,650: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T00:15:02.652323432Z [2024-06-19 00:15:02,652: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:15:02.652621601Z [2024-06-19 00:15:02,652: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:15:02.652804530Z [2024-06-19 00:15:02,652: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:15:02.652847564Z [2024-06-19 00:15:02,652: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T00:15:02.653250670Z [2024-06-19 00:15:02,652: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T00:15:02.653287738Z [2024-06-19 00:15:02,653: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:15:02.783744244Z [2024-06-19 00:15:02,783: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:15:02.822413962Z [2024-06-19 00:15:02,821: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:15:03.535682201Z [2024-06-19 00:15:03,535: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e9f96ac5-745d-4e83-a211-c95ee6d24611] succeeded in 3.0407563729995672s: None 2024-06-19T00:15:03.703926190Z [2024-06-19 00:15:03,703: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2a8ba3e8-968e-4a83-bd58-1742488d77e0] received 2024-06-19T00:15:03.714350938Z [2024-06-19 00:15:03,714: INFO/ForkPoolWorker-15] [2a8ba3e8-968e-4a83-bd58-1742488d77e0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'split_metrics', 'scheduled__2024-06-19T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T00:15:04.019306303Z [2024-06-19 00:15:04,015: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T00:15:04.418007783Z [2024-06-19 00:15:04,417: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[66820287-7c0e-47ae-98aa-4a2d6485562b] succeeded in 3.8913245820003795s: None 2024-06-19T00:15:04.567623273Z [2024-06-19 00:15:04,566: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0a711b1d-f57d-4ce3-96a4-db0f39e7b557] succeeded in 4.0671038070004215s: None 2024-06-19T00:15:05.263801681Z [2024-06-19 00:15:05,263: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T00:15:05.267254666Z [2024-06-19 00:15:05,266: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:15:05.295420323Z [2024-06-19 00:15:05,295: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T00:15:05.297161303Z [2024-06-19 00:15:05,296: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:15:05.297366538Z [2024-06-19 00:15:05,297: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:15:05.297713408Z [2024-06-19 00:15:05,297: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:15:05.297765630Z [2024-06-19 00:15:05,297: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T00:15:05.298130115Z [2024-06-19 00:15:05,297: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T00:15:05.298207906Z [2024-06-19 00:15:05,298: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:15:05.411203372Z [2024-06-19 00:15:05,410: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:15:06.169128795Z [2024-06-19 00:15:06,168: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2a8ba3e8-968e-4a83-bd58-1742488d77e0] succeeded in 2.4600945319998573s: None 2024-06-19T00:15:06.581061865Z [2024-06-19 00:15:06,580: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2714af99-800d-43e4-9605-5dc12f973073] received 2024-06-19T00:15:06.601201644Z [2024-06-19 00:15:06,599: INFO/ForkPoolWorker-15] [2714af99-800d-43e4-9605-5dc12f973073] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'collect_metrics', 'scheduled__2024-06-19T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-19T00:15:06.908810077Z [2024-06-19 00:15:06,905: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T00:15:08.040826200Z [2024-06-19 00:15:08,040: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T00:15:08.043938726Z [2024-06-19 00:15:08,043: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:15:08.068072415Z [2024-06-19 00:15:08,067: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T00:15:08.070223951Z [2024-06-19 00:15:08,069: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:15:08.070242834Z [2024-06-19 00:15:08,070: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:15:08.070514685Z [2024-06-19 00:15:08,070: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:15:08.070662158Z [2024-06-19 00:15:08,070: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T00:15:08.071505255Z [2024-06-19 00:15:08,070: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T00:15:08.071536079Z [2024-06-19 00:15:08,070: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:15:08.177126135Z [2024-06-19 00:15:08,176: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:15:08.868773242Z [2024-06-19 00:15:08,867: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2714af99-800d-43e4-9605-5dc12f973073] succeeded in 2.282829634999871s: None 2024-06-19T00:15:09.033981498Z [2024-06-19 00:15:09,033: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f3931fdb-c6ff-445a-b955-2f7bf9d70c72] received 2024-06-19T00:15:09.043187612Z [2024-06-19 00:15:09,042: INFO/ForkPoolWorker-15] [f3931fdb-c6ff-445a-b955-2f7bf9d70c72] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'send_prometheus', 'scheduled__2024-06-19T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T00:15:09.319774307Z [2024-06-19 00:15:09,316: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T00:15:10.379757386Z [2024-06-19 00:15:10,379: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T00:15:10.382886165Z [2024-06-19 00:15:10,382: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:15:10.399994975Z [2024-06-19 00:15:10,399: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T00:15:10.401897685Z [2024-06-19 00:15:10,401: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:15:10.401910233Z [2024-06-19 00:15:10,401: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:15:10.402045609Z [2024-06-19 00:15:10,401: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:15:10.402056446Z [2024-06-19 00:15:10,401: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T00:15:10.402273042Z [2024-06-19 00:15:10,402: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T00:15:10.402277303Z [2024-06-19 00:15:10,402: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:15:10.473870733Z [2024-06-19 00:15:10,473: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:15:11.097164139Z [2024-06-19 00:15:11,096: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f3931fdb-c6ff-445a-b955-2f7bf9d70c72] succeeded in 2.0589801559999614s: None 2024-06-19T00:15:12.781390134Z [2024-06-19 00:15:12,781: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[99d193d5-0046-42b0-b922-3f6cef5f8ce5] received 2024-06-19T00:15:12.804275310Z [2024-06-19 00:15:12,803: INFO/ForkPoolWorker-15] [99d193d5-0046-42b0-b922-3f6cef5f8ce5] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_5d4ac1b1-3758-4beb-ade3-990f7ac3c17c', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T00:15:13.146236283Z [2024-06-19 00:15:13,137: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T00:15:13.319628846Z [2024-06-19 00:15:13,319: INFO/ForkPoolWorker-15] Getting SDNC list 2024-06-19T00:15:13.323744319Z [2024-06-19 00:15:13,323: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:15:13.348967627Z [2024-06-19 00:15:13,348: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T00:15:13.350410150Z [2024-06-19 00:15:13,350: INFO/ForkPoolWorker-15] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T00:15:13.350643675Z [2024-06-19 00:15:13,350: INFO/ForkPoolWorker-15] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T00:15:13.350786687Z [2024-06-19 00:15:13,350: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-06-19T00:15:13.351166033Z [2024-06-19 00:15:13,350: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T00:15:13.361925168Z [2024-06-19 00:15:13,361: WARNING/ForkPoolWorker-15] Dag 'sdnc_status_5d4ac1b1-3758-4beb-ade3-990f7ac3c17c' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T00:15:13.362156893Z [2024-06-19 00:15:13,362: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T00:15:13.363103740Z [2024-06-19 00:15:13,362: INFO/ForkPoolWorker-15] Getting SDNC list 2024-06-19T00:15:13.365888301Z [2024-06-19 00:15:13,365: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:15:13.385494049Z [2024-06-19 00:15:13,385: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T00:15:13.386763605Z [2024-06-19 00:15:13,386: INFO/ForkPoolWorker-15] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T00:15:13.386940119Z [2024-06-19 00:15:13,386: INFO/ForkPoolWorker-15] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T00:15:13.387090381Z [2024-06-19 00:15:13,386: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-06-19T00:15:13.387541404Z [2024-06-19 00:15:13,387: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T00:15:13.391832585Z [2024-06-19 00:15:13,391: ERROR/ForkPoolWorker-15] [99d193d5-0046-42b0-b922-3f6cef5f8ce5] Failed to execute task Dag 'sdnc_status_5d4ac1b1-3758-4beb-ade3-990f7ac3c17c' could not be found; either it does not exist or it failed to parse.. 2024-06-19T00:15:13.391881332Z Traceback (most recent call last): 2024-06-19T00:15:13.391931190Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-06-19T00:15:13.391959884Z args.func(args) 2024-06-19T00:15:13.391971843Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-06-19T00:15:13.391981386Z return func(*args, **kwargs) 2024-06-19T00:15:13.391989777Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-06-19T00:15:13.391998395Z return f(*args, **kwargs) 2024-06-19T00:15:13.392006715Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-06-19T00:15:13.392015404Z dag = get_dag(args.subdir, args.dag_id) 2024-06-19T00:15:13.392024235Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-06-19T00:15:13.392032712Z raise AirflowException( 2024-06-19T00:15:13.392042230Z airflow.exceptions.AirflowException: Dag 'sdnc_status_5d4ac1b1-3758-4beb-ade3-990f7ac3c17c' could not be found; either it does not exist or it failed to parse. 2024-06-19T00:15:13.413106078Z [2024-06-19 00:15:13,412: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[99d193d5-0046-42b0-b922-3f6cef5f8ce5] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 99d193d5-0046-42b0-b922-3f6cef5f8ce5') 2024-06-19T00:15:13.413155718Z Traceback (most recent call last): 2024-06-19T00:15:13.413170026Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-06-19T00:15:13.413182449Z R = retval = fun(*args, **kwargs) 2024-06-19T00:15:13.413195457Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-06-19T00:15:13.413246163Z return self.run(*args, **kwargs) 2024-06-19T00:15:13.413260615Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-06-19T00:15:13.413273701Z _execute_in_fork(command_to_exec, celery_task_id) 2024-06-19T00:15:13.413286141Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-06-19T00:15:13.413299667Z raise AirflowException(msg) 2024-06-19T00:15:13.413313206Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 99d193d5-0046-42b0-b922-3f6cef5f8ce5 2024-06-19T00:16:00.559847057Z [2024-06-19 00:16:00,559: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[59467b43-c191-42d9-b7cb-4ce0a1b06fad] received 2024-06-19T00:16:00.561710253Z [2024-06-19 00:16:00,561: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[71955a77-5b0f-4669-8018-fa0829b18d48] received 2024-06-19T00:16:00.562967507Z [2024-06-19 00:16:00,562: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[01d0261f-1401-440b-9dc1-e65309bd451f] received 2024-06-19T00:16:00.564842223Z [2024-06-19 00:16:00,564: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ac804781-7a78-4404-88c5-5cf57287539e] received 2024-06-19T00:16:00.573684038Z [2024-06-19 00:16:00,573: INFO/ForkPoolWorker-2] [ac804781-7a78-4404-88c5-5cf57287539e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T00:16:00.574439639Z [2024-06-19 00:16:00,574: INFO/ForkPoolWorker-1] [01d0261f-1401-440b-9dc1-e65309bd451f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T00:16:00.585228550Z [2024-06-19 00:16:00,584: INFO/ForkPoolWorker-15] [59467b43-c191-42d9-b7cb-4ce0a1b06fad] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T00:16:00.593895705Z [2024-06-19 00:16:00,593: INFO/ForkPoolWorker-16] [71955a77-5b0f-4669-8018-fa0829b18d48] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-19T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-19T00:16:00.907386558Z [2024-06-19 00:16:00,903: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T00:16:01.035562579Z [2024-06-19 00:16:01,031: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-19T00:16:01.040008498Z [2024-06-19 00:16:01,035: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T00:16:01.070677892Z [2024-06-19 00:16:01,067: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T00:16:01.281607848Z [2024-06-19 00:16:01,281: INFO/ForkPoolWorker-15] Getting SDNC list 2024-06-19T00:16:01.295482846Z [2024-06-19 00:16:01,294: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:16:01.348792053Z [2024-06-19 00:16:01,348: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T00:16:01.350604772Z [2024-06-19 00:16:01,350: INFO/ForkPoolWorker-15] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T00:16:01.350680482Z [2024-06-19 00:16:01,350: INFO/ForkPoolWorker-15] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T00:16:01.350753640Z [2024-06-19 00:16:01,350: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-06-19T00:16:01.351015100Z [2024-06-19 00:16:01,350: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T00:16:01.392246360Z [2024-06-19 00:16:01,391: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:16:01.489311290Z [2024-06-19 00:16:01,488: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:16:02.075318620Z [2024-06-19 00:16:02,074: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[71955a77-5b0f-4669-8018-fa0829b18d48] succeeded in 1.5083204010006739s: None 2024-06-19T00:16:02.150035134Z [2024-06-19 00:16:02,149: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[59467b43-c191-42d9-b7cb-4ce0a1b06fad] succeeded in 1.5858034049997514s: None 2024-06-19T00:16:02.413734051Z [2024-06-19 00:16:02,413: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T00:16:02.418251746Z [2024-06-19 00:16:02,417: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:16:02.444240743Z [2024-06-19 00:16:02,443: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T00:16:02.446471433Z [2024-06-19 00:16:02,446: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:16:02.446488176Z [2024-06-19 00:16:02,446: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:16:02.446642054Z [2024-06-19 00:16:02,446: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:16:02.446652808Z [2024-06-19 00:16:02,446: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T00:16:02.447530905Z [2024-06-19 00:16:02,447: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T00:16:02.447562998Z [2024-06-19 00:16:02,447: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:16:02.533811028Z [2024-06-19 00:16:02,533: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:16:02.555902576Z [2024-06-19 00:16:02,555: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-19T00:16:02.559220425Z [2024-06-19 00:16:02,558: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:16:02.586173797Z [2024-06-19 00:16:02,585: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T00:16:02.588275021Z [2024-06-19 00:16:02,587: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:16:02.588316021Z [2024-06-19 00:16:02,588: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:16:02.588447037Z [2024-06-19 00:16:02,588: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:16:02.588492368Z [2024-06-19 00:16:02,588: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-19T00:16:02.589252641Z [2024-06-19 00:16:02,588: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-06-19T00:16:02.589351789Z [2024-06-19 00:16:02,589: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:16:02.703083802Z [2024-06-19 00:16:02,702: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:16:04.085912526Z [2024-06-19 00:16:04,085: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[01d0261f-1401-440b-9dc1-e65309bd451f] succeeded in 3.5213428870001735s: None 2024-06-19T00:16:04.617532145Z [2024-06-19 00:16:04,616: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[ac804781-7a78-4404-88c5-5cf57287539e] succeeded in 4.0504663810006605s: None 2024-06-19T00:17:01.247258739Z [2024-06-19 00:17:01,246: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5524470a-6b2b-4217-a293-7b659bced7e4] received 2024-06-19T00:17:01.260551989Z [2024-06-19 00:17:01,260: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[63d23057-d3de-4273-ae35-4d76470487b3] received 2024-06-19T00:17:01.266205104Z [2024-06-19 00:17:01,265: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f8742cfe-96bd-48b7-b8e2-db8768103129] received 2024-06-19T00:17:01.268891253Z [2024-06-19 00:17:01,268: INFO/ForkPoolWorker-15] [5524470a-6b2b-4217-a293-7b659bced7e4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T00:17:01.277843458Z [2024-06-19 00:17:01,277: INFO/ForkPoolWorker-16] [63d23057-d3de-4273-ae35-4d76470487b3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T00:17:01.287726383Z [2024-06-19 00:17:01,287: INFO/ForkPoolWorker-1] [f8742cfe-96bd-48b7-b8e2-db8768103129] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T00:17:01.612956831Z [2024-06-19 00:17:01,608: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T00:17:01.685354926Z [2024-06-19 00:17:01,680: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T00:17:01.754883141Z [2024-06-19 00:17:01,749: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T00:17:01.988144624Z [2024-06-19 00:17:01,987: INFO/ForkPoolWorker-1] Getting SDNC list 2024-06-19T00:17:01.992935504Z [2024-06-19 00:17:01,992: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:17:02.025839895Z [2024-06-19 00:17:02,025: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T00:17:02.029400843Z [2024-06-19 00:17:02,028: INFO/ForkPoolWorker-1] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T00:17:02.029748703Z [2024-06-19 00:17:02,029: INFO/ForkPoolWorker-1] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T00:17:02.030040817Z [2024-06-19 00:17:02,029: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-06-19T00:17:02.030750069Z [2024-06-19 00:17:02,030: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T00:17:02.185997565Z [2024-06-19 00:17:02,185: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:17:02.957604282Z [2024-06-19 00:17:02,957: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f8742cfe-96bd-48b7-b8e2-db8768103129] succeeded in 1.6887688729993897s: None 2024-06-19T00:17:03.074862743Z [2024-06-19 00:17:03,074: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T00:17:03.078123280Z [2024-06-19 00:17:03,077: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:17:03.108398689Z [2024-06-19 00:17:03,107: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T00:17:03.111555135Z [2024-06-19 00:17:03,110: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:17:03.112260621Z [2024-06-19 00:17:03,111: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:17:03.112618194Z [2024-06-19 00:17:03,112: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:17:03.112894645Z [2024-06-19 00:17:03,112: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T00:17:03.113857635Z [2024-06-19 00:17:03,113: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-06-19T00:17:03.114246829Z [2024-06-19 00:17:03,113: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:17:03.207164536Z [2024-06-19 00:17:03,206: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T00:17:03.210842111Z [2024-06-19 00:17:03,210: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:17:03.232366668Z [2024-06-19 00:17:03,232: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T00:17:03.235633867Z [2024-06-19 00:17:03,235: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:17:03.236043890Z [2024-06-19 00:17:03,235: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:17:03.236297083Z [2024-06-19 00:17:03,236: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:17:03.236450060Z [2024-06-19 00:17:03,236: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T00:17:03.236794862Z [2024-06-19 00:17:03,236: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T00:17:03.237330594Z [2024-06-19 00:17:03,237: INFO/ForkPoolWorker-16] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:17:03.237674731Z [2024-06-19 00:17:03,237: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:17:03.334107189Z [2024-06-19 00:17:03,333: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:17:05.245005780Z [2024-06-19 00:17:05,244: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[63d23057-d3de-4273-ae35-4d76470487b3] succeeded in 3.9753931909999665s: None 2024-06-19T00:17:05.787454702Z [2024-06-19 00:17:05,786: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5524470a-6b2b-4217-a293-7b659bced7e4] succeeded in 4.534400527000798s: None 2024-06-19T00:18:00.667746101Z [2024-06-19 00:18:00,667: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d224ee77-8aa4-4ba8-8220-ba3aa8cd8a08] received 2024-06-19T00:18:00.675662685Z [2024-06-19 00:18:00,675: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[069afcd6-aa50-4fd4-bd82-cb0fb37078b1] received 2024-06-19T00:18:00.679939791Z [2024-06-19 00:18:00,679: INFO/ForkPoolWorker-15] [d224ee77-8aa4-4ba8-8220-ba3aa8cd8a08] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-19T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-19T00:18:00.680477243Z [2024-06-19 00:18:00,680: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7d8d3e6e-cc7f-4c25-804c-50042ebade6b] received 2024-06-19T00:18:00.699276100Z [2024-06-19 00:18:00,698: INFO/ForkPoolWorker-16] [069afcd6-aa50-4fd4-bd82-cb0fb37078b1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T00:18:00.700997725Z [2024-06-19 00:18:00,700: INFO/ForkPoolWorker-1] [7d8d3e6e-cc7f-4c25-804c-50042ebade6b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T00:18:00.710260430Z [2024-06-19 00:18:00,709: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9f33bd72-c50f-4421-8064-43dc54d66eda] received 2024-06-19T00:18:00.743893255Z [2024-06-19 00:18:00,743: INFO/ForkPoolWorker-2] [9f33bd72-c50f-4421-8064-43dc54d66eda] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T00:18:01.015828793Z [2024-06-19 00:18:01,012: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-19T00:18:01.184420301Z [2024-06-19 00:18:01,179: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T00:18:01.275806574Z [2024-06-19 00:18:01,271: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T00:18:01.282885417Z [2024-06-19 00:18:01,279: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T00:18:01.304729539Z [2024-06-19 00:18:01,304: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:18:01.454254872Z [2024-06-19 00:18:01,453: INFO/ForkPoolWorker-2] Getting SDNC list 2024-06-19T00:18:01.458882455Z [2024-06-19 00:18:01,458: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:18:01.496030329Z [2024-06-19 00:18:01,495: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T00:18:01.499830200Z [2024-06-19 00:18:01,499: INFO/ForkPoolWorker-2] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T00:18:01.500826792Z [2024-06-19 00:18:01,500: INFO/ForkPoolWorker-2] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T00:18:01.501067512Z [2024-06-19 00:18:01,500: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-06-19T00:18:01.504677325Z [2024-06-19 00:18:01,504: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T00:18:01.639569980Z [2024-06-19 00:18:01,639: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:18:01.909358785Z [2024-06-19 00:18:01,908: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d224ee77-8aa4-4ba8-8220-ba3aa8cd8a08] succeeded in 1.239594143999966s: None 2024-06-19T00:18:02.458232488Z [2024-06-19 00:18:02,457: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[9f33bd72-c50f-4421-8064-43dc54d66eda] succeeded in 1.7458239529996717s: None 2024-06-19T00:18:02.715532224Z [2024-06-19 00:18:02,715: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T00:18:02.719069442Z [2024-06-19 00:18:02,718: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:18:02.748092082Z [2024-06-19 00:18:02,747: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T00:18:02.750103596Z [2024-06-19 00:18:02,749: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:18:02.750301653Z [2024-06-19 00:18:02,750: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:18:02.750587398Z [2024-06-19 00:18:02,750: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:18:02.750803389Z [2024-06-19 00:18:02,750: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T00:18:02.751259229Z [2024-06-19 00:18:02,751: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-06-19T00:18:02.751469343Z [2024-06-19 00:18:02,751: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:18:02.754647996Z [2024-06-19 00:18:02,754: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T00:18:02.759040270Z [2024-06-19 00:18:02,758: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:18:02.785693798Z [2024-06-19 00:18:02,785: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T00:18:02.787375854Z [2024-06-19 00:18:02,787: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:18:02.787400733Z [2024-06-19 00:18:02,787: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:18:02.787525087Z [2024-06-19 00:18:02,787: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:18:02.787561777Z [2024-06-19 00:18:02,787: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T00:18:02.787846071Z [2024-06-19 00:18:02,787: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T00:18:02.787860998Z [2024-06-19 00:18:02,787: INFO/ForkPoolWorker-16] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:18:02.865324365Z [2024-06-19 00:18:02,864: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:18:02.875842919Z [2024-06-19 00:18:02,875: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:18:04.455165370Z [2024-06-19 00:18:04,454: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[069afcd6-aa50-4fd4-bd82-cb0fb37078b1] succeeded in 3.7724693279997155s: None 2024-06-19T00:18:05.073256784Z [2024-06-19 00:18:05,072: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7d8d3e6e-cc7f-4c25-804c-50042ebade6b] succeeded in 4.380154259999472s: None 2024-06-19T00:19:01.090316633Z [2024-06-19 00:19:01,089: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a3c892d9-1a74-4c30-9a1f-9447215688df] received 2024-06-19T00:19:01.104459361Z [2024-06-19 00:19:01,104: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[45ff0a20-e1b8-4c13-ab65-b320be6affc9] received 2024-06-19T00:19:01.111237197Z [2024-06-19 00:19:01,110: INFO/ForkPoolWorker-15] [a3c892d9-1a74-4c30-9a1f-9447215688df] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T00:19:01.118349798Z [2024-06-19 00:19:01,118: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[85883a80-402f-4ba1-96cd-1a2e9ffaee00] received 2024-06-19T00:19:01.120592585Z [2024-06-19 00:19:01,120: INFO/ForkPoolWorker-16] [45ff0a20-e1b8-4c13-ab65-b320be6affc9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T00:19:01.130371242Z [2024-06-19 00:19:01,130: INFO/ForkPoolWorker-1] [85883a80-402f-4ba1-96cd-1a2e9ffaee00] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T00:19:01.450445455Z [2024-06-19 00:19:01,446: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T00:19:01.465609190Z [2024-06-19 00:19:01,460: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T00:19:01.495185936Z [2024-06-19 00:19:01,491: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T00:19:01.638827151Z [2024-06-19 00:19:01,638: INFO/ForkPoolWorker-15] Getting SDNC list 2024-06-19T00:19:01.642840736Z [2024-06-19 00:19:01,642: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:19:01.674727212Z [2024-06-19 00:19:01,674: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T00:19:01.676609978Z [2024-06-19 00:19:01,676: INFO/ForkPoolWorker-15] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T00:19:01.676743665Z [2024-06-19 00:19:01,676: INFO/ForkPoolWorker-15] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T00:19:01.676811239Z [2024-06-19 00:19:01,676: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-06-19T00:19:01.677142764Z [2024-06-19 00:19:01,676: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T00:19:01.830085228Z [2024-06-19 00:19:01,829: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:19:02.602527990Z [2024-06-19 00:19:02,602: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a3c892d9-1a74-4c30-9a1f-9447215688df] succeeded in 1.501738017000207s: None 2024-06-19T00:19:02.916841751Z [2024-06-19 00:19:02,916: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T00:19:02.920106754Z [2024-06-19 00:19:02,919: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:19:02.940800909Z [2024-06-19 00:19:02,940: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T00:19:02.944289763Z [2024-06-19 00:19:02,943: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:19:02.950683528Z [2024-06-19 00:19:02,950: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T00:19:02.952599341Z [2024-06-19 00:19:02,952: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:19:02.952803204Z [2024-06-19 00:19:02,952: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:19:02.953054465Z [2024-06-19 00:19:02,952: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:19:02.953184011Z [2024-06-19 00:19:02,953: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T00:19:02.953574561Z [2024-06-19 00:19:02,953: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-06-19T00:19:02.953826019Z [2024-06-19 00:19:02,953: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:19:02.969236789Z [2024-06-19 00:19:02,968: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T00:19:02.970588473Z [2024-06-19 00:19:02,970: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:19:02.970827661Z [2024-06-19 00:19:02,970: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:19:02.971067405Z [2024-06-19 00:19:02,970: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:19:02.971272504Z [2024-06-19 00:19:02,971: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T00:19:02.971626209Z [2024-06-19 00:19:02,971: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T00:19:02.971826093Z [2024-06-19 00:19:02,971: INFO/ForkPoolWorker-16] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:19:03.035843643Z [2024-06-19 00:19:03,035: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:19:03.064556760Z [2024-06-19 00:19:03,064: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:19:05.146500421Z [2024-06-19 00:19:05,145: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[45ff0a20-e1b8-4c13-ab65-b320be6affc9] succeeded in 4.03790067799946s: None 2024-06-19T00:19:05.546743201Z [2024-06-19 00:19:05,546: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[85883a80-402f-4ba1-96cd-1a2e9ffaee00] succeeded in 4.425438748000488s: None 2024-06-19T00:20:00.529777148Z [2024-06-19 00:20:00,528: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bdb27990-3373-4691-8fdb-d705f554c73e] received 2024-06-19T00:20:00.536332790Z [2024-06-19 00:20:00,535: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[deaf0931-778f-48ba-adfc-ada51479353d] received 2024-06-19T00:20:00.540894021Z [2024-06-19 00:20:00,540: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a128c27e-f828-4ea4-bd6f-c0c5f296651d] received 2024-06-19T00:20:00.542696170Z [2024-06-19 00:20:00,542: INFO/ForkPoolWorker-15] [bdb27990-3373-4691-8fdb-d705f554c73e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T00:20:00.550702370Z [2024-06-19 00:20:00,550: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f4c5a0eb-ffd3-402d-82e9-88757a873085] received 2024-06-19T00:20:00.554075862Z [2024-06-19 00:20:00,553: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2fbf5211-29ba-4d20-9e25-cda4151980e9] received 2024-06-19T00:20:00.559428313Z [2024-06-19 00:20:00,559: INFO/ForkPoolWorker-1] [a128c27e-f828-4ea4-bd6f-c0c5f296651d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T00:20:00.562519826Z [2024-06-19 00:20:00,562: INFO/ForkPoolWorker-16] [deaf0931-778f-48ba-adfc-ada51479353d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-19T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T00:20:00.578276040Z [2024-06-19 00:20:00,577: INFO/ForkPoolWorker-2] [f4c5a0eb-ffd3-402d-82e9-88757a873085] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-19T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-19T00:20:00.579258032Z [2024-06-19 00:20:00,578: INFO/ForkPoolWorker-3] [2fbf5211-29ba-4d20-9e25-cda4151980e9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T00:20:00.956034527Z [2024-06-19 00:20:00,952: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T00:20:00.999962889Z [2024-06-19 00:20:00,996: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T00:20:01.020147146Z [2024-06-19 00:20:01,015: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T00:20:01.111829597Z [2024-06-19 00:20:01,107: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-19T00:20:01.180106210Z [2024-06-19 00:20:01,179: INFO/ForkPoolWorker-15] Getting SDNC list 2024-06-19T00:20:01.184384135Z [2024-06-19 00:20:01,183: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:20:01.187913088Z [2024-06-19 00:20:01,184: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T00:20:01.240296831Z [2024-06-19 00:20:01,240: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T00:20:01.244625252Z [2024-06-19 00:20:01,244: INFO/ForkPoolWorker-15] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T00:20:01.244819145Z [2024-06-19 00:20:01,244: INFO/ForkPoolWorker-15] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T00:20:01.244971536Z [2024-06-19 00:20:01,244: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-06-19T00:20:01.245384689Z [2024-06-19 00:20:01,245: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T00:20:01.396177499Z [2024-06-19 00:20:01,395: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:20:01.521727428Z [2024-06-19 00:20:01,521: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:20:02.405026294Z [2024-06-19 00:20:02,404: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bdb27990-3373-4691-8fdb-d705f554c73e] succeeded in 1.8724173489999885s: None 2024-06-19T00:20:02.476250807Z [2024-06-19 00:20:02,475: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[f4c5a0eb-ffd3-402d-82e9-88757a873085] succeeded in 1.9216685420005888s: None 2024-06-19T00:20:02.817752682Z [2024-06-19 00:20:02,817: INFO/ForkPoolWorker-3] Getting VIM list 2024-06-19T00:20:02.821387050Z [2024-06-19 00:20:02,820: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:20:02.826960081Z [2024-06-19 00:20:02,826: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T00:20:02.830172715Z [2024-06-19 00:20:02,829: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:20:02.847585899Z [2024-06-19 00:20:02,846: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-06-19T00:20:02.848819085Z [2024-06-19 00:20:02,848: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T00:20:02.849205509Z [2024-06-19 00:20:02,849: INFO/ForkPoolWorker-3] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:20:02.849363787Z [2024-06-19 00:20:02,849: INFO/ForkPoolWorker-3] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:20:02.849570966Z [2024-06-19 00:20:02,849: INFO/ForkPoolWorker-3] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:20:02.849733746Z [2024-06-19 00:20:02,849: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-06-19T00:20:02.849976739Z [2024-06-19 00:20:02,849: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:20:02.850009878Z [2024-06-19 00:20:02,849: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:20:02.850125493Z [2024-06-19 00:20:02,849: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:20:02.850155355Z [2024-06-19 00:20:02,850: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T00:20:02.850279411Z [2024-06-19 00:20:02,849: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-06-19T00:20:02.850354739Z [2024-06-19 00:20:02,850: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T00:20:02.850402505Z [2024-06-19 00:20:02,850: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:20:02.850525446Z [2024-06-19 00:20:02,850: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:20:02.943277075Z [2024-06-19 00:20:02,942: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T00:20:02.956379316Z [2024-06-19 00:20:02,954: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:20:02.959766031Z [2024-06-19 00:20:02,959: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:20:02.960356879Z [2024-06-19 00:20:02,960: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:20:03.007905220Z [2024-06-19 00:20:03,000: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T00:20:03.007971141Z [2024-06-19 00:20:03,002: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:20:03.009941890Z [2024-06-19 00:20:03,002: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:20:03.009952194Z [2024-06-19 00:20:03,002: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:20:03.009957708Z [2024-06-19 00:20:03,002: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T00:20:03.009962252Z [2024-06-19 00:20:03,003: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T00:20:03.009966956Z [2024-06-19 00:20:03,003: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:20:03.132258368Z [2024-06-19 00:20:03,131: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:20:03.890987614Z [2024-06-19 00:20:03,890: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[deaf0931-778f-48ba-adfc-ada51479353d] succeeded in 3.3518821890002073s: None 2024-06-19T00:20:04.269884796Z [2024-06-19 00:20:04,269: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[af8c3b27-5877-4612-bc82-c673e5fc2b4a] received 2024-06-19T00:20:04.279898502Z [2024-06-19 00:20:04,279: INFO/ForkPoolWorker-15] [af8c3b27-5877-4612-bc82-c673e5fc2b4a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'split_metrics', 'scheduled__2024-06-19T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T00:20:04.605391272Z [2024-06-19 00:20:04,602: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T00:20:04.744342763Z [2024-06-19 00:20:04,743: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a128c27e-f828-4ea4-bd6f-c0c5f296651d] succeeded in 4.200318270000025s: None 2024-06-19T00:20:05.075754230Z [2024-06-19 00:20:05,073: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[2fbf5211-29ba-4d20-9e25-cda4151980e9] succeeded in 4.517356313000164s: None 2024-06-19T00:20:05.853770106Z [2024-06-19 00:20:05,853: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T00:20:05.857400562Z [2024-06-19 00:20:05,856: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:20:05.880013650Z [2024-06-19 00:20:05,879: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T00:20:05.881398647Z [2024-06-19 00:20:05,881: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:20:05.881410820Z [2024-06-19 00:20:05,881: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:20:05.881706087Z [2024-06-19 00:20:05,881: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:20:05.881735861Z [2024-06-19 00:20:05,881: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T00:20:05.881995658Z [2024-06-19 00:20:05,881: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T00:20:05.882010367Z [2024-06-19 00:20:05,881: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:20:05.975015681Z [2024-06-19 00:20:05,974: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:20:06.713583506Z [2024-06-19 00:20:06,713: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[af8c3b27-5877-4612-bc82-c673e5fc2b4a] succeeded in 2.440360036000129s: None 2024-06-19T00:20:07.114134373Z [2024-06-19 00:20:07,113: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a25ad232-69ba-4a89-9662-7454e0bfe29e] received 2024-06-19T00:20:07.122844015Z [2024-06-19 00:20:07,122: INFO/ForkPoolWorker-15] [a25ad232-69ba-4a89-9662-7454e0bfe29e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'collect_metrics', 'scheduled__2024-06-19T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-19T00:20:07.407500606Z [2024-06-19 00:20:07,404: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T00:20:08.645177040Z [2024-06-19 00:20:08,644: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T00:20:08.648544880Z [2024-06-19 00:20:08,648: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:20:08.671649165Z [2024-06-19 00:20:08,671: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T00:20:08.673356736Z [2024-06-19 00:20:08,673: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:20:08.673520371Z [2024-06-19 00:20:08,673: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:20:08.673705794Z [2024-06-19 00:20:08,673: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:20:08.673850282Z [2024-06-19 00:20:08,673: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T00:20:08.674135925Z [2024-06-19 00:20:08,673: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T00:20:08.674251057Z [2024-06-19 00:20:08,674: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:20:08.778395081Z [2024-06-19 00:20:08,778: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:20:09.464524268Z [2024-06-19 00:20:09,464: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f306565f-08cd-4a4e-aef4-924026630ac3] received 2024-06-19T00:20:09.471959017Z [2024-06-19 00:20:09,471: INFO/ForkPoolWorker-16] [f306565f-08cd-4a4e-aef4-924026630ac3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'send_prometheus', 'scheduled__2024-06-19T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T00:20:09.477526540Z [2024-06-19 00:20:09,477: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a25ad232-69ba-4a89-9662-7454e0bfe29e] succeeded in 2.361533249999411s: None 2024-06-19T00:20:09.724345992Z [2024-06-19 00:20:09,721: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T00:20:10.763607509Z [2024-06-19 00:20:10,763: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T00:20:10.767116445Z [2024-06-19 00:20:10,766: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:20:10.798569163Z [2024-06-19 00:20:10,798: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T00:20:10.801073758Z [2024-06-19 00:20:10,800: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:20:10.801281065Z [2024-06-19 00:20:10,801: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:20:10.801600259Z [2024-06-19 00:20:10,801: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:20:10.801792800Z [2024-06-19 00:20:10,801: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T00:20:10.802218534Z [2024-06-19 00:20:10,802: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T00:20:10.802446577Z [2024-06-19 00:20:10,802: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:20:10.941590558Z [2024-06-19 00:20:10,941: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:20:11.588284009Z [2024-06-19 00:20:11,587: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f306565f-08cd-4a4e-aef4-924026630ac3] succeeded in 2.120898999000019s: None 2024-06-19T00:21:01.300523038Z [2024-06-19 00:21:01,300: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c56bf70f-a09b-4b0b-a574-b674f5b58e4a] received 2024-06-19T00:21:01.311908997Z [2024-06-19 00:21:01,311: INFO/ForkPoolWorker-15] [c56bf70f-a09b-4b0b-a574-b674f5b58e4a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T00:21:01.312422939Z [2024-06-19 00:21:01,312: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5e9a14a0-e99b-4b6e-8d8c-749a25612a92] received 2024-06-19T00:21:01.320970115Z [2024-06-19 00:21:01,320: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5ec78f58-27c5-4834-af77-d9099cf8d835] received 2024-06-19T00:21:01.328245198Z [2024-06-19 00:21:01,327: INFO/ForkPoolWorker-16] [5e9a14a0-e99b-4b6e-8d8c-749a25612a92] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T00:21:01.337581965Z [2024-06-19 00:21:01,337: INFO/ForkPoolWorker-1] [5ec78f58-27c5-4834-af77-d9099cf8d835] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T00:21:01.641555005Z [2024-06-19 00:21:01,637: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T00:21:01.722583530Z [2024-06-19 00:21:01,717: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T00:21:01.785957620Z [2024-06-19 00:21:01,781: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T00:21:01.800777853Z [2024-06-19 00:21:01,800: INFO/ForkPoolWorker-15] Getting SDNC list 2024-06-19T00:21:01.805162849Z [2024-06-19 00:21:01,804: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:21:01.829358514Z [2024-06-19 00:21:01,829: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T00:21:01.830470717Z [2024-06-19 00:21:01,830: INFO/ForkPoolWorker-15] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T00:21:01.830824460Z [2024-06-19 00:21:01,830: INFO/ForkPoolWorker-15] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T00:21:01.831219033Z [2024-06-19 00:21:01,831: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-06-19T00:21:01.831585642Z [2024-06-19 00:21:01,831: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T00:21:01.925146216Z [2024-06-19 00:21:01,924: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:21:02.607763316Z [2024-06-19 00:21:02,607: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c56bf70f-a09b-4b0b-a574-b674f5b58e4a] succeeded in 1.3034664329998122s: None 2024-06-19T00:21:03.235276903Z [2024-06-19 00:21:03,234: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T00:21:03.238952077Z [2024-06-19 00:21:03,238: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:21:03.263201742Z [2024-06-19 00:21:03,262: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T00:21:03.264931463Z [2024-06-19 00:21:03,264: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:21:03.264988577Z [2024-06-19 00:21:03,264: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:21:03.265208310Z [2024-06-19 00:21:03,264: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:21:03.265252966Z [2024-06-19 00:21:03,265: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T00:21:03.265675776Z [2024-06-19 00:21:03,265: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-19T00:21:03.265681266Z [2024-06-19 00:21:03,265: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:21:03.310794268Z [2024-06-19 00:21:03,310: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T00:21:03.314168783Z [2024-06-19 00:21:03,313: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:21:03.340883050Z [2024-06-19 00:21:03,340: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T00:21:03.342444880Z [2024-06-19 00:21:03,342: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:21:03.342573265Z [2024-06-19 00:21:03,342: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:21:03.342816992Z [2024-06-19 00:21:03,342: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:21:03.342952376Z [2024-06-19 00:21:03,342: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T00:21:03.343296223Z [2024-06-19 00:21:03,343: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T00:21:03.343484729Z [2024-06-19 00:21:03,343: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:21:03.365621494Z [2024-06-19 00:21:03,365: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:21:03.426368031Z [2024-06-19 00:21:03,426: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:21:05.167119541Z [2024-06-19 00:21:05,166: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5ec78f58-27c5-4834-af77-d9099cf8d835] succeeded in 3.8372046439999394s: None 2024-06-19T00:21:05.589667607Z [2024-06-19 00:21:05,589: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5e9a14a0-e99b-4b6e-8d8c-749a25612a92] succeeded in 4.274416821000159s: None 2024-06-19T00:22:01.286061195Z [2024-06-19 00:22:01,285: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[63ca6cf4-491a-47ad-a2b6-6aa466658747] received 2024-06-19T00:22:01.289929269Z [2024-06-19 00:22:01,289: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b6eda101-5a38-49d9-bc74-bf36c52e2cfe] received 2024-06-19T00:22:01.296304395Z [2024-06-19 00:22:01,295: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a1cb1551-678f-4188-8083-480bb0e2c89f] received 2024-06-19T00:22:01.299145351Z [2024-06-19 00:22:01,298: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8bf13f1c-d96e-4054-b113-aec8a27c239b] received 2024-06-19T00:22:01.307212306Z [2024-06-19 00:22:01,306: INFO/ForkPoolWorker-16] [b6eda101-5a38-49d9-bc74-bf36c52e2cfe] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-19T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-19T00:22:01.322174093Z [2024-06-19 00:22:01,321: INFO/ForkPoolWorker-1] [a1cb1551-678f-4188-8083-480bb0e2c89f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T00:22:01.331043213Z [2024-06-19 00:22:01,330: INFO/ForkPoolWorker-2] [8bf13f1c-d96e-4054-b113-aec8a27c239b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T00:22:01.333938276Z [2024-06-19 00:22:01,333: INFO/ForkPoolWorker-15] [63ca6cf4-491a-47ad-a2b6-6aa466658747] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T00:22:01.692417567Z [2024-06-19 00:22:01,688: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T00:22:01.733728005Z [2024-06-19 00:22:01,730: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-19T00:22:01.800401373Z [2024-06-19 00:22:01,796: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T00:22:01.841008373Z [2024-06-19 00:22:01,834: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T00:22:01.936558719Z [2024-06-19 00:22:01,936: INFO/ForkPoolWorker-2] Getting SDNC list 2024-06-19T00:22:01.955279455Z [2024-06-19 00:22:01,954: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:22:01.989195285Z [2024-06-19 00:22:01,988: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:22:01.999381175Z [2024-06-19 00:22:01,999: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T00:22:02.007127626Z [2024-06-19 00:22:02,006: INFO/ForkPoolWorker-2] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T00:22:02.007416279Z [2024-06-19 00:22:02,006: INFO/ForkPoolWorker-2] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T00:22:02.007848289Z [2024-06-19 00:22:02,007: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-06-19T00:22:02.008202077Z [2024-06-19 00:22:02,008: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T00:22:02.256911471Z [2024-06-19 00:22:02,256: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:22:02.694091191Z [2024-06-19 00:22:02,693: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b6eda101-5a38-49d9-bc74-bf36c52e2cfe] succeeded in 1.4021483239994268s: None 2024-06-19T00:22:03.163923088Z [2024-06-19 00:22:03,163: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[8bf13f1c-d96e-4054-b113-aec8a27c239b] succeeded in 1.8606000419995326s: None 2024-06-19T00:22:03.348899496Z [2024-06-19 00:22:03,348: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T00:22:03.352568984Z [2024-06-19 00:22:03,352: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:22:03.381173724Z [2024-06-19 00:22:03,380: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T00:22:03.383433944Z [2024-06-19 00:22:03,383: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:22:03.383582188Z [2024-06-19 00:22:03,383: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:22:03.384023266Z [2024-06-19 00:22:03,383: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:22:03.384331263Z [2024-06-19 00:22:03,384: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T00:22:03.385196383Z [2024-06-19 00:22:03,384: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-06-19T00:22:03.385475001Z [2024-06-19 00:22:03,385: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:22:03.496136221Z [2024-06-19 00:22:03,495: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:22:03.506834286Z [2024-06-19 00:22:03,506: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T00:22:03.513098838Z [2024-06-19 00:22:03,512: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:22:03.548015972Z [2024-06-19 00:22:03,547: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T00:22:03.551272779Z [2024-06-19 00:22:03,550: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:22:03.551548519Z [2024-06-19 00:22:03,551: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:22:03.551910611Z [2024-06-19 00:22:03,551: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:22:03.552175637Z [2024-06-19 00:22:03,551: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T00:22:03.552653036Z [2024-06-19 00:22:03,552: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T00:22:03.553284852Z [2024-06-19 00:22:03,553: INFO/ForkPoolWorker-15] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:22:03.680111550Z [2024-06-19 00:22:03,679: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:22:05.281284383Z [2024-06-19 00:22:05,280: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[63ca6cf4-491a-47ad-a2b6-6aa466658747] succeeded in 3.9852533019993643s: None 2024-06-19T00:22:05.665271897Z [2024-06-19 00:22:05,664: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a1cb1551-678f-4188-8083-480bb0e2c89f] succeeded in 4.3653540740006065s: None 2024-06-19T00:23:00.373804090Z [2024-06-19 00:23:00,373: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[038483f5-fcde-4b42-88d7-eebab00f1a7d] received 2024-06-19T00:23:00.377898970Z [2024-06-19 00:23:00,377: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dc7ad2e9-777b-4c41-9d3f-2a66b04a8d20] received 2024-06-19T00:23:00.379392864Z [2024-06-19 00:23:00,379: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cdd031f4-38a7-4be1-b9ac-2ef00d02f064] received 2024-06-19T00:23:00.392978599Z [2024-06-19 00:23:00,392: INFO/ForkPoolWorker-16] [dc7ad2e9-777b-4c41-9d3f-2a66b04a8d20] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T00:23:00.399429243Z [2024-06-19 00:23:00,399: INFO/ForkPoolWorker-1] [cdd031f4-38a7-4be1-b9ac-2ef00d02f064] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T00:23:00.422276800Z [2024-06-19 00:23:00,421: INFO/ForkPoolWorker-15] [038483f5-fcde-4b42-88d7-eebab00f1a7d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T00:23:00.736721876Z [2024-06-19 00:23:00,729: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T00:23:00.780013678Z [2024-06-19 00:23:00,775: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T00:23:00.903069203Z [2024-06-19 00:23:00,898: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T00:23:00.965467174Z [2024-06-19 00:23:00,964: INFO/ForkPoolWorker-1] Getting SDNC list 2024-06-19T00:23:00.975364938Z [2024-06-19 00:23:00,974: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:23:01.017056275Z [2024-06-19 00:23:01,016: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T00:23:01.021342943Z [2024-06-19 00:23:01,020: INFO/ForkPoolWorker-1] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T00:23:01.021710396Z [2024-06-19 00:23:01,021: INFO/ForkPoolWorker-1] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T00:23:01.021974492Z [2024-06-19 00:23:01,021: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-06-19T00:23:01.022507436Z [2024-06-19 00:23:01,022: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T00:23:01.111959812Z [2024-06-19 00:23:01,111: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:23:01.823386715Z [2024-06-19 00:23:01,822: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[cdd031f4-38a7-4be1-b9ac-2ef00d02f064] succeeded in 1.4413465449997602s: None 2024-06-19T00:23:01.987745600Z [2024-06-19 00:23:01,987: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T00:23:01.990813148Z [2024-06-19 00:23:01,990: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:23:02.012420674Z [2024-06-19 00:23:02,012: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T00:23:02.014917515Z [2024-06-19 00:23:02,014: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:23:02.014937544Z [2024-06-19 00:23:02,014: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:23:02.014984224Z [2024-06-19 00:23:02,014: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:23:02.015052465Z [2024-06-19 00:23:02,014: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T00:23:02.015270363Z [2024-06-19 00:23:02,015: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-19T00:23:02.015283185Z [2024-06-19 00:23:02,015: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:23:02.085602711Z [2024-06-19 00:23:02,085: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:23:02.229628836Z [2024-06-19 00:23:02,229: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T00:23:02.233349414Z [2024-06-19 00:23:02,232: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:23:02.277697297Z [2024-06-19 00:23:02,277: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T00:23:02.280614468Z [2024-06-19 00:23:02,280: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:23:02.280664075Z [2024-06-19 00:23:02,280: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:23:02.280795673Z [2024-06-19 00:23:02,280: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:23:02.280853013Z [2024-06-19 00:23:02,280: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T00:23:02.281108082Z [2024-06-19 00:23:02,280: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T00:23:02.281160168Z [2024-06-19 00:23:02,281: INFO/ForkPoolWorker-15] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:23:02.365953125Z [2024-06-19 00:23:02,365: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:23:03.869645379Z [2024-06-19 00:23:03,869: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[038483f5-fcde-4b42-88d7-eebab00f1a7d] succeeded in 3.4847093030002725s: None 2024-06-19T00:23:04.171132281Z [2024-06-19 00:23:04,170: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[dc7ad2e9-777b-4c41-9d3f-2a66b04a8d20] succeeded in 3.790832431999661s: None 2024-06-19T00:24:00.511146376Z [2024-06-19 00:24:00,510: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a1d666e0-ece1-42ad-a87e-a629c2e43684] received 2024-06-19T00:24:00.514098532Z [2024-06-19 00:24:00,513: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9f44e7da-8c2e-4f25-a871-b7bb108a2d67] received 2024-06-19T00:24:00.530899906Z [2024-06-19 00:24:00,530: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4ee4f15b-e526-4789-814b-997f51878fcc] received 2024-06-19T00:24:00.531643204Z [2024-06-19 00:24:00,531: INFO/ForkPoolWorker-15] [a1d666e0-ece1-42ad-a87e-a629c2e43684] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-19T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-19T00:24:00.532843772Z [2024-06-19 00:24:00,532: INFO/ForkPoolWorker-16] [9f44e7da-8c2e-4f25-a871-b7bb108a2d67] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T00:24:00.538872518Z [2024-06-19 00:24:00,538: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[677af6c1-9e1f-4aa1-a426-8d33fb0987cb] received 2024-06-19T00:24:00.551892069Z [2024-06-19 00:24:00,551: INFO/ForkPoolWorker-1] [4ee4f15b-e526-4789-814b-997f51878fcc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T00:24:00.555955005Z [2024-06-19 00:24:00,555: INFO/ForkPoolWorker-2] [677af6c1-9e1f-4aa1-a426-8d33fb0987cb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T00:24:00.849156176Z [2024-06-19 00:24:00,845: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T00:24:00.859074095Z [2024-06-19 00:24:00,855: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T00:24:00.901775677Z [2024-06-19 00:24:00,898: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T00:24:00.920436843Z [2024-06-19 00:24:00,915: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-19T00:24:01.019740689Z [2024-06-19 00:24:01,019: INFO/ForkPoolWorker-16] Getting SDNC list 2024-06-19T00:24:01.024907457Z [2024-06-19 00:24:01,024: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:24:01.059357493Z [2024-06-19 00:24:01,059: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T00:24:01.060591728Z [2024-06-19 00:24:01,060: INFO/ForkPoolWorker-16] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T00:24:01.060616134Z [2024-06-19 00:24:01,060: INFO/ForkPoolWorker-16] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T00:24:01.060694815Z [2024-06-19 00:24:01,060: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-06-19T00:24:01.060856201Z [2024-06-19 00:24:01,060: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T00:24:01.277110009Z [2024-06-19 00:24:01,276: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:24:01.391087622Z [2024-06-19 00:24:01,390: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:24:01.882541936Z [2024-06-19 00:24:01,882: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9f44e7da-8c2e-4f25-a871-b7bb108a2d67] succeeded in 1.3647071630002756s: None 2024-06-19T00:24:02.210130207Z [2024-06-19 00:24:02,209: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a1d666e0-ece1-42ad-a87e-a629c2e43684] succeeded in 1.694737970999995s: None 2024-06-19T00:24:02.320523291Z [2024-06-19 00:24:02,320: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-19T00:24:02.323603999Z [2024-06-19 00:24:02,323: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:24:02.354872324Z [2024-06-19 00:24:02,354: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T00:24:02.357173594Z [2024-06-19 00:24:02,356: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:24:02.357255528Z [2024-06-19 00:24:02,357: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:24:02.357405970Z [2024-06-19 00:24:02,357: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:24:02.357477837Z [2024-06-19 00:24:02,357: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-19T00:24:02.357746562Z [2024-06-19 00:24:02,357: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T00:24:02.358424589Z [2024-06-19 00:24:02,358: INFO/ForkPoolWorker-2] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:24:02.443464148Z [2024-06-19 00:24:02,442: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T00:24:02.448236159Z [2024-06-19 00:24:02,447: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:24:02.474902222Z [2024-06-19 00:24:02,474: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:24:02.480894682Z [2024-06-19 00:24:02,480: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T00:24:02.483109559Z [2024-06-19 00:24:02,482: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:24:02.483123193Z [2024-06-19 00:24:02,483: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:24:02.483264240Z [2024-06-19 00:24:02,483: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:24:02.483298437Z [2024-06-19 00:24:02,483: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T00:24:02.483532289Z [2024-06-19 00:24:02,483: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-06-19T00:24:02.483650965Z [2024-06-19 00:24:02,483: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:24:02.573568982Z [2024-06-19 00:24:02,573: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:24:03.880901891Z [2024-06-19 00:24:03,880: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[677af6c1-9e1f-4aa1-a426-8d33fb0987cb] succeeded in 3.333253544999934s: None 2024-06-19T00:24:04.397662844Z [2024-06-19 00:24:04,397: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4ee4f15b-e526-4789-814b-997f51878fcc] succeeded in 3.86378371399951s: None 2024-06-19T00:25:00.501327646Z [2024-06-19 00:25:00,500: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bf426898-98dd-439b-bc64-031d128ecb36] received 2024-06-19T00:25:00.508175850Z [2024-06-19 00:25:00,507: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[57d7035e-4bf2-40fc-b024-6be9a958e50d] received 2024-06-19T00:25:00.511913013Z [2024-06-19 00:25:00,511: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c6785c96-7992-4568-87ae-79f2f531a778] received 2024-06-19T00:25:00.517725867Z [2024-06-19 00:25:00,517: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7593df7e-bb6e-430c-b319-e861c93fddfc] received 2024-06-19T00:25:00.522522380Z [2024-06-19 00:25:00,522: INFO/ForkPoolWorker-1] [c6785c96-7992-4568-87ae-79f2f531a778] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T00:25:00.524557993Z [2024-06-19 00:25:00,524: INFO/ForkPoolWorker-15] [bf426898-98dd-439b-bc64-031d128ecb36] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T00:25:00.527659478Z [2024-06-19 00:25:00,527: INFO/ForkPoolWorker-16] [57d7035e-4bf2-40fc-b024-6be9a958e50d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-19T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T00:25:00.543335422Z [2024-06-19 00:25:00,543: INFO/ForkPoolWorker-2] [7593df7e-bb6e-430c-b319-e861c93fddfc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T00:25:00.907298666Z [2024-06-19 00:25:00,898: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T00:25:01.072421351Z [2024-06-19 00:25:01,068: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T00:25:01.076364606Z [2024-06-19 00:25:01,072: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T00:25:01.089367768Z [2024-06-19 00:25:01,088: INFO/ForkPoolWorker-15] Getting SDNC list 2024-06-19T00:25:01.091667827Z [2024-06-19 00:25:01,086: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T00:25:01.095649623Z [2024-06-19 00:25:01,095: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:25:01.121914563Z [2024-06-19 00:25:01,121: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T00:25:01.122883330Z [2024-06-19 00:25:01,122: INFO/ForkPoolWorker-15] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T00:25:01.123037427Z [2024-06-19 00:25:01,122: INFO/ForkPoolWorker-15] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T00:25:01.123221492Z [2024-06-19 00:25:01,123: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-06-19T00:25:01.123930439Z [2024-06-19 00:25:01,123: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T00:25:01.215924824Z [2024-06-19 00:25:01,215: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:25:01.750150172Z [2024-06-19 00:25:01,749: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bf426898-98dd-439b-bc64-031d128ecb36] succeeded in 1.2443695750007464s: None 2024-06-19T00:25:02.315861482Z [2024-06-19 00:25:02,302: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T00:25:02.315888057Z [2024-06-19 00:25:02,306: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:25:02.401880510Z [2024-06-19 00:25:02,400: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T00:25:02.407544438Z [2024-06-19 00:25:02,407: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:25:02.407598738Z [2024-06-19 00:25:02,407: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:25:02.408247077Z [2024-06-19 00:25:02,408: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:25:02.408332515Z [2024-06-19 00:25:02,408: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T00:25:02.409091355Z [2024-06-19 00:25:02,408: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T00:25:02.409211758Z [2024-06-19 00:25:02,409: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:25:02.432086900Z [2024-06-19 00:25:02,431: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T00:25:02.436320831Z [2024-06-19 00:25:02,435: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:25:02.455481443Z [2024-06-19 00:25:02,455: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T00:25:02.457097153Z [2024-06-19 00:25:02,456: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:25:02.457412266Z [2024-06-19 00:25:02,457: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:25:02.458295544Z [2024-06-19 00:25:02,457: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:25:02.458505097Z [2024-06-19 00:25:02,458: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T00:25:02.458985391Z [2024-06-19 00:25:02,458: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-06-19T00:25:02.459178320Z [2024-06-19 00:25:02,459: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:25:02.511108745Z [2024-06-19 00:25:02,510: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:25:02.578196501Z [2024-06-19 00:25:02,577: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:25:02.627303375Z [2024-06-19 00:25:02,626: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-19T00:25:02.630820005Z [2024-06-19 00:25:02,630: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:25:02.661033748Z [2024-06-19 00:25:02,660: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T00:25:02.662713854Z [2024-06-19 00:25:02,662: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:25:02.662757696Z [2024-06-19 00:25:02,662: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:25:02.662902110Z [2024-06-19 00:25:02,662: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:25:02.662985177Z [2024-06-19 00:25:02,662: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-19T00:25:02.663266656Z [2024-06-19 00:25:02,663: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T00:25:02.663327525Z [2024-06-19 00:25:02,663: INFO/ForkPoolWorker-2] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:25:02.744620943Z [2024-06-19 00:25:02,744: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:25:03.160933259Z [2024-06-19 00:25:03,160: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[57d7035e-4bf2-40fc-b024-6be9a958e50d] succeeded in 2.6454141049998725s: None 2024-06-19T00:25:03.392048128Z [2024-06-19 00:25:03,391: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[669a4913-f5d0-4d61-909f-9af2c9e1ec3a] received 2024-06-19T00:25:03.401554073Z [2024-06-19 00:25:03,401: INFO/ForkPoolWorker-15] [669a4913-f5d0-4d61-909f-9af2c9e1ec3a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'split_metrics', 'scheduled__2024-06-19T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T00:25:03.717900863Z [2024-06-19 00:25:03,713: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T00:25:04.501909152Z [2024-06-19 00:25:04,501: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[7593df7e-bb6e-430c-b319-e861c93fddfc] succeeded in 3.9774544890005927s: None 2024-06-19T00:25:04.871941965Z [2024-06-19 00:25:04,871: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c6785c96-7992-4568-87ae-79f2f531a778] succeeded in 4.357689523000772s: None 2024-06-19T00:25:04.883601572Z [2024-06-19 00:25:04,883: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T00:25:04.889510685Z [2024-06-19 00:25:04,889: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:25:04.910146497Z [2024-06-19 00:25:04,909: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T00:25:04.911403470Z [2024-06-19 00:25:04,911: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:25:04.911486674Z [2024-06-19 00:25:04,911: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:25:04.911610454Z [2024-06-19 00:25:04,911: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:25:04.911636213Z [2024-06-19 00:25:04,911: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T00:25:04.912017302Z [2024-06-19 00:25:04,911: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T00:25:04.912098349Z [2024-06-19 00:25:04,911: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:25:05.015920505Z [2024-06-19 00:25:05,015: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:25:05.758902775Z [2024-06-19 00:25:05,758: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[669a4913-f5d0-4d61-909f-9af2c9e1ec3a] succeeded in 2.3638712370002395s: None 2024-06-19T00:25:05.943808334Z [2024-06-19 00:25:05,943: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4d4cf66a-f334-455e-a290-df81d87915d7] received 2024-06-19T00:25:05.953701521Z [2024-06-19 00:25:05,953: INFO/ForkPoolWorker-15] [4d4cf66a-f334-455e-a290-df81d87915d7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'collect_metrics', 'scheduled__2024-06-19T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-19T00:25:06.258576162Z [2024-06-19 00:25:06,255: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T00:25:07.364132162Z [2024-06-19 00:25:07,363: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T00:25:07.367370972Z [2024-06-19 00:25:07,366: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:25:07.390144850Z [2024-06-19 00:25:07,389: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T00:25:07.391799108Z [2024-06-19 00:25:07,391: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:25:07.391959651Z [2024-06-19 00:25:07,391: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:25:07.392165186Z [2024-06-19 00:25:07,391: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:25:07.392308473Z [2024-06-19 00:25:07,392: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T00:25:07.392739984Z [2024-06-19 00:25:07,392: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T00:25:07.392764786Z [2024-06-19 00:25:07,392: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:25:07.524292975Z [2024-06-19 00:25:07,523: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:25:08.222619380Z [2024-06-19 00:25:08,222: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4d4cf66a-f334-455e-a290-df81d87915d7] succeeded in 2.275775156999771s: None 2024-06-19T00:25:08.509938221Z [2024-06-19 00:25:08,509: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[584072e4-06d8-498c-9204-6d9deeab5a90] received 2024-06-19T00:25:08.537870460Z [2024-06-19 00:25:08,537: INFO/ForkPoolWorker-15] [584072e4-06d8-498c-9204-6d9deeab5a90] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'send_prometheus', 'scheduled__2024-06-19T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T00:25:08.836204623Z [2024-06-19 00:25:08,832: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T00:25:09.918696129Z [2024-06-19 00:25:09,917: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T00:25:09.921399994Z [2024-06-19 00:25:09,921: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:25:09.938196622Z [2024-06-19 00:25:09,938: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T00:25:09.939346314Z [2024-06-19 00:25:09,939: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:25:09.939473819Z [2024-06-19 00:25:09,939: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:25:09.939764050Z [2024-06-19 00:25:09,939: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:25:09.939865438Z [2024-06-19 00:25:09,939: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T00:25:09.940132835Z [2024-06-19 00:25:09,940: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T00:25:09.940253248Z [2024-06-19 00:25:09,940: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:25:10.019211789Z [2024-06-19 00:25:10,018: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:25:10.660040590Z [2024-06-19 00:25:10,659: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[584072e4-06d8-498c-9204-6d9deeab5a90] succeeded in 2.1410046979999606s: None 2024-06-19T00:26:00.628628050Z [2024-06-19 00:26:00,628: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4a5b4306-6a1b-4084-96fe-fb5ed651cad7] received 2024-06-19T00:26:00.632582072Z [2024-06-19 00:26:00,632: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[69e62031-f90e-41c5-952e-6e2fcc306c7a] received 2024-06-19T00:26:00.635459496Z [2024-06-19 00:26:00,635: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[218d608f-7984-49cd-9ea6-f2342b5ab516] received 2024-06-19T00:26:00.638212475Z [2024-06-19 00:26:00,637: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9dc9de3b-761f-456d-a861-01b15bfbe509] received 2024-06-19T00:26:00.656590552Z [2024-06-19 00:26:00,656: INFO/ForkPoolWorker-2] [9dc9de3b-761f-456d-a861-01b15bfbe509] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T00:26:00.658745189Z [2024-06-19 00:26:00,658: INFO/ForkPoolWorker-15] [4a5b4306-6a1b-4084-96fe-fb5ed651cad7] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-19T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-19T00:26:00.664590598Z [2024-06-19 00:26:00,664: INFO/ForkPoolWorker-1] [218d608f-7984-49cd-9ea6-f2342b5ab516] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T00:26:00.672979370Z [2024-06-19 00:26:00,672: INFO/ForkPoolWorker-16] [69e62031-f90e-41c5-952e-6e2fcc306c7a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T00:26:00.971308017Z [2024-06-19 00:26:00,968: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T00:26:00.984313789Z [2024-06-19 00:26:00,981: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T00:26:01.145738754Z [2024-06-19 00:26:01,141: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-19T00:26:01.151396759Z [2024-06-19 00:26:01,147: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T00:26:01.315313895Z [2024-06-19 00:26:01,314: INFO/ForkPoolWorker-1] Getting SDNC list 2024-06-19T00:26:01.320470156Z [2024-06-19 00:26:01,320: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:26:01.365683435Z [2024-06-19 00:26:01,365: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T00:26:01.366571723Z [2024-06-19 00:26:01,366: INFO/ForkPoolWorker-1] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T00:26:01.366718223Z [2024-06-19 00:26:01,366: INFO/ForkPoolWorker-1] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T00:26:01.366802600Z [2024-06-19 00:26:01,366: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-06-19T00:26:01.367138169Z [2024-06-19 00:26:01,366: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T00:26:01.474019954Z [2024-06-19 00:26:01,473: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:26:01.510340361Z [2024-06-19 00:26:01,510: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:26:02.106257240Z [2024-06-19 00:26:02,105: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4a5b4306-6a1b-4084-96fe-fb5ed651cad7] succeeded in 1.474755795999954s: None 2024-06-19T00:26:02.126608690Z [2024-06-19 00:26:02,126: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[218d608f-7984-49cd-9ea6-f2342b5ab516] succeeded in 1.4844517100000303s: None 2024-06-19T00:26:02.536380089Z [2024-06-19 00:26:02,535: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T00:26:02.541581714Z [2024-06-19 00:26:02,541: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:26:02.602858626Z [2024-06-19 00:26:02,602: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T00:26:02.611087243Z [2024-06-19 00:26:02,610: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:26:02.611387861Z [2024-06-19 00:26:02,611: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:26:02.611823479Z [2024-06-19 00:26:02,611: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:26:02.612171168Z [2024-06-19 00:26:02,611: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T00:26:02.612782792Z [2024-06-19 00:26:02,612: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-19T00:26:02.613798968Z [2024-06-19 00:26:02,613: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:26:02.674803438Z [2024-06-19 00:26:02,674: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-19T00:26:02.680732515Z [2024-06-19 00:26:02,680: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:26:02.700044260Z [2024-06-19 00:26:02,699: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:26:02.714408699Z [2024-06-19 00:26:02,714: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T00:26:02.716610395Z [2024-06-19 00:26:02,716: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:26:02.716622865Z [2024-06-19 00:26:02,716: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:26:02.716821258Z [2024-06-19 00:26:02,716: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:26:02.716845132Z [2024-06-19 00:26:02,716: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-19T00:26:02.717190277Z [2024-06-19 00:26:02,717: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T00:26:02.717217307Z [2024-06-19 00:26:02,717: INFO/ForkPoolWorker-2] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:26:02.823227990Z [2024-06-19 00:26:02,822: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:26:04.826001804Z [2024-06-19 00:26:04,825: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[9dc9de3b-761f-456d-a861-01b15bfbe509] succeeded in 4.185683046999657s: None 2024-06-19T00:26:05.120552282Z [2024-06-19 00:26:05,120: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[69e62031-f90e-41c5-952e-6e2fcc306c7a] succeeded in 4.4826951109998845s: None 2024-06-19T00:27:00.591868649Z [2024-06-19 00:27:00,590: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5b48ebf7-b6a2-4b2e-aa41-47245f7536b4] received 2024-06-19T00:27:00.598193238Z [2024-06-19 00:27:00,597: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[33249b7d-0f43-42aa-8a47-a9b3aa3b4689] received 2024-06-19T00:27:00.604860288Z [2024-06-19 00:27:00,601: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e690cf3d-6f2b-4ab2-a14e-cfddb04ac6f2] received 2024-06-19T00:27:00.604884513Z [2024-06-19 00:27:00,602: INFO/ForkPoolWorker-15] [5b48ebf7-b6a2-4b2e-aa41-47245f7536b4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T00:27:00.617195466Z [2024-06-19 00:27:00,612: INFO/ForkPoolWorker-16] [33249b7d-0f43-42aa-8a47-a9b3aa3b4689] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T00:27:00.624852083Z [2024-06-19 00:27:00,624: INFO/ForkPoolWorker-1] [e690cf3d-6f2b-4ab2-a14e-cfddb04ac6f2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T00:27:00.916040228Z [2024-06-19 00:27:00,912: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T00:27:00.974223079Z [2024-06-19 00:27:00,969: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T00:27:00.978283509Z [2024-06-19 00:27:00,974: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T00:27:01.180704082Z [2024-06-19 00:27:01,180: INFO/ForkPoolWorker-16] Getting SDNC list 2024-06-19T00:27:01.186378992Z [2024-06-19 00:27:01,185: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:27:01.215033130Z [2024-06-19 00:27:01,214: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T00:27:01.216688626Z [2024-06-19 00:27:01,216: INFO/ForkPoolWorker-16] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T00:27:01.216795450Z [2024-06-19 00:27:01,216: INFO/ForkPoolWorker-16] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T00:27:01.216856146Z [2024-06-19 00:27:01,216: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-06-19T00:27:01.217089308Z [2024-06-19 00:27:01,216: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T00:27:01.352371545Z [2024-06-19 00:27:01,352: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:27:02.141289586Z [2024-06-19 00:27:02,140: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[33249b7d-0f43-42aa-8a47-a9b3aa3b4689] succeeded in 1.540663900999789s: None 2024-06-19T00:27:02.163929379Z [2024-06-19 00:27:02,163: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T00:27:02.167239049Z [2024-06-19 00:27:02,166: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:27:02.188623315Z [2024-06-19 00:27:02,188: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T00:27:02.190239502Z [2024-06-19 00:27:02,190: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:27:02.190369765Z [2024-06-19 00:27:02,190: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:27:02.190549842Z [2024-06-19 00:27:02,190: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:27:02.190660486Z [2024-06-19 00:27:02,190: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T00:27:02.190962235Z [2024-06-19 00:27:02,190: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T00:27:02.191079995Z [2024-06-19 00:27:02,190: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:27:02.402339681Z [2024-06-19 00:27:02,401: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:27:02.566382423Z [2024-06-19 00:27:02,565: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T00:27:02.569794288Z [2024-06-19 00:27:02,569: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:27:02.595380477Z [2024-06-19 00:27:02,595: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T00:27:02.597742399Z [2024-06-19 00:27:02,597: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:27:02.597817657Z [2024-06-19 00:27:02,597: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:27:02.598073084Z [2024-06-19 00:27:02,597: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:27:02.598146025Z [2024-06-19 00:27:02,598: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T00:27:02.598506058Z [2024-06-19 00:27:02,598: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-06-19T00:27:02.598598525Z [2024-06-19 00:27:02,598: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:27:02.712737734Z [2024-06-19 00:27:02,712: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:27:03.992776047Z [2024-06-19 00:27:03,992: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e690cf3d-6f2b-4ab2-a14e-cfddb04ac6f2] succeeded in 3.375601925999945s: None 2024-06-19T00:27:05.794557579Z [2024-06-19 00:27:05,793: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5b48ebf7-b6a2-4b2e-aa41-47245f7536b4] succeeded in 5.1989940819994445s: None 2024-06-19T00:28:00.336317845Z [2024-06-19 00:28:00,334: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[068f20d1-a76c-4ee9-8b97-8bf14f552749] received 2024-06-19T00:28:00.341934779Z [2024-06-19 00:28:00,341: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[33919a6d-ec65-461f-8d48-a0f1b00c4fd6] received 2024-06-19T00:28:00.344996170Z [2024-06-19 00:28:00,344: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6fd73c2f-a121-40f7-97f1-965fdc273fa6] received 2024-06-19T00:28:00.351753362Z [2024-06-19 00:28:00,351: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3446cc51-ee60-4a7e-b5b4-81e246678d52] received 2024-06-19T00:28:00.353227031Z [2024-06-19 00:28:00,352: INFO/ForkPoolWorker-16] [33919a6d-ec65-461f-8d48-a0f1b00c4fd6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T00:28:00.363530711Z [2024-06-19 00:28:00,362: INFO/ForkPoolWorker-1] [6fd73c2f-a121-40f7-97f1-965fdc273fa6] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T00:28:00.368535339Z [2024-06-19 00:28:00,368: INFO/ForkPoolWorker-15] [068f20d1-a76c-4ee9-8b97-8bf14f552749] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-19T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-19T00:28:00.369569991Z [2024-06-19 00:28:00,369: INFO/ForkPoolWorker-2] [3446cc51-ee60-4a7e-b5b4-81e246678d52] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T00:28:00.694307794Z [2024-06-19 00:28:00,689: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-19T00:28:00.723050140Z [2024-06-19 00:28:00,719: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T00:28:00.726430926Z [2024-06-19 00:28:00,722: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T00:28:00.826102747Z [2024-06-19 00:28:00,816: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T00:28:00.955887700Z [2024-06-19 00:28:00,955: INFO/ForkPoolWorker-1] Getting SDNC list 2024-06-19T00:28:00.958858720Z [2024-06-19 00:28:00,958: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:28:00.961087405Z [2024-06-19 00:28:00,960: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:28:00.989465737Z [2024-06-19 00:28:00,989: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T00:28:00.990777887Z [2024-06-19 00:28:00,990: INFO/ForkPoolWorker-1] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T00:28:00.991003565Z [2024-06-19 00:28:00,990: INFO/ForkPoolWorker-1] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T00:28:00.991148780Z [2024-06-19 00:28:00,991: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-06-19T00:28:00.991423439Z [2024-06-19 00:28:00,991: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T00:28:01.132890650Z [2024-06-19 00:28:01,132: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:28:01.611997652Z [2024-06-19 00:28:01,611: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[068f20d1-a76c-4ee9-8b97-8bf14f552749] succeeded in 1.2695807500003866s: None 2024-06-19T00:28:01.945126562Z [2024-06-19 00:28:01,944: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6fd73c2f-a121-40f7-97f1-965fdc273fa6] succeeded in 1.594192777999524s: None 2024-06-19T00:28:02.147864739Z [2024-06-19 00:28:02,147: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T00:28:02.151037012Z [2024-06-19 00:28:02,150: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:28:02.172930649Z [2024-06-19 00:28:02,172: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T00:28:02.175232659Z [2024-06-19 00:28:02,174: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:28:02.175271864Z [2024-06-19 00:28:02,175: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:28:02.175427723Z [2024-06-19 00:28:02,175: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:28:02.175572249Z [2024-06-19 00:28:02,175: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T00:28:02.175927869Z [2024-06-19 00:28:02,175: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T00:28:02.179956214Z [2024-06-19 00:28:02,175: INFO/ForkPoolWorker-16] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:28:02.215878610Z [2024-06-19 00:28:02,215: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-19T00:28:02.219293933Z [2024-06-19 00:28:02,218: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:28:02.311850868Z [2024-06-19 00:28:02,311: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T00:28:02.313499148Z [2024-06-19 00:28:02,313: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:28:02.313523678Z [2024-06-19 00:28:02,313: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:28:02.313612484Z [2024-06-19 00:28:02,313: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:28:02.313620144Z [2024-06-19 00:28:02,313: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-19T00:28:02.313896490Z [2024-06-19 00:28:02,313: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-06-19T00:28:02.313909676Z [2024-06-19 00:28:02,313: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:28:02.322384643Z [2024-06-19 00:28:02,322: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:28:02.430680292Z [2024-06-19 00:28:02,430: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:28:03.864181081Z [2024-06-19 00:28:03,863: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[33919a6d-ec65-461f-8d48-a0f1b00c4fd6] succeeded in 3.518855082999835s: None 2024-06-19T00:28:04.615321181Z [2024-06-19 00:28:04,614: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[3446cc51-ee60-4a7e-b5b4-81e246678d52] succeeded in 4.260306655000022s: None 2024-06-19T00:29:01.128290201Z [2024-06-19 00:29:01,127: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[29e86c87-8f9b-40e2-b87b-0f943d7eb47b] received 2024-06-19T00:29:01.139914144Z [2024-06-19 00:29:01,139: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0cd06796-8fbb-40a0-9ece-6d55bc265325] received 2024-06-19T00:29:01.148289339Z [2024-06-19 00:29:01,146: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ab5854e3-21fd-4870-92a8-f08081f29a80] received 2024-06-19T00:29:01.155586718Z [2024-06-19 00:29:01,155: INFO/ForkPoolWorker-15] [29e86c87-8f9b-40e2-b87b-0f943d7eb47b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T00:29:01.165238616Z [2024-06-19 00:29:01,164: INFO/ForkPoolWorker-16] [0cd06796-8fbb-40a0-9ece-6d55bc265325] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T00:29:01.165375624Z [2024-06-19 00:29:01,165: INFO/ForkPoolWorker-1] [ab5854e3-21fd-4870-92a8-f08081f29a80] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T00:29:01.477969689Z [2024-06-19 00:29:01,473: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T00:29:01.494141580Z [2024-06-19 00:29:01,489: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T00:29:01.499494770Z [2024-06-19 00:29:01,493: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T00:29:01.662054706Z [2024-06-19 00:29:01,661: INFO/ForkPoolWorker-1] Getting SDNC list 2024-06-19T00:29:01.666154494Z [2024-06-19 00:29:01,665: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:29:01.708014371Z [2024-06-19 00:29:01,707: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T00:29:01.709909193Z [2024-06-19 00:29:01,709: INFO/ForkPoolWorker-1] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T00:29:01.710084454Z [2024-06-19 00:29:01,709: INFO/ForkPoolWorker-1] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T00:29:01.710216608Z [2024-06-19 00:29:01,710: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-06-19T00:29:01.710896470Z [2024-06-19 00:29:01,710: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T00:29:01.836496829Z [2024-06-19 00:29:01,836: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:29:02.568249136Z [2024-06-19 00:29:02,567: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ab5854e3-21fd-4870-92a8-f08081f29a80] succeeded in 1.413518271000612s: None 2024-06-19T00:29:02.820051415Z [2024-06-19 00:29:02,819: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T00:29:02.823263810Z [2024-06-19 00:29:02,822: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:29:02.850108924Z [2024-06-19 00:29:02,849: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T00:29:02.851991073Z [2024-06-19 00:29:02,851: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:29:02.852096538Z [2024-06-19 00:29:02,851: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:29:02.852409047Z [2024-06-19 00:29:02,852: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:29:02.852519804Z [2024-06-19 00:29:02,852: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T00:29:02.853050192Z [2024-06-19 00:29:02,852: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T00:29:02.853087807Z [2024-06-19 00:29:02,852: INFO/ForkPoolWorker-16] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:29:02.966355896Z [2024-06-19 00:29:02,965: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T00:29:02.970603437Z [2024-06-19 00:29:02,970: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:29:02.999322655Z [2024-06-19 00:29:02,999: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T00:29:03.004486139Z [2024-06-19 00:29:03,004: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:29:03.004606262Z [2024-06-19 00:29:03,004: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:29:03.004773767Z [2024-06-19 00:29:03,004: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:29:03.004865281Z [2024-06-19 00:29:03,004: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T00:29:03.005155481Z [2024-06-19 00:29:03,005: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-06-19T00:29:03.005232588Z [2024-06-19 00:29:03,005: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:29:03.013471392Z [2024-06-19 00:29:03,013: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:29:03.102193101Z [2024-06-19 00:29:03,101: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:29:05.207137166Z [2024-06-19 00:29:05,206: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0cd06796-8fbb-40a0-9ece-6d55bc265325] succeeded in 4.061973300000318s: None 2024-06-19T00:29:05.697357950Z [2024-06-19 00:29:05,696: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[29e86c87-8f9b-40e2-b87b-0f943d7eb47b] succeeded in 4.561933843000588s: None 2024-06-19T00:30:01.060174897Z [2024-06-19 00:30:01,059: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1cf72c39-058f-42e1-a0a5-3dc5d58ef940] received 2024-06-19T00:30:01.065545406Z [2024-06-19 00:30:01,065: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dbfcd5c2-f624-4753-8b8b-2c06e2ab4dd4] received 2024-06-19T00:30:01.068182829Z [2024-06-19 00:30:01,067: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9c6c9b46-b03a-4112-966f-538631b51020] received 2024-06-19T00:30:01.076011474Z [2024-06-19 00:30:01,075: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[24af80c0-669c-4034-a76d-4ad33ecab0b8] received 2024-06-19T00:30:01.076986591Z [2024-06-19 00:30:01,076: INFO/ForkPoolWorker-1] [9c6c9b46-b03a-4112-966f-538631b51020] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T00:30:01.084344795Z [2024-06-19 00:30:01,084: INFO/ForkPoolWorker-16] [dbfcd5c2-f624-4753-8b8b-2c06e2ab4dd4] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-19T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-19T00:30:01.088429487Z [2024-06-19 00:30:01,088: INFO/ForkPoolWorker-15] [1cf72c39-058f-42e1-a0a5-3dc5d58ef940] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-19T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T00:30:01.091465849Z [2024-06-19 00:30:01,091: INFO/ForkPoolWorker-2] [24af80c0-669c-4034-a76d-4ad33ecab0b8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T00:30:01.097451248Z [2024-06-19 00:30:01,097: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[892ccd72-3a9e-4218-990b-3c4b132c4566] received 2024-06-19T00:30:01.107833387Z [2024-06-19 00:30:01,107: INFO/ForkPoolWorker-3] [892ccd72-3a9e-4218-990b-3c4b132c4566] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T00:30:01.403775737Z [2024-06-19 00:30:01,400: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-19T00:30:01.423823671Z [2024-06-19 00:30:01,420: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T00:30:01.646833798Z [2024-06-19 00:30:01,646: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:30:01.850797446Z [2024-06-19 00:30:01,847: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T00:30:01.854434069Z [2024-06-19 00:30:01,843: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T00:30:01.864040285Z [2024-06-19 00:30:01,853: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T00:30:02.118530917Z [2024-06-19 00:30:02,118: INFO/ForkPoolWorker-1] Getting SDNC list 2024-06-19T00:30:02.123487125Z [2024-06-19 00:30:02,122: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:30:02.165935414Z [2024-06-19 00:30:02,165: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[dbfcd5c2-f624-4753-8b8b-2c06e2ab4dd4] succeeded in 1.0983383740003774s: None 2024-06-19T00:30:02.177918299Z [2024-06-19 00:30:02,177: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T00:30:02.180789312Z [2024-06-19 00:30:02,180: INFO/ForkPoolWorker-1] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T00:30:02.181191370Z [2024-06-19 00:30:02,180: INFO/ForkPoolWorker-1] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T00:30:02.181477626Z [2024-06-19 00:30:02,181: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-06-19T00:30:02.182095581Z [2024-06-19 00:30:02,181: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T00:30:02.351482879Z [2024-06-19 00:30:02,351: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:30:03.172890864Z [2024-06-19 00:30:03,172: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9c6c9b46-b03a-4112-966f-538631b51020] succeeded in 2.103159109000444s: None 2024-06-19T00:30:03.483198894Z [2024-06-19 00:30:03,482: INFO/ForkPoolWorker-3] Getting VIM list 2024-06-19T00:30:03.488666582Z [2024-06-19 00:30:03,487: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:30:03.518529723Z [2024-06-19 00:30:03,517: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-19T00:30:03.521822468Z [2024-06-19 00:30:03,521: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:30:03.540457857Z [2024-06-19 00:30:03,540: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-06-19T00:30:03.542502541Z [2024-06-19 00:30:03,542: INFO/ForkPoolWorker-3] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:30:03.542514030Z [2024-06-19 00:30:03,542: INFO/ForkPoolWorker-3] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:30:03.542733843Z [2024-06-19 00:30:03,542: INFO/ForkPoolWorker-3] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:30:03.543443738Z [2024-06-19 00:30:03,542: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-06-19T00:30:03.543782962Z [2024-06-19 00:30:03,543: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-06-19T00:30:03.543792769Z [2024-06-19 00:30:03,543: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:30:03.553854723Z [2024-06-19 00:30:03,553: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T00:30:03.555502407Z [2024-06-19 00:30:03,555: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:30:03.555582728Z [2024-06-19 00:30:03,555: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:30:03.555867496Z [2024-06-19 00:30:03,555: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:30:03.556046576Z [2024-06-19 00:30:03,555: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-19T00:30:03.556527555Z [2024-06-19 00:30:03,556: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T00:30:03.556608500Z [2024-06-19 00:30:03,556: INFO/ForkPoolWorker-2] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:30:03.650180048Z [2024-06-19 00:30:03,649: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:30:03.657510995Z [2024-06-19 00:30:03,657: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T00:30:03.665547725Z [2024-06-19 00:30:03,664: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:30:03.689322643Z [2024-06-19 00:30:03,688: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:30:03.706459653Z [2024-06-19 00:30:03,706: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T00:30:03.709099378Z [2024-06-19 00:30:03,708: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:30:03.710081529Z [2024-06-19 00:30:03,709: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:30:03.710344020Z [2024-06-19 00:30:03,710: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:30:03.710545652Z [2024-06-19 00:30:03,710: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T00:30:03.714247585Z [2024-06-19 00:30:03,713: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T00:30:03.714480365Z [2024-06-19 00:30:03,714: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:30:03.824412242Z [2024-06-19 00:30:03,823: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:30:04.527282642Z [2024-06-19 00:30:04,526: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1cf72c39-058f-42e1-a0a5-3dc5d58ef940] succeeded in 3.461657371000001s: None 2024-06-19T00:30:05.210196547Z [2024-06-19 00:30:05,209: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[16930187-6af0-4e30-949c-871dc96f483c] received 2024-06-19T00:30:05.221228971Z [2024-06-19 00:30:05,220: INFO/ForkPoolWorker-15] [16930187-6af0-4e30-949c-871dc96f483c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'split_metrics', 'scheduled__2024-06-19T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T00:30:05.295061717Z [2024-06-19 00:30:05,294: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[24af80c0-669c-4034-a76d-4ad33ecab0b8] succeeded in 4.211465315000169s: None 2024-06-19T00:30:05.537249580Z [2024-06-19 00:30:05,533: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T00:30:05.558866160Z [2024-06-19 00:30:05,558: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[892ccd72-3a9e-4218-990b-3c4b132c4566] succeeded in 4.4591407970001455s: None 2024-06-19T00:30:06.616541519Z [2024-06-19 00:30:06,615: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T00:30:06.619764093Z [2024-06-19 00:30:06,619: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:30:06.646710250Z [2024-06-19 00:30:06,646: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T00:30:06.649385686Z [2024-06-19 00:30:06,649: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:30:06.649664702Z [2024-06-19 00:30:06,649: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:30:06.649980253Z [2024-06-19 00:30:06,649: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:30:06.650210591Z [2024-06-19 00:30:06,650: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T00:30:06.650621731Z [2024-06-19 00:30:06,650: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T00:30:06.650886326Z [2024-06-19 00:30:06,650: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:30:06.741717949Z [2024-06-19 00:30:06,741: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:30:07.474407337Z [2024-06-19 00:30:07,473: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[16930187-6af0-4e30-949c-871dc96f483c] succeeded in 2.262290925999878s: None 2024-06-19T00:30:07.977005490Z [2024-06-19 00:30:07,976: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b7c4a176-5436-4f21-a00b-cf1fc35967a0] received 2024-06-19T00:30:07.984288165Z [2024-06-19 00:30:07,984: INFO/ForkPoolWorker-15] [b7c4a176-5436-4f21-a00b-cf1fc35967a0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'collect_metrics', 'scheduled__2024-06-19T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-19T00:30:08.290756833Z [2024-06-19 00:30:08,287: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T00:30:09.353311739Z [2024-06-19 00:30:09,352: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T00:30:09.356351036Z [2024-06-19 00:30:09,355: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:30:09.381867105Z [2024-06-19 00:30:09,381: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T00:30:09.383370166Z [2024-06-19 00:30:09,383: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:30:09.383433912Z [2024-06-19 00:30:09,383: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:30:09.383646816Z [2024-06-19 00:30:09,383: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:30:09.383742838Z [2024-06-19 00:30:09,383: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T00:30:09.384113490Z [2024-06-19 00:30:09,383: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T00:30:09.384679848Z [2024-06-19 00:30:09,384: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:30:09.532171917Z [2024-06-19 00:30:09,531: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:30:10.197958817Z [2024-06-19 00:30:10,197: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b7c4a176-5436-4f21-a00b-cf1fc35967a0] succeeded in 2.218878098999994s: None 2024-06-19T00:30:10.430225240Z [2024-06-19 00:30:10,429: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[359b25a4-ed2f-4d02-a328-c647add8dd01] received 2024-06-19T00:30:10.440036600Z [2024-06-19 00:30:10,439: INFO/ForkPoolWorker-15] [359b25a4-ed2f-4d02-a328-c647add8dd01] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'send_prometheus', 'scheduled__2024-06-19T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T00:30:10.748217304Z [2024-06-19 00:30:10,744: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T00:30:11.789596104Z [2024-06-19 00:30:11,789: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T00:30:11.792911817Z [2024-06-19 00:30:11,792: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:30:11.814794431Z [2024-06-19 00:30:11,814: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T00:30:11.816409602Z [2024-06-19 00:30:11,816: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:30:11.816523283Z [2024-06-19 00:30:11,816: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:30:11.816737543Z [2024-06-19 00:30:11,816: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:30:11.816817359Z [2024-06-19 00:30:11,816: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T00:30:11.817118463Z [2024-06-19 00:30:11,816: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T00:30:11.817318714Z [2024-06-19 00:30:11,817: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:30:11.919038852Z [2024-06-19 00:30:11,918: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:30:12.640095704Z [2024-06-19 00:30:12,639: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[359b25a4-ed2f-4d02-a328-c647add8dd01] succeeded in 2.2067263689996253s: None 2024-06-19T00:31:01.295778980Z [2024-06-19 00:31:01,295: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fb689d91-3c27-4582-9ae1-71d0abfe0904] received 2024-06-19T00:31:01.309875012Z [2024-06-19 00:31:01,309: INFO/ForkPoolWorker-15] [fb689d91-3c27-4582-9ae1-71d0abfe0904] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T00:31:01.312793792Z [2024-06-19 00:31:01,312: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[22a9fefe-8321-44d8-82aa-ff94b41f13b5] received 2024-06-19T00:31:01.326013570Z [2024-06-19 00:31:01,325: INFO/ForkPoolWorker-16] [22a9fefe-8321-44d8-82aa-ff94b41f13b5] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T00:31:01.329802563Z [2024-06-19 00:31:01,329: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ff0ee516-ee9d-4cad-be22-14a1211ebd4b] received 2024-06-19T00:31:01.338715971Z [2024-06-19 00:31:01,338: INFO/ForkPoolWorker-1] [ff0ee516-ee9d-4cad-be22-14a1211ebd4b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T00:31:01.657079188Z [2024-06-19 00:31:01,650: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T00:31:01.683150693Z [2024-06-19 00:31:01,679: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T00:31:01.688959730Z [2024-06-19 00:31:01,680: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T00:31:01.938324049Z [2024-06-19 00:31:01,937: INFO/ForkPoolWorker-16] Getting SDNC list 2024-06-19T00:31:01.944159760Z [2024-06-19 00:31:01,943: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:31:01.985414802Z [2024-06-19 00:31:01,985: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T00:31:01.989037734Z [2024-06-19 00:31:01,988: INFO/ForkPoolWorker-16] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T00:31:01.989225700Z [2024-06-19 00:31:01,988: INFO/ForkPoolWorker-16] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T00:31:01.989345695Z [2024-06-19 00:31:01,989: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-06-19T00:31:01.989716465Z [2024-06-19 00:31:01,989: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T00:31:02.118530013Z [2024-06-19 00:31:02,118: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:31:02.936896388Z [2024-06-19 00:31:02,936: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[22a9fefe-8321-44d8-82aa-ff94b41f13b5] succeeded in 1.6198876489997929s: None 2024-06-19T00:31:03.137573121Z [2024-06-19 00:31:03,137: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T00:31:03.140676420Z [2024-06-19 00:31:03,140: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:31:03.160495219Z [2024-06-19 00:31:03,160: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T00:31:03.163575812Z [2024-06-19 00:31:03,163: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T00:31:03.163593887Z [2024-06-19 00:31:03,163: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:31:03.165148970Z [2024-06-19 00:31:03,164: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:31:03.165256630Z [2024-06-19 00:31:03,165: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:31:03.165472367Z [2024-06-19 00:31:03,165: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:31:03.165521390Z [2024-06-19 00:31:03,165: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T00:31:03.166334260Z [2024-06-19 00:31:03,166: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-06-19T00:31:03.166384824Z [2024-06-19 00:31:03,166: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:31:03.185643515Z [2024-06-19 00:31:03,185: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T00:31:03.187162649Z [2024-06-19 00:31:03,186: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:31:03.187182158Z [2024-06-19 00:31:03,187: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:31:03.187349127Z [2024-06-19 00:31:03,187: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:31:03.187364205Z [2024-06-19 00:31:03,187: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T00:31:03.187670531Z [2024-06-19 00:31:03,187: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T00:31:03.187736650Z [2024-06-19 00:31:03,187: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:31:03.240783575Z [2024-06-19 00:31:03,240: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:31:03.260184130Z [2024-06-19 00:31:03,259: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:31:05.027065585Z [2024-06-19 00:31:05,026: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ff0ee516-ee9d-4cad-be22-14a1211ebd4b] succeeded in 3.69525171100031s: None 2024-06-19T00:31:05.383560973Z [2024-06-19 00:31:05,383: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fb689d91-3c27-4582-9ae1-71d0abfe0904] succeeded in 4.084360666998691s: None 2024-06-19T00:32:01.320563020Z [2024-06-19 00:32:01,320: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d1f17042-4403-47eb-aab7-3d5f7bd686f4] received 2024-06-19T00:32:01.322320413Z [2024-06-19 00:32:01,322: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0054ef44-48cd-4b15-b175-e227ae7162d8] received 2024-06-19T00:32:01.323672319Z [2024-06-19 00:32:01,323: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[166ad667-4c3f-407c-a1e8-c726ad0202ec] received 2024-06-19T00:32:01.332019477Z [2024-06-19 00:32:01,331: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[391cd8a7-5220-430d-80e8-30808fecf3ec] received 2024-06-19T00:32:01.333098138Z [2024-06-19 00:32:01,332: INFO/ForkPoolWorker-1] [166ad667-4c3f-407c-a1e8-c726ad0202ec] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-19T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-19T00:32:01.345289533Z [2024-06-19 00:32:01,344: INFO/ForkPoolWorker-15] [d1f17042-4403-47eb-aab7-3d5f7bd686f4] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T00:32:01.362415375Z [2024-06-19 00:32:01,361: INFO/ForkPoolWorker-16] [0054ef44-48cd-4b15-b175-e227ae7162d8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T00:32:01.365441501Z [2024-06-19 00:32:01,365: INFO/ForkPoolWorker-2] [391cd8a7-5220-430d-80e8-30808fecf3ec] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T00:32:01.657409903Z [2024-06-19 00:32:01,654: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T00:32:01.662224080Z [2024-06-19 00:32:01,658: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T00:32:01.702590410Z [2024-06-19 00:32:01,696: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-19T00:32:01.713267515Z [2024-06-19 00:32:01,708: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T00:32:01.938932312Z [2024-06-19 00:32:01,938: INFO/ForkPoolWorker-15] Getting SDNC list 2024-06-19T00:32:01.944704222Z [2024-06-19 00:32:01,944: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:32:01.998850567Z [2024-06-19 00:32:01,998: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T00:32:02.001247895Z [2024-06-19 00:32:02,001: INFO/ForkPoolWorker-15] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T00:32:02.001425424Z [2024-06-19 00:32:02,001: INFO/ForkPoolWorker-15] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T00:32:02.001558475Z [2024-06-19 00:32:02,001: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-06-19T00:32:02.001870385Z [2024-06-19 00:32:02,001: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T00:32:02.006509280Z [2024-06-19 00:32:02,006: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:32:02.143971309Z [2024-06-19 00:32:02,143: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:32:02.672756973Z [2024-06-19 00:32:02,672: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[166ad667-4c3f-407c-a1e8-c726ad0202ec] succeeded in 1.3475428260007902s: None 2024-06-19T00:32:02.815666612Z [2024-06-19 00:32:02,815: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d1f17042-4403-47eb-aab7-3d5f7bd686f4] succeeded in 1.4890544190002402s: None 2024-06-19T00:32:03.068248179Z [2024-06-19 00:32:03,067: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-19T00:32:03.072048489Z [2024-06-19 00:32:03,071: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:32:03.112292532Z [2024-06-19 00:32:03,111: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T00:32:03.116294440Z [2024-06-19 00:32:03,115: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:32:03.117463662Z [2024-06-19 00:32:03,117: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T00:32:03.120654760Z [2024-06-19 00:32:03,120: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:32:03.120974851Z [2024-06-19 00:32:03,120: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:32:03.121325361Z [2024-06-19 00:32:03,120: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:32:03.121562446Z [2024-06-19 00:32:03,121: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-19T00:32:03.121983882Z [2024-06-19 00:32:03,121: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T00:32:03.122545020Z [2024-06-19 00:32:03,122: INFO/ForkPoolWorker-2] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:32:03.144795957Z [2024-06-19 00:32:03,144: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T00:32:03.146542179Z [2024-06-19 00:32:03,146: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:32:03.146715522Z [2024-06-19 00:32:03,146: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:32:03.146935926Z [2024-06-19 00:32:03,146: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:32:03.147023482Z [2024-06-19 00:32:03,146: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T00:32:03.147461343Z [2024-06-19 00:32:03,147: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-19T00:32:03.147530186Z [2024-06-19 00:32:03,147: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:32:03.218251383Z [2024-06-19 00:32:03,217: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:32:03.272647261Z [2024-06-19 00:32:03,272: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:32:05.872308982Z [2024-06-19 00:32:05,871: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[391cd8a7-5220-430d-80e8-30808fecf3ec] succeeded in 4.536479706999671s: None 2024-06-19T00:32:06.815128714Z [2024-06-19 00:32:06,814: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0054ef44-48cd-4b15-b175-e227ae7162d8] succeeded in 5.4899751159991865s: None 2024-06-19T00:33:01.041065092Z [2024-06-19 00:33:01,038: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a4beb5b2-b2c0-40de-a37c-805e8f186610] received 2024-06-19T00:33:01.050147143Z [2024-06-19 00:33:01,049: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[60ee4b2b-d741-4092-b716-0ee120aa6e3f] received 2024-06-19T00:33:01.070778694Z [2024-06-19 00:33:01,070: INFO/ForkPoolWorker-16] [60ee4b2b-d741-4092-b716-0ee120aa6e3f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T00:33:01.075860847Z [2024-06-19 00:33:01,075: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[702a8399-d369-4fcc-b472-5be709e64d96] received 2024-06-19T00:33:01.081580889Z [2024-06-19 00:33:01,081: INFO/ForkPoolWorker-15] [a4beb5b2-b2c0-40de-a37c-805e8f186610] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T00:33:01.086874619Z [2024-06-19 00:33:01,086: INFO/ForkPoolWorker-1] [702a8399-d369-4fcc-b472-5be709e64d96] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T00:33:01.410766898Z [2024-06-19 00:33:01,407: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T00:33:01.415019187Z [2024-06-19 00:33:01,411: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T00:33:01.431234665Z [2024-06-19 00:33:01,427: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T00:33:01.563754206Z [2024-06-19 00:33:01,563: INFO/ForkPoolWorker-15] Getting SDNC list 2024-06-19T00:33:01.567869869Z [2024-06-19 00:33:01,567: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:33:01.592861623Z [2024-06-19 00:33:01,592: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T00:33:01.596454353Z [2024-06-19 00:33:01,596: INFO/ForkPoolWorker-15] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T00:33:01.596494109Z [2024-06-19 00:33:01,596: INFO/ForkPoolWorker-15] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T00:33:01.596565495Z [2024-06-19 00:33:01,596: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-06-19T00:33:01.596780302Z [2024-06-19 00:33:01,596: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T00:33:01.707666998Z [2024-06-19 00:33:01,707: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:33:02.327975619Z [2024-06-19 00:33:02,327: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a4beb5b2-b2c0-40de-a37c-805e8f186610] succeeded in 1.2731563010001992s: None 2024-06-19T00:33:02.624407065Z [2024-06-19 00:33:02,623: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T00:33:02.624929623Z [2024-06-19 00:33:02,624: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T00:33:02.627366119Z [2024-06-19 00:33:02,626: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:33:02.628136357Z [2024-06-19 00:33:02,627: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:33:02.656465118Z [2024-06-19 00:33:02,656: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T00:33:02.658220828Z [2024-06-19 00:33:02,657: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:33:02.658239162Z [2024-06-19 00:33:02,658: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:33:02.658342994Z [2024-06-19 00:33:02,658: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:33:02.658357703Z [2024-06-19 00:33:02,658: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T00:33:02.658622238Z [2024-06-19 00:33:02,658: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-19T00:33:02.658633222Z [2024-06-19 00:33:02,658: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:33:02.658861023Z [2024-06-19 00:33:02,658: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T00:33:02.660288324Z [2024-06-19 00:33:02,660: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:33:02.660477989Z [2024-06-19 00:33:02,660: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:33:02.660691323Z [2024-06-19 00:33:02,660: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:33:02.660818051Z [2024-06-19 00:33:02,660: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T00:33:02.661244018Z [2024-06-19 00:33:02,661: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T00:33:02.661388956Z [2024-06-19 00:33:02,661: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:33:02.732900612Z [2024-06-19 00:33:02,732: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:33:02.747830446Z [2024-06-19 00:33:02,747: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:33:04.478578371Z [2024-06-19 00:33:04,477: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[702a8399-d369-4fcc-b472-5be709e64d96] succeeded in 3.399813992000418s: None 2024-06-19T00:33:04.566444892Z [2024-06-19 00:33:04,565: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[60ee4b2b-d741-4092-b716-0ee120aa6e3f] succeeded in 3.5036971570007154s: None 2024-06-19T00:34:00.523714467Z [2024-06-19 00:34:00,523: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[395fe3b1-ac0f-4891-b367-681e10272a32] received 2024-06-19T00:34:00.526286526Z [2024-06-19 00:34:00,526: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[42dd1394-a4f2-4535-913d-401e7024f1ff] received 2024-06-19T00:34:00.529647144Z [2024-06-19 00:34:00,529: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5894985a-529f-4575-8db0-f9ac957fc63b] received 2024-06-19T00:34:00.532033665Z [2024-06-19 00:34:00,531: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9ca19d02-89d8-4da5-b5b7-876aed9ab20b] received 2024-06-19T00:34:00.539173206Z [2024-06-19 00:34:00,538: INFO/ForkPoolWorker-15] [395fe3b1-ac0f-4891-b367-681e10272a32] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-19T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-19T00:34:00.545180898Z [2024-06-19 00:34:00,544: INFO/ForkPoolWorker-16] [42dd1394-a4f2-4535-913d-401e7024f1ff] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T00:34:00.567703966Z [2024-06-19 00:34:00,567: INFO/ForkPoolWorker-1] [5894985a-529f-4575-8db0-f9ac957fc63b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T00:34:00.583967814Z [2024-06-19 00:34:00,583: INFO/ForkPoolWorker-2] [9ca19d02-89d8-4da5-b5b7-876aed9ab20b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T00:34:00.964835822Z [2024-06-19 00:34:00,960: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T00:34:00.978679980Z [2024-06-19 00:34:00,973: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T00:34:01.024791132Z [2024-06-19 00:34:01,013: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T00:34:01.087199612Z [2024-06-19 00:34:01,083: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-19T00:34:01.141330120Z [2024-06-19 00:34:01,140: INFO/ForkPoolWorker-2] Getting SDNC list 2024-06-19T00:34:01.145510123Z [2024-06-19 00:34:01,145: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:34:01.191500992Z [2024-06-19 00:34:01,191: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T00:34:01.192968704Z [2024-06-19 00:34:01,192: INFO/ForkPoolWorker-2] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T00:34:01.193314227Z [2024-06-19 00:34:01,192: INFO/ForkPoolWorker-2] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T00:34:01.193466742Z [2024-06-19 00:34:01,193: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-06-19T00:34:01.193751325Z [2024-06-19 00:34:01,193: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T00:34:01.294264250Z [2024-06-19 00:34:01,293: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:34:01.558806557Z [2024-06-19 00:34:01,558: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:34:01.933698290Z [2024-06-19 00:34:01,933: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[9ca19d02-89d8-4da5-b5b7-876aed9ab20b] succeeded in 1.3973731610003597s: None 2024-06-19T00:34:02.276563816Z [2024-06-19 00:34:02,276: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[395fe3b1-ac0f-4891-b367-681e10272a32] succeeded in 1.7503441579992796s: None 2024-06-19T00:34:02.603249667Z [2024-06-19 00:34:02,602: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T00:34:02.606799646Z [2024-06-19 00:34:02,606: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:34:02.629827884Z [2024-06-19 00:34:02,629: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T00:34:02.633199888Z [2024-06-19 00:34:02,632: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:34:02.637605788Z [2024-06-19 00:34:02,637: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T00:34:02.640226526Z [2024-06-19 00:34:02,639: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:34:02.640434119Z [2024-06-19 00:34:02,640: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:34:02.640701501Z [2024-06-19 00:34:02,640: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:34:02.640866848Z [2024-06-19 00:34:02,640: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T00:34:02.641280732Z [2024-06-19 00:34:02,641: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-19T00:34:02.641566183Z [2024-06-19 00:34:02,641: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:34:02.663316118Z [2024-06-19 00:34:02,663: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T00:34:02.664709687Z [2024-06-19 00:34:02,664: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:34:02.664788489Z [2024-06-19 00:34:02,664: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:34:02.664816495Z [2024-06-19 00:34:02,664: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:34:02.664866968Z [2024-06-19 00:34:02,664: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T00:34:02.665154715Z [2024-06-19 00:34:02,665: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T00:34:02.665352277Z [2024-06-19 00:34:02,665: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:34:02.739590443Z [2024-06-19 00:34:02,739: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:34:02.761488162Z [2024-06-19 00:34:02,761: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:34:04.603085915Z [2024-06-19 00:34:04,602: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5894985a-529f-4575-8db0-f9ac957fc63b] succeeded in 4.071321270999761s: None 2024-06-19T00:34:04.926066129Z [2024-06-19 00:34:04,924: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[42dd1394-a4f2-4535-913d-401e7024f1ff] succeeded in 4.396320455998648s: None 2024-06-19T00:35:00.963810272Z [2024-06-19 00:35:00,963: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9450e803-4287-477f-bb46-7d3aa7111fc7] received 2024-06-19T00:35:00.968146587Z [2024-06-19 00:35:00,967: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[889bfef3-b226-46fd-aa77-2988348c3056] received 2024-06-19T00:35:00.978445165Z [2024-06-19 00:35:00,978: INFO/ForkPoolWorker-16] [889bfef3-b226-46fd-aa77-2988348c3056] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T00:35:00.978467626Z [2024-06-19 00:35:00,978: INFO/ForkPoolWorker-15] [9450e803-4287-477f-bb46-7d3aa7111fc7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-19T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T00:35:01.015806775Z [2024-06-19 00:35:01,015: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[78efc57c-758e-4b3d-9f6c-6657353c9eee] received 2024-06-19T00:35:01.020413285Z [2024-06-19 00:35:01,020: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[348baa29-80a0-4c0d-80c5-3ef440939af1] received 2024-06-19T00:35:01.034405828Z [2024-06-19 00:35:01,033: INFO/ForkPoolWorker-1] [78efc57c-758e-4b3d-9f6c-6657353c9eee] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T00:35:01.040890201Z [2024-06-19 00:35:01,040: INFO/ForkPoolWorker-2] [348baa29-80a0-4c0d-80c5-3ef440939af1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T00:35:01.313961132Z [2024-06-19 00:35:01,310: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T00:35:01.390053359Z [2024-06-19 00:35:01,386: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T00:35:01.391244344Z [2024-06-19 00:35:01,387: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T00:35:01.496067521Z [2024-06-19 00:35:01,491: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T00:35:01.657398513Z [2024-06-19 00:35:01,656: INFO/ForkPoolWorker-1] Getting SDNC list 2024-06-19T00:35:01.661659670Z [2024-06-19 00:35:01,661: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:35:01.709065510Z [2024-06-19 00:35:01,708: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T00:35:01.712787894Z [2024-06-19 00:35:01,712: INFO/ForkPoolWorker-1] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T00:35:01.712945237Z [2024-06-19 00:35:01,712: INFO/ForkPoolWorker-1] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T00:35:01.713026661Z [2024-06-19 00:35:01,712: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-06-19T00:35:01.713730249Z [2024-06-19 00:35:01,713: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T00:35:01.835414511Z [2024-06-19 00:35:01,835: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:35:02.607540042Z [2024-06-19 00:35:02,607: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T00:35:02.611017674Z [2024-06-19 00:35:02,610: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:35:02.642994631Z [2024-06-19 00:35:02,642: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T00:35:02.645136367Z [2024-06-19 00:35:02,644: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:35:02.645150283Z [2024-06-19 00:35:02,645: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:35:02.645245598Z [2024-06-19 00:35:02,645: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:35:02.645304959Z [2024-06-19 00:35:02,645: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T00:35:02.645572848Z [2024-06-19 00:35:02,645: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T00:35:02.645662962Z [2024-06-19 00:35:02,645: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:35:02.655921759Z [2024-06-19 00:35:02,655: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[78efc57c-758e-4b3d-9f6c-6657353c9eee] succeeded in 1.6375942089998716s: None 2024-06-19T00:35:02.743011235Z [2024-06-19 00:35:02,742: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:35:02.812227270Z [2024-06-19 00:35:02,811: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-19T00:35:02.815424905Z [2024-06-19 00:35:02,815: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:35:02.843094960Z [2024-06-19 00:35:02,842: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T00:35:02.845027458Z [2024-06-19 00:35:02,844: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:35:02.845596373Z [2024-06-19 00:35:02,845: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:35:02.845855982Z [2024-06-19 00:35:02,845: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:35:02.846243177Z [2024-06-19 00:35:02,846: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-19T00:35:02.846572263Z [2024-06-19 00:35:02,846: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-06-19T00:35:02.846801016Z [2024-06-19 00:35:02,846: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:35:02.928380205Z [2024-06-19 00:35:02,928: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:35:02.991462764Z [2024-06-19 00:35:02,991: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T00:35:02.994952304Z [2024-06-19 00:35:02,994: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:35:03.042584464Z [2024-06-19 00:35:03,042: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T00:35:03.044300231Z [2024-06-19 00:35:03,044: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:35:03.044464720Z [2024-06-19 00:35:03,044: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:35:03.044705784Z [2024-06-19 00:35:03,044: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:35:03.044818077Z [2024-06-19 00:35:03,044: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T00:35:03.045410835Z [2024-06-19 00:35:03,045: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T00:35:03.045537661Z [2024-06-19 00:35:03,045: INFO/ForkPoolWorker-16] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:35:03.162521238Z [2024-06-19 00:35:03,162: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:35:03.467363361Z [2024-06-19 00:35:03,466: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9450e803-4287-477f-bb46-7d3aa7111fc7] succeeded in 2.497580483999627s: None 2024-06-19T00:35:03.515518913Z [2024-06-19 00:35:03,515: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3eb8cefe-3abf-4139-9f1f-c89b7614b2b8] received 2024-06-19T00:35:03.543560464Z [2024-06-19 00:35:03,543: INFO/ForkPoolWorker-15] [3eb8cefe-3abf-4139-9f1f-c89b7614b2b8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'split_metrics', 'scheduled__2024-06-19T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T00:35:03.890184546Z [2024-06-19 00:35:03,885: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T00:35:04.981085847Z [2024-06-19 00:35:04,980: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[889bfef3-b226-46fd-aa77-2988348c3056] succeeded in 4.010229908000838s: None 2024-06-19T00:35:05.046705632Z [2024-06-19 00:35:05,046: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[348baa29-80a0-4c0d-80c5-3ef440939af1] succeeded in 4.023729129999992s: None 2024-06-19T00:35:05.111843105Z [2024-06-19 00:35:05,111: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T00:35:05.114945650Z [2024-06-19 00:35:05,114: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:35:05.140027566Z [2024-06-19 00:35:05,139: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T00:35:05.142159341Z [2024-06-19 00:35:05,141: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:35:05.142175324Z [2024-06-19 00:35:05,142: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:35:05.142492300Z [2024-06-19 00:35:05,142: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:35:05.142503686Z [2024-06-19 00:35:05,142: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T00:35:05.143035663Z [2024-06-19 00:35:05,142: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T00:35:05.143194840Z [2024-06-19 00:35:05,142: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:35:05.261928719Z [2024-06-19 00:35:05,261: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:35:05.993629825Z [2024-06-19 00:35:05,993: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[26eb7710-82d2-4855-ad8b-d2ba36954cec] received 2024-06-19T00:35:06.011034966Z [2024-06-19 00:35:06,010: INFO/ForkPoolWorker-16] [26eb7710-82d2-4855-ad8b-d2ba36954cec] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'collect_metrics', 'scheduled__2024-06-19T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-19T00:35:06.032670740Z [2024-06-19 00:35:06,032: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3eb8cefe-3abf-4139-9f1f-c89b7614b2b8] succeeded in 2.5053148699989833s: None 2024-06-19T00:35:06.384056482Z [2024-06-19 00:35:06,380: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T00:35:07.557964595Z [2024-06-19 00:35:07,557: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T00:35:07.563346801Z [2024-06-19 00:35:07,562: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:35:07.588662738Z [2024-06-19 00:35:07,588: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T00:35:07.597425800Z [2024-06-19 00:35:07,597: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:35:07.597646773Z [2024-06-19 00:35:07,597: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:35:07.597921578Z [2024-06-19 00:35:07,597: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:35:07.598152741Z [2024-06-19 00:35:07,597: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T00:35:07.598634756Z [2024-06-19 00:35:07,598: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T00:35:07.598800042Z [2024-06-19 00:35:07,598: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:35:07.685631466Z [2024-06-19 00:35:07,685: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:35:08.314637716Z [2024-06-19 00:35:08,314: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[26eb7710-82d2-4855-ad8b-d2ba36954cec] succeeded in 2.319138013999691s: None 2024-06-19T00:35:08.436462396Z [2024-06-19 00:35:08,436: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1ef304dd-f426-4ac3-8f75-fee49e004e4a] received 2024-06-19T00:35:08.447826493Z [2024-06-19 00:35:08,447: INFO/ForkPoolWorker-15] [1ef304dd-f426-4ac3-8f75-fee49e004e4a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'send_prometheus', 'scheduled__2024-06-19T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T00:35:08.745811453Z [2024-06-19 00:35:08,741: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T00:35:10.107211334Z [2024-06-19 00:35:10,106: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T00:35:10.112664416Z [2024-06-19 00:35:10,112: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:35:10.141970243Z [2024-06-19 00:35:10,141: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T00:35:10.143386828Z [2024-06-19 00:35:10,143: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:35:10.143402205Z [2024-06-19 00:35:10,143: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:35:10.143609277Z [2024-06-19 00:35:10,143: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:35:10.143617047Z [2024-06-19 00:35:10,143: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T00:35:10.144001683Z [2024-06-19 00:35:10,143: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T00:35:10.144017449Z [2024-06-19 00:35:10,143: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:35:10.249417407Z [2024-06-19 00:35:10,248: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:35:10.925929152Z [2024-06-19 00:35:10,925: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1ef304dd-f426-4ac3-8f75-fee49e004e4a] succeeded in 2.486898201999793s: None 2024-06-19T00:36:00.507791497Z [2024-06-19 00:36:00,507: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b6ac9737-fbea-4229-911c-dbdfd3daf989] received 2024-06-19T00:36:00.508902889Z [2024-06-19 00:36:00,508: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9b3d98cb-5701-4079-8654-ec54cbcb5303] received 2024-06-19T00:36:00.518455860Z [2024-06-19 00:36:00,518: INFO/ForkPoolWorker-16] [9b3d98cb-5701-4079-8654-ec54cbcb5303] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T00:36:00.519034174Z [2024-06-19 00:36:00,518: INFO/ForkPoolWorker-15] [b6ac9737-fbea-4229-911c-dbdfd3daf989] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-19T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-19T00:36:00.527213690Z [2024-06-19 00:36:00,526: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2d5514c5-7765-45cc-b26d-3048f81e15e4] received 2024-06-19T00:36:00.535965922Z [2024-06-19 00:36:00,535: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[93df9760-6f39-47e1-95e4-2a0b3b806dc8] received 2024-06-19T00:36:00.536990711Z [2024-06-19 00:36:00,536: INFO/ForkPoolWorker-1] [2d5514c5-7765-45cc-b26d-3048f81e15e4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T00:36:00.546330798Z [2024-06-19 00:36:00,545: INFO/ForkPoolWorker-2] [93df9760-6f39-47e1-95e4-2a0b3b806dc8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T00:36:00.848588688Z [2024-06-19 00:36:00,845: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-19T00:36:00.854985275Z [2024-06-19 00:36:00,852: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T00:36:00.873244356Z [2024-06-19 00:36:00,870: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T00:36:00.913793861Z [2024-06-19 00:36:00,905: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T00:36:01.081331217Z [2024-06-19 00:36:01,080: INFO/ForkPoolWorker-16] Getting SDNC list 2024-06-19T00:36:01.087642617Z [2024-06-19 00:36:01,087: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:36:01.125116080Z [2024-06-19 00:36:01,124: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:36:01.125130680Z [2024-06-19 00:36:01,124: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T00:36:01.131021573Z [2024-06-19 00:36:01,129: INFO/ForkPoolWorker-16] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T00:36:01.131877819Z [2024-06-19 00:36:01,130: INFO/ForkPoolWorker-16] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T00:36:01.132109163Z [2024-06-19 00:36:01,131: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-06-19T00:36:01.132399131Z [2024-06-19 00:36:01,132: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T00:36:01.246227927Z [2024-06-19 00:36:01,245: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:36:01.701279456Z [2024-06-19 00:36:01,700: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b6ac9737-fbea-4229-911c-dbdfd3daf989] succeeded in 1.1912642839997716s: None 2024-06-19T00:36:01.830252621Z [2024-06-19 00:36:01,829: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9b3d98cb-5701-4079-8654-ec54cbcb5303] succeeded in 1.3198096179985441s: None 2024-06-19T00:36:02.237567227Z [2024-06-19 00:36:02,237: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-19T00:36:02.243809690Z [2024-06-19 00:36:02,240: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:36:02.259627788Z [2024-06-19 00:36:02,250: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T00:36:02.264592593Z [2024-06-19 00:36:02,262: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:36:02.290326576Z [2024-06-19 00:36:02,290: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T00:36:02.291814941Z [2024-06-19 00:36:02,291: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:36:02.291847967Z [2024-06-19 00:36:02,291: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:36:02.291940445Z [2024-06-19 00:36:02,291: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:36:02.291990699Z [2024-06-19 00:36:02,291: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T00:36:02.292212932Z [2024-06-19 00:36:02,292: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T00:36:02.292232448Z [2024-06-19 00:36:02,292: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:36:02.301520643Z [2024-06-19 00:36:02,301: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T00:36:02.307905482Z [2024-06-19 00:36:02,307: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:36:02.307960485Z [2024-06-19 00:36:02,307: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:36:02.308217076Z [2024-06-19 00:36:02,308: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:36:02.308318326Z [2024-06-19 00:36:02,308: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-19T00:36:02.308677144Z [2024-06-19 00:36:02,308: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-06-19T00:36:02.309060050Z [2024-06-19 00:36:02,308: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:36:02.398532604Z [2024-06-19 00:36:02,398: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:36:02.402700667Z [2024-06-19 00:36:02,402: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:36:04.034934329Z [2024-06-19 00:36:04,034: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2d5514c5-7765-45cc-b26d-3048f81e15e4] succeeded in 3.5054505829994014s: None 2024-06-19T00:36:04.513822668Z [2024-06-19 00:36:04,513: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[93df9760-6f39-47e1-95e4-2a0b3b806dc8] succeeded in 3.9740777320002962s: None 2024-06-19T00:37:00.488557181Z [2024-06-19 00:37:00,488: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6ddc6685-0c4c-4a81-9b04-d913670679d1] received 2024-06-19T00:37:00.490922513Z [2024-06-19 00:37:00,490: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5a852b53-e5f4-498c-8283-63ca4ea6c092] received 2024-06-19T00:37:00.501146207Z [2024-06-19 00:37:00,500: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[80d85d1a-925b-415f-804f-1215ed0ba16d] received 2024-06-19T00:37:00.502372860Z [2024-06-19 00:37:00,502: INFO/ForkPoolWorker-15] [6ddc6685-0c4c-4a81-9b04-d913670679d1] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T00:37:00.504315704Z [2024-06-19 00:37:00,503: INFO/ForkPoolWorker-16] [5a852b53-e5f4-498c-8283-63ca4ea6c092] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T00:37:00.519723105Z [2024-06-19 00:37:00,519: INFO/ForkPoolWorker-1] [80d85d1a-925b-415f-804f-1215ed0ba16d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T00:37:00.798336890Z [2024-06-19 00:37:00,793: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T00:37:00.844887703Z [2024-06-19 00:37:00,841: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T00:37:00.878926626Z [2024-06-19 00:37:00,865: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T00:37:01.096671253Z [2024-06-19 00:37:01,096: INFO/ForkPoolWorker-15] Getting SDNC list 2024-06-19T00:37:01.102180493Z [2024-06-19 00:37:01,101: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:37:01.126799806Z [2024-06-19 00:37:01,126: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T00:37:01.128116180Z [2024-06-19 00:37:01,127: INFO/ForkPoolWorker-15] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T00:37:01.128186029Z [2024-06-19 00:37:01,128: INFO/ForkPoolWorker-15] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T00:37:01.128367483Z [2024-06-19 00:37:01,128: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-06-19T00:37:01.128620033Z [2024-06-19 00:37:01,128: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T00:37:01.299956998Z [2024-06-19 00:37:01,299: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:37:01.879616161Z [2024-06-19 00:37:01,879: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6ddc6685-0c4c-4a81-9b04-d913670679d1] succeeded in 1.3886633540005278s: None 2024-06-19T00:37:02.120663952Z [2024-06-19 00:37:02,120: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T00:37:02.136891985Z [2024-06-19 00:37:02,136: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:37:02.181441199Z [2024-06-19 00:37:02,181: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T00:37:02.183245879Z [2024-06-19 00:37:02,183: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:37:02.183987605Z [2024-06-19 00:37:02,183: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:37:02.184122038Z [2024-06-19 00:37:02,183: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:37:02.184190340Z [2024-06-19 00:37:02,184: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T00:37:02.184469977Z [2024-06-19 00:37:02,184: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T00:37:02.184495718Z [2024-06-19 00:37:02,184: INFO/ForkPoolWorker-16] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:37:02.305952419Z [2024-06-19 00:37:02,305: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:37:02.328824303Z [2024-06-19 00:37:02,328: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T00:37:02.336327788Z [2024-06-19 00:37:02,335: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:37:02.358965689Z [2024-06-19 00:37:02,358: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T00:37:02.360994751Z [2024-06-19 00:37:02,360: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:37:02.361049446Z [2024-06-19 00:37:02,360: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:37:02.361148458Z [2024-06-19 00:37:02,360: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:37:02.361197277Z [2024-06-19 00:37:02,361: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T00:37:02.361375211Z [2024-06-19 00:37:02,361: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-06-19T00:37:02.361434027Z [2024-06-19 00:37:02,361: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:37:02.454975534Z [2024-06-19 00:37:02,454: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:37:03.841163959Z [2024-06-19 00:37:03,840: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5a852b53-e5f4-498c-8283-63ca4ea6c092] succeeded in 3.3480509230012103s: None 2024-06-19T00:37:04.306467505Z [2024-06-19 00:37:04,305: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[80d85d1a-925b-415f-804f-1215ed0ba16d] succeeded in 3.795500519001507s: None 2024-06-19T00:38:01.449514268Z [2024-06-19 00:38:01,448: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e760fea6-ca0f-499c-9a62-80950436a473] received 2024-06-19T00:38:01.457134168Z [2024-06-19 00:38:01,456: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1ff3369b-4d9e-4025-b1fb-6971be9d5819] received 2024-06-19T00:38:01.464762616Z [2024-06-19 00:38:01,464: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d4906f78-8de1-42ce-9cd8-c5fea20d3f96] received 2024-06-19T00:38:01.465502930Z [2024-06-19 00:38:01,465: INFO/ForkPoolWorker-15] [e760fea6-ca0f-499c-9a62-80950436a473] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T00:38:01.475552578Z [2024-06-19 00:38:01,475: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ad2d4eca-3cce-4f92-8f46-33c0afb808bd] received 2024-06-19T00:38:01.487881104Z [2024-06-19 00:38:01,483: INFO/ForkPoolWorker-16] [1ff3369b-4d9e-4025-b1fb-6971be9d5819] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T00:38:01.489248742Z [2024-06-19 00:38:01,488: INFO/ForkPoolWorker-1] [d4906f78-8de1-42ce-9cd8-c5fea20d3f96] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-19T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-19T00:38:01.495037217Z [2024-06-19 00:38:01,494: INFO/ForkPoolWorker-2] [ad2d4eca-3cce-4f92-8f46-33c0afb808bd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T00:38:01.817294284Z [2024-06-19 00:38:01,813: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T00:38:01.860123768Z [2024-06-19 00:38:01,856: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T00:38:01.914751903Z [2024-06-19 00:38:01,910: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-19T00:38:01.934695427Z [2024-06-19 00:38:01,930: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T00:38:02.013052912Z [2024-06-19 00:38:02,012: INFO/ForkPoolWorker-15] Getting SDNC list 2024-06-19T00:38:02.016895892Z [2024-06-19 00:38:02,016: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:38:02.037553204Z [2024-06-19 00:38:02,037: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T00:38:02.038543019Z [2024-06-19 00:38:02,038: INFO/ForkPoolWorker-15] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T00:38:02.038559762Z [2024-06-19 00:38:02,038: INFO/ForkPoolWorker-15] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T00:38:02.038633989Z [2024-06-19 00:38:02,038: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-06-19T00:38:02.038802783Z [2024-06-19 00:38:02,038: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T00:38:02.128056539Z [2024-06-19 00:38:02,127: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:38:02.227854312Z [2024-06-19 00:38:02,224: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:38:03.055109050Z [2024-06-19 00:38:03,049: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e760fea6-ca0f-499c-9a62-80950436a473] succeeded in 1.5965324839999084s: None 2024-06-19T00:38:03.104445848Z [2024-06-19 00:38:03,103: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d4906f78-8de1-42ce-9cd8-c5fea20d3f96] succeeded in 1.6311957649995747s: None 2024-06-19T00:38:03.422142437Z [2024-06-19 00:38:03,421: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-19T00:38:03.425780734Z [2024-06-19 00:38:03,425: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:38:03.458732734Z [2024-06-19 00:38:03,458: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T00:38:03.461750262Z [2024-06-19 00:38:03,461: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T00:38:03.462686637Z [2024-06-19 00:38:03,462: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:38:03.462985422Z [2024-06-19 00:38:03,462: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:38:03.463361351Z [2024-06-19 00:38:03,463: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:38:03.463651895Z [2024-06-19 00:38:03,463: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-19T00:38:03.464274310Z [2024-06-19 00:38:03,464: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-06-19T00:38:03.464975249Z [2024-06-19 00:38:03,464: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:38:03.466237555Z [2024-06-19 00:38:03,465: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:38:03.493640854Z [2024-06-19 00:38:03,493: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T00:38:03.495082561Z [2024-06-19 00:38:03,494: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:38:03.495310725Z [2024-06-19 00:38:03,495: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:38:03.495587377Z [2024-06-19 00:38:03,495: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:38:03.495814168Z [2024-06-19 00:38:03,495: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T00:38:03.496278721Z [2024-06-19 00:38:03,496: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T00:38:03.496491237Z [2024-06-19 00:38:03,496: INFO/ForkPoolWorker-16] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:38:03.571498270Z [2024-06-19 00:38:03,571: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:38:03.588407418Z [2024-06-19 00:38:03,588: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:38:05.423317909Z [2024-06-19 00:38:05,422: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1ff3369b-4d9e-4025-b1fb-6971be9d5819] succeeded in 3.9555825959996582s: None 2024-06-19T00:38:05.977512514Z [2024-06-19 00:38:05,977: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[ad2d4eca-3cce-4f92-8f46-33c0afb808bd] succeeded in 4.497822311999698s: None 2024-06-19T00:39:00.570467250Z [2024-06-19 00:39:00,570: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[057ed85c-e1a1-4003-a9c2-435404b62120] received 2024-06-19T00:39:00.589264019Z [2024-06-19 00:39:00,588: INFO/ForkPoolWorker-15] [057ed85c-e1a1-4003-a9c2-435404b62120] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T00:39:00.592143544Z [2024-06-19 00:39:00,591: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8d903915-064d-4d0a-bbd1-c0cf375ebf58] received 2024-06-19T00:39:00.600387537Z [2024-06-19 00:39:00,599: INFO/ForkPoolWorker-16] [8d903915-064d-4d0a-bbd1-c0cf375ebf58] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T00:39:00.614005851Z [2024-06-19 00:39:00,613: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e3714fbc-5e83-4133-be27-70f432b34301] received 2024-06-19T00:39:00.632954124Z [2024-06-19 00:39:00,632: INFO/ForkPoolWorker-1] [e3714fbc-5e83-4133-be27-70f432b34301] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T00:39:00.989385394Z [2024-06-19 00:39:00,984: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T00:39:01.011554244Z [2024-06-19 00:39:01,008: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T00:39:01.126125295Z [2024-06-19 00:39:01,121: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T00:39:01.321066506Z [2024-06-19 00:39:01,320: INFO/ForkPoolWorker-1] Getting SDNC list 2024-06-19T00:39:01.326017191Z [2024-06-19 00:39:01,325: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:39:01.380797185Z [2024-06-19 00:39:01,380: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T00:39:01.386297712Z [2024-06-19 00:39:01,385: INFO/ForkPoolWorker-1] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T00:39:01.386962795Z [2024-06-19 00:39:01,386: INFO/ForkPoolWorker-1] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T00:39:01.387826483Z [2024-06-19 00:39:01,387: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-06-19T00:39:01.388373602Z [2024-06-19 00:39:01,388: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T00:39:01.485008909Z [2024-06-19 00:39:01,484: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:39:02.105073502Z [2024-06-19 00:39:02,104: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e3714fbc-5e83-4133-be27-70f432b34301] succeeded in 1.4855802259990014s: None 2024-06-19T00:39:02.320645058Z [2024-06-19 00:39:02,313: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T00:39:02.324239816Z [2024-06-19 00:39:02,323: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:39:02.376597043Z [2024-06-19 00:39:02,376: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T00:39:02.380902976Z [2024-06-19 00:39:02,380: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:39:02.381009190Z [2024-06-19 00:39:02,380: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:39:02.381188668Z [2024-06-19 00:39:02,381: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:39:02.381290320Z [2024-06-19 00:39:02,381: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T00:39:02.381629203Z [2024-06-19 00:39:02,381: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-19T00:39:02.381786770Z [2024-06-19 00:39:02,381: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:39:02.389603962Z [2024-06-19 00:39:02,389: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T00:39:02.393294876Z [2024-06-19 00:39:02,392: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:39:02.416153147Z [2024-06-19 00:39:02,415: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T00:39:02.417168444Z [2024-06-19 00:39:02,416: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:39:02.417289368Z [2024-06-19 00:39:02,417: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:39:02.417573440Z [2024-06-19 00:39:02,417: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:39:02.417706831Z [2024-06-19 00:39:02,417: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T00:39:02.418029837Z [2024-06-19 00:39:02,417: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T00:39:02.418106011Z [2024-06-19 00:39:02,417: INFO/ForkPoolWorker-15] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:39:02.494717873Z [2024-06-19 00:39:02,494: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:39:02.505728035Z [2024-06-19 00:39:02,505: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:39:04.292437260Z [2024-06-19 00:39:04,291: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[057ed85c-e1a1-4003-a9c2-435404b62120] succeeded in 3.7185389779988327s: None 2024-06-19T00:39:04.746353172Z [2024-06-19 00:39:04,745: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8d903915-064d-4d0a-bbd1-c0cf375ebf58] succeeded in 4.152119289001348s: None 2024-06-19T00:40:01.210014229Z [2024-06-19 00:40:01,209: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[727c5782-03d7-4f58-80e0-4933a7c2cf81] received 2024-06-19T00:40:01.213458663Z [2024-06-19 00:40:01,213: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aa31ed45-d003-41ba-9b6d-190f1ad1e531] received 2024-06-19T00:40:01.222079748Z [2024-06-19 00:40:01,221: INFO/ForkPoolWorker-16] [aa31ed45-d003-41ba-9b6d-190f1ad1e531] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T00:40:01.236388124Z [2024-06-19 00:40:01,236: INFO/ForkPoolWorker-15] [727c5782-03d7-4f58-80e0-4933a7c2cf81] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T00:40:01.236427960Z [2024-06-19 00:40:01,236: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c19ade69-4ebf-425a-bfee-326e93020a07] received 2024-06-19T00:40:01.246186696Z [2024-06-19 00:40:01,245: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7fe0f937-462b-425f-96e1-2582c565a332] received 2024-06-19T00:40:01.266684540Z [2024-06-19 00:40:01,266: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[55a2deae-0ccc-4c11-aaf1-56b2ae0d7ac5] received 2024-06-19T00:40:01.269075101Z [2024-06-19 00:40:01,268: INFO/ForkPoolWorker-1] [c19ade69-4ebf-425a-bfee-326e93020a07] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-19T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T00:40:01.289374022Z [2024-06-19 00:40:01,283: INFO/ForkPoolWorker-2] [7fe0f937-462b-425f-96e1-2582c565a332] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-19T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-19T00:40:01.296645829Z [2024-06-19 00:40:01,296: INFO/ForkPoolWorker-3] [55a2deae-0ccc-4c11-aaf1-56b2ae0d7ac5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T00:40:01.757997676Z [2024-06-19 00:40:01,754: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T00:40:01.774448642Z [2024-06-19 00:40:01,770: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T00:40:01.964081707Z [2024-06-19 00:40:01,959: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-19T00:40:02.114013095Z [2024-06-19 00:40:02,110: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T00:40:02.267852634Z [2024-06-19 00:40:02,263: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T00:40:02.396880250Z [2024-06-19 00:40:02,396: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:40:02.421421676Z [2024-06-19 00:40:02,409: INFO/ForkPoolWorker-15] Getting SDNC list 2024-06-19T00:40:02.430796421Z [2024-06-19 00:40:02,430: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:40:02.519909613Z [2024-06-19 00:40:02,519: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T00:40:02.525113066Z [2024-06-19 00:40:02,524: INFO/ForkPoolWorker-15] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T00:40:02.525268153Z [2024-06-19 00:40:02,525: INFO/ForkPoolWorker-15] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T00:40:02.525331075Z [2024-06-19 00:40:02,525: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-06-19T00:40:02.525619385Z [2024-06-19 00:40:02,525: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T00:40:02.629709302Z [2024-06-19 00:40:02,629: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:40:03.373376057Z [2024-06-19 00:40:03,372: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[727c5782-03d7-4f58-80e0-4933a7c2cf81] succeeded in 2.158692503000566s: None 2024-06-19T00:40:03.377197236Z [2024-06-19 00:40:03,376: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[7fe0f937-462b-425f-96e1-2582c565a332] succeeded in 2.1281964159989s: None 2024-06-19T00:40:03.556433378Z [2024-06-19 00:40:03,556: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T00:40:03.559605010Z [2024-06-19 00:40:03,559: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:40:03.577084008Z [2024-06-19 00:40:03,576: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T00:40:03.578416672Z [2024-06-19 00:40:03,578: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:40:03.578543112Z [2024-06-19 00:40:03,578: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:40:03.578773268Z [2024-06-19 00:40:03,578: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:40:03.578905976Z [2024-06-19 00:40:03,578: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T00:40:03.579288724Z [2024-06-19 00:40:03,579: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-19T00:40:03.579571695Z [2024-06-19 00:40:03,579: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:40:03.651108344Z [2024-06-19 00:40:03,650: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:40:03.944781692Z [2024-06-19 00:40:03,944: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T00:40:03.948118362Z [2024-06-19 00:40:03,947: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:40:03.971432820Z [2024-06-19 00:40:03,971: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T00:40:03.972705392Z [2024-06-19 00:40:03,972: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:40:03.972870792Z [2024-06-19 00:40:03,972: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:40:03.973141807Z [2024-06-19 00:40:03,972: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:40:03.973351473Z [2024-06-19 00:40:03,973: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T00:40:03.973654292Z [2024-06-19 00:40:03,973: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T00:40:03.973820349Z [2024-06-19 00:40:03,973: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:40:04.217069165Z [2024-06-19 00:40:04,216: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:40:04.306827876Z [2024-06-19 00:40:04,306: INFO/ForkPoolWorker-3] Getting VIM list 2024-06-19T00:40:04.310005430Z [2024-06-19 00:40:04,309: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:40:04.339521192Z [2024-06-19 00:40:04,339: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-06-19T00:40:04.341988028Z [2024-06-19 00:40:04,341: INFO/ForkPoolWorker-3] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:40:04.342204884Z [2024-06-19 00:40:04,341: INFO/ForkPoolWorker-3] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:40:04.342488344Z [2024-06-19 00:40:04,342: INFO/ForkPoolWorker-3] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:40:04.342732887Z [2024-06-19 00:40:04,342: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-06-19T00:40:04.343553163Z [2024-06-19 00:40:04,343: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T00:40:04.343789326Z [2024-06-19 00:40:04,343: INFO/ForkPoolWorker-3] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:40:04.616228303Z [2024-06-19 00:40:04,615: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:40:05.038724731Z [2024-06-19 00:40:05,038: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c19ade69-4ebf-425a-bfee-326e93020a07] succeeded in 3.7994926600003964s: None 2024-06-19T00:40:05.129206017Z [2024-06-19 00:40:05,128: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[18cf8756-9773-4c64-aa27-39c5d2acaa85] received 2024-06-19T00:40:05.156354237Z [2024-06-19 00:40:05,156: INFO/ForkPoolWorker-15] [18cf8756-9773-4c64-aa27-39c5d2acaa85] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'split_metrics', 'scheduled__2024-06-19T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T00:40:05.425304144Z [2024-06-19 00:40:05,421: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T00:40:06.209679787Z [2024-06-19 00:40:06,209: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[aa31ed45-d003-41ba-9b6d-190f1ad1e531] succeeded in 4.993959896000888s: None 2024-06-19T00:40:06.465785694Z [2024-06-19 00:40:06,465: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T00:40:06.468867566Z [2024-06-19 00:40:06,468: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:40:06.488854901Z [2024-06-19 00:40:06,488: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[55a2deae-0ccc-4c11-aaf1-56b2ae0d7ac5] succeeded in 5.21816242100067s: None 2024-06-19T00:40:06.493352641Z [2024-06-19 00:40:06,492: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T00:40:06.494699866Z [2024-06-19 00:40:06,494: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:40:06.494709370Z [2024-06-19 00:40:06,494: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:40:06.494957495Z [2024-06-19 00:40:06,494: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:40:06.494993365Z [2024-06-19 00:40:06,494: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T00:40:06.496104428Z [2024-06-19 00:40:06,495: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T00:40:06.496131911Z [2024-06-19 00:40:06,495: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:40:06.584856108Z [2024-06-19 00:40:06,584: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:40:07.349558620Z [2024-06-19 00:40:07,349: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[18cf8756-9773-4c64-aa27-39c5d2acaa85] succeeded in 2.216867937000643s: None 2024-06-19T00:40:07.560994562Z [2024-06-19 00:40:07,560: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c58f6f38-ca3a-4ac1-90c5-bbfd5e7f7e5e] received 2024-06-19T00:40:07.571219056Z [2024-06-19 00:40:07,570: INFO/ForkPoolWorker-15] [c58f6f38-ca3a-4ac1-90c5-bbfd5e7f7e5e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'collect_metrics', 'scheduled__2024-06-19T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-19T00:40:07.844576321Z [2024-06-19 00:40:07,841: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T00:40:08.827181515Z [2024-06-19 00:40:08,826: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T00:40:08.830253385Z [2024-06-19 00:40:08,829: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:40:08.855463385Z [2024-06-19 00:40:08,855: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T00:40:08.857190982Z [2024-06-19 00:40:08,856: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:40:08.857209775Z [2024-06-19 00:40:08,857: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:40:08.857387485Z [2024-06-19 00:40:08,857: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:40:08.857411871Z [2024-06-19 00:40:08,857: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T00:40:08.857744850Z [2024-06-19 00:40:08,857: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T00:40:08.857761113Z [2024-06-19 00:40:08,857: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:40:08.954700616Z [2024-06-19 00:40:08,954: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:40:09.670587709Z [2024-06-19 00:40:09,669: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c58f6f38-ca3a-4ac1-90c5-bbfd5e7f7e5e] succeeded in 2.106454341001154s: None 2024-06-19T00:40:10.223504320Z [2024-06-19 00:40:10,223: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3a54658c-6145-403c-8e00-7c2494777d87] received 2024-06-19T00:40:10.235269740Z [2024-06-19 00:40:10,234: INFO/ForkPoolWorker-15] [3a54658c-6145-403c-8e00-7c2494777d87] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'send_prometheus', 'scheduled__2024-06-19T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T00:40:10.509924227Z [2024-06-19 00:40:10,506: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T00:40:11.526606305Z [2024-06-19 00:40:11,525: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T00:40:11.529523180Z [2024-06-19 00:40:11,529: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:40:11.562525542Z [2024-06-19 00:40:11,562: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T00:40:11.565540618Z [2024-06-19 00:40:11,565: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:40:11.565700382Z [2024-06-19 00:40:11,565: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:40:11.566157025Z [2024-06-19 00:40:11,565: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:40:11.566400418Z [2024-06-19 00:40:11,566: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T00:40:11.567049881Z [2024-06-19 00:40:11,566: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T00:40:11.567208584Z [2024-06-19 00:40:11,567: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:40:11.692305248Z [2024-06-19 00:40:11,691: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:40:12.491330264Z [2024-06-19 00:40:12,490: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3a54658c-6145-403c-8e00-7c2494777d87] succeeded in 2.2662877180009673s: None 2024-06-19T00:41:01.178633790Z [2024-06-19 00:41:01,178: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2940ff0d-9f4a-4e86-922e-129a3db90201] received 2024-06-19T00:41:01.181815632Z [2024-06-19 00:41:01,181: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7886d5a4-df8d-43e0-bf3f-c6ab89198f55] received 2024-06-19T00:41:01.184682152Z [2024-06-19 00:41:01,184: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2e77b388-87d9-4c74-83d4-a92acb569bbb] received 2024-06-19T00:41:01.195465960Z [2024-06-19 00:41:01,195: INFO/ForkPoolWorker-15] [2940ff0d-9f4a-4e86-922e-129a3db90201] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T00:41:01.202489347Z [2024-06-19 00:41:01,201: INFO/ForkPoolWorker-16] [7886d5a4-df8d-43e0-bf3f-c6ab89198f55] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T00:41:01.211799453Z [2024-06-19 00:41:01,211: INFO/ForkPoolWorker-1] [2e77b388-87d9-4c74-83d4-a92acb569bbb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T00:41:01.534521777Z [2024-06-19 00:41:01,531: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T00:41:01.553227162Z [2024-06-19 00:41:01,549: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T00:41:01.589988024Z [2024-06-19 00:41:01,586: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T00:41:01.732708250Z [2024-06-19 00:41:01,732: INFO/ForkPoolWorker-15] Getting SDNC list 2024-06-19T00:41:01.736552759Z [2024-06-19 00:41:01,736: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:41:01.761044490Z [2024-06-19 00:41:01,760: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T00:41:01.762928078Z [2024-06-19 00:41:01,762: INFO/ForkPoolWorker-15] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T00:41:01.763386145Z [2024-06-19 00:41:01,763: INFO/ForkPoolWorker-15] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T00:41:01.763862452Z [2024-06-19 00:41:01,763: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-06-19T00:41:01.764575702Z [2024-06-19 00:41:01,764: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T00:41:01.900789461Z [2024-06-19 00:41:01,900: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:41:02.616694185Z [2024-06-19 00:41:02,616: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2940ff0d-9f4a-4e86-922e-129a3db90201] succeeded in 1.4303091159999894s: None 2024-06-19T00:41:02.729173078Z [2024-06-19 00:41:02,728: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T00:41:02.732276199Z [2024-06-19 00:41:02,731: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:41:02.745557424Z [2024-06-19 00:41:02,745: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T00:41:02.748751927Z [2024-06-19 00:41:02,748: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:41:02.756862636Z [2024-06-19 00:41:02,756: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T00:41:02.758835890Z [2024-06-19 00:41:02,758: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:41:02.759043900Z [2024-06-19 00:41:02,758: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:41:02.759497152Z [2024-06-19 00:41:02,759: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:41:02.759668560Z [2024-06-19 00:41:02,759: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T00:41:02.760124639Z [2024-06-19 00:41:02,759: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-19T00:41:02.760329832Z [2024-06-19 00:41:02,760: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:41:02.768674397Z [2024-06-19 00:41:02,768: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T00:41:02.769946440Z [2024-06-19 00:41:02,769: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:41:02.770067856Z [2024-06-19 00:41:02,769: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:41:02.770264404Z [2024-06-19 00:41:02,770: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:41:02.770433610Z [2024-06-19 00:41:02,770: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T00:41:02.770726310Z [2024-06-19 00:41:02,770: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T00:41:02.770839231Z [2024-06-19 00:41:02,770: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:41:02.844765580Z [2024-06-19 00:41:02,844: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:41:02.854296789Z [2024-06-19 00:41:02,853: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:41:04.396734164Z [2024-06-19 00:41:04,396: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2e77b388-87d9-4c74-83d4-a92acb569bbb] succeeded in 3.2078455080009007s: None 2024-06-19T00:41:04.687911561Z [2024-06-19 00:41:04,686: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7886d5a4-df8d-43e0-bf3f-c6ab89198f55] succeeded in 3.5024459850010317s: None 2024-06-19T00:42:00.505525538Z [2024-06-19 00:42:00,505: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9b7235e9-efba-4281-bdbb-3b3b013b35ae] received 2024-06-19T00:42:00.509391791Z [2024-06-19 00:42:00,509: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0bf4a493-cb1d-415b-8833-3afb273b5340] received 2024-06-19T00:42:00.514860655Z [2024-06-19 00:42:00,514: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4746d2e9-19d1-460c-aadb-ba72a7ef438b] received 2024-06-19T00:42:00.516813213Z [2024-06-19 00:42:00,516: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[802ff870-c9af-4fce-bac5-9c225f3f5da4] received 2024-06-19T00:42:00.527469685Z [2024-06-19 00:42:00,527: INFO/ForkPoolWorker-1] [4746d2e9-19d1-460c-aadb-ba72a7ef438b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T00:42:00.529446597Z [2024-06-19 00:42:00,529: INFO/ForkPoolWorker-2] [802ff870-c9af-4fce-bac5-9c225f3f5da4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T00:42:00.531046273Z [2024-06-19 00:42:00,530: INFO/ForkPoolWorker-15] [9b7235e9-efba-4281-bdbb-3b3b013b35ae] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-19T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-19T00:42:00.531778609Z [2024-06-19 00:42:00,531: INFO/ForkPoolWorker-16] [0bf4a493-cb1d-415b-8833-3afb273b5340] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T00:42:00.843394995Z [2024-06-19 00:42:00,838: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T00:42:00.871706270Z [2024-06-19 00:42:00,868: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T00:42:00.883998585Z [2024-06-19 00:42:00,880: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-19T00:42:00.926785892Z [2024-06-19 00:42:00,922: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T00:42:01.163124969Z [2024-06-19 00:42:01,162: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:42:01.223915601Z [2024-06-19 00:42:01,223: INFO/ForkPoolWorker-16] Getting SDNC list 2024-06-19T00:42:01.228138737Z [2024-06-19 00:42:01,227: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:42:01.261589890Z [2024-06-19 00:42:01,261: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T00:42:01.263353211Z [2024-06-19 00:42:01,263: INFO/ForkPoolWorker-16] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T00:42:01.263665192Z [2024-06-19 00:42:01,263: INFO/ForkPoolWorker-16] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T00:42:01.263940948Z [2024-06-19 00:42:01,263: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-06-19T00:42:01.264393219Z [2024-06-19 00:42:01,264: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T00:42:01.354161728Z [2024-06-19 00:42:01,353: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:42:01.880892742Z [2024-06-19 00:42:01,880: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9b7235e9-efba-4281-bdbb-3b3b013b35ae] succeeded in 1.3693705710011272s: None 2024-06-19T00:42:02.022969472Z [2024-06-19 00:42:02,022: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0bf4a493-cb1d-415b-8833-3afb273b5340] succeeded in 1.5076074400003563s: None 2024-06-19T00:42:02.164155527Z [2024-06-19 00:42:02,163: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-19T00:42:02.167383489Z [2024-06-19 00:42:02,166: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:42:02.188102040Z [2024-06-19 00:42:02,187: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T00:42:02.190267032Z [2024-06-19 00:42:02,189: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:42:02.190280857Z [2024-06-19 00:42:02,190: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:42:02.190334795Z [2024-06-19 00:42:02,190: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:42:02.190345519Z [2024-06-19 00:42:02,190: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-19T00:42:02.190811299Z [2024-06-19 00:42:02,190: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-06-19T00:42:02.190821099Z [2024-06-19 00:42:02,190: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:42:02.364998079Z [2024-06-19 00:42:02,364: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:42:02.509047936Z [2024-06-19 00:42:02,508: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T00:42:02.515858804Z [2024-06-19 00:42:02,515: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:42:02.546029280Z [2024-06-19 00:42:02,545: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T00:42:02.548291935Z [2024-06-19 00:42:02,548: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:42:02.548352503Z [2024-06-19 00:42:02,548: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:42:02.548514175Z [2024-06-19 00:42:02,548: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:42:02.548582988Z [2024-06-19 00:42:02,548: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T00:42:02.548901617Z [2024-06-19 00:42:02,548: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T00:42:02.548979760Z [2024-06-19 00:42:02,548: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:42:02.661201760Z [2024-06-19 00:42:02,660: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:42:04.410860710Z [2024-06-19 00:42:04,410: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4746d2e9-19d1-460c-aadb-ba72a7ef438b] succeeded in 3.8940841530002217s: None 2024-06-19T00:42:04.535834057Z [2024-06-19 00:42:04,535: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[802ff870-c9af-4fce-bac5-9c225f3f5da4] succeeded in 4.016053716000897s: None 2024-06-19T00:43:00.376577842Z [2024-06-19 00:43:00,376: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fa443f07-c416-46da-8fbf-d6bcd9189b9c] received 2024-06-19T00:43:00.386731347Z [2024-06-19 00:43:00,386: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bd1a1b97-48cd-4188-87c0-27662eea1fb7] received 2024-06-19T00:43:00.389538626Z [2024-06-19 00:43:00,389: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a756c00e-e41c-40e2-8238-e7572024c37d] received 2024-06-19T00:43:00.390390735Z [2024-06-19 00:43:00,390: INFO/ForkPoolWorker-15] [fa443f07-c416-46da-8fbf-d6bcd9189b9c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T00:43:00.410249748Z [2024-06-19 00:43:00,409: INFO/ForkPoolWorker-16] [bd1a1b97-48cd-4188-87c0-27662eea1fb7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T00:43:00.420859592Z [2024-06-19 00:43:00,419: INFO/ForkPoolWorker-1] [a756c00e-e41c-40e2-8238-e7572024c37d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T00:43:00.711168206Z [2024-06-19 00:43:00,708: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T00:43:00.716783486Z [2024-06-19 00:43:00,713: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T00:43:00.746518917Z [2024-06-19 00:43:00,741: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T00:43:00.867929535Z [2024-06-19 00:43:00,867: INFO/ForkPoolWorker-15] Getting SDNC list 2024-06-19T00:43:00.871895018Z [2024-06-19 00:43:00,871: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:43:00.892471777Z [2024-06-19 00:43:00,892: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T00:43:00.893375801Z [2024-06-19 00:43:00,893: INFO/ForkPoolWorker-15] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T00:43:00.893505629Z [2024-06-19 00:43:00,893: INFO/ForkPoolWorker-15] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T00:43:00.893603648Z [2024-06-19 00:43:00,893: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-06-19T00:43:00.893806010Z [2024-06-19 00:43:00,893: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T00:43:01.016161535Z [2024-06-19 00:43:01,014: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:43:01.622638081Z [2024-06-19 00:43:01,622: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fa443f07-c416-46da-8fbf-d6bcd9189b9c] succeeded in 1.241482621000614s: None 2024-06-19T00:43:01.979820483Z [2024-06-19 00:43:01,979: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T00:43:01.983044305Z [2024-06-19 00:43:01,982: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:43:02.021659247Z [2024-06-19 00:43:02,021: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T00:43:02.023885538Z [2024-06-19 00:43:02,023: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:43:02.024044598Z [2024-06-19 00:43:02,023: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:43:02.024329568Z [2024-06-19 00:43:02,024: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:43:02.024462619Z [2024-06-19 00:43:02,024: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T00:43:02.024790545Z [2024-06-19 00:43:02,024: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-19T00:43:02.024834274Z [2024-06-19 00:43:02,024: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:43:02.145680957Z [2024-06-19 00:43:02,145: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:43:02.339631475Z [2024-06-19 00:43:02,339: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T00:43:02.347532617Z [2024-06-19 00:43:02,346: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:43:02.393870405Z [2024-06-19 00:43:02,393: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T00:43:02.395530233Z [2024-06-19 00:43:02,395: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:43:02.395545008Z [2024-06-19 00:43:02,395: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:43:02.395638561Z [2024-06-19 00:43:02,395: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:43:02.395669058Z [2024-06-19 00:43:02,395: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T00:43:02.396064956Z [2024-06-19 00:43:02,395: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T00:43:02.396099377Z [2024-06-19 00:43:02,396: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:43:02.513601959Z [2024-06-19 00:43:02,513: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:43:04.017249417Z [2024-06-19 00:43:04,016: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a756c00e-e41c-40e2-8238-e7572024c37d] succeeded in 3.61594055400019s: None 2024-06-19T00:43:04.036149879Z [2024-06-19 00:43:04,035: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[bd1a1b97-48cd-4188-87c0-27662eea1fb7] succeeded in 3.6473073300003307s: None 2024-06-19T00:44:00.345211399Z [2024-06-19 00:44:00,344: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2af1567b-58a3-41d2-b5fe-9c90cc9134a4] received 2024-06-19T00:44:00.348597717Z [2024-06-19 00:44:00,348: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[636a9327-2a39-4c8e-b49a-01c3cdeae528] received 2024-06-19T00:44:00.352059880Z [2024-06-19 00:44:00,351: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c2c8ee5d-fdcc-4520-8822-b154109167ee] received 2024-06-19T00:44:00.362180327Z [2024-06-19 00:44:00,361: INFO/ForkPoolWorker-1] [c2c8ee5d-fdcc-4520-8822-b154109167ee] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-19T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-19T00:44:00.362713326Z [2024-06-19 00:44:00,362: INFO/ForkPoolWorker-15] [2af1567b-58a3-41d2-b5fe-9c90cc9134a4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T00:44:00.362944073Z [2024-06-19 00:44:00,362: INFO/ForkPoolWorker-16] [636a9327-2a39-4c8e-b49a-01c3cdeae528] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T00:44:00.371403058Z [2024-06-19 00:44:00,371: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[32a182e2-ee5c-40ca-8816-73d9dfd6ce33] received 2024-06-19T00:44:00.405824708Z [2024-06-19 00:44:00,405: INFO/ForkPoolWorker-2] [32a182e2-ee5c-40ca-8816-73d9dfd6ce33] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T00:44:00.686211806Z [2024-06-19 00:44:00,681: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T00:44:00.737629160Z [2024-06-19 00:44:00,733: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T00:44:00.822772811Z [2024-06-19 00:44:00,818: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T00:44:00.906443445Z [2024-06-19 00:44:00,906: INFO/ForkPoolWorker-16] Getting SDNC list 2024-06-19T00:44:00.910067653Z [2024-06-19 00:44:00,909: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:44:00.953171268Z [2024-06-19 00:44:00,952: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T00:44:00.956429715Z [2024-06-19 00:44:00,956: INFO/ForkPoolWorker-16] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T00:44:00.956513059Z [2024-06-19 00:44:00,956: INFO/ForkPoolWorker-16] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T00:44:00.956597492Z [2024-06-19 00:44:00,956: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-06-19T00:44:00.957033608Z [2024-06-19 00:44:00,953: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-19T00:44:00.957071552Z [2024-06-19 00:44:00,956: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T00:44:01.074359168Z [2024-06-19 00:44:01,074: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:44:01.389220449Z [2024-06-19 00:44:01,388: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:44:01.824693160Z [2024-06-19 00:44:01,824: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[636a9327-2a39-4c8e-b49a-01c3cdeae528] succeeded in 1.4711084249993291s: None 2024-06-19T00:44:02.081346602Z [2024-06-19 00:44:02,080: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c2c8ee5d-fdcc-4520-8822-b154109167ee] succeeded in 1.7249311630002921s: None 2024-06-19T00:44:02.305328598Z [2024-06-19 00:44:02,305: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-19T00:44:02.308456340Z [2024-06-19 00:44:02,308: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:44:02.323038543Z [2024-06-19 00:44:02,322: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T00:44:02.324389714Z [2024-06-19 00:44:02,324: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:44:02.324456805Z [2024-06-19 00:44:02,324: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:44:02.324631982Z [2024-06-19 00:44:02,324: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:44:02.324687833Z [2024-06-19 00:44:02,324: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-19T00:44:02.324921815Z [2024-06-19 00:44:02,324: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T00:44:02.324978223Z [2024-06-19 00:44:02,324: INFO/ForkPoolWorker-2] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:44:02.389623304Z [2024-06-19 00:44:02,388: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T00:44:02.393611225Z [2024-06-19 00:44:02,393: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:44:02.401707473Z [2024-06-19 00:44:02,401: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:44:02.426546538Z [2024-06-19 00:44:02,426: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T00:44:02.429749694Z [2024-06-19 00:44:02,428: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:44:02.430284923Z [2024-06-19 00:44:02,430: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:44:02.430593386Z [2024-06-19 00:44:02,430: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:44:02.430736093Z [2024-06-19 00:44:02,430: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T00:44:02.431088395Z [2024-06-19 00:44:02,430: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-06-19T00:44:02.432185784Z [2024-06-19 00:44:02,431: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:44:02.532812343Z [2024-06-19 00:44:02,532: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:44:03.872217730Z [2024-06-19 00:44:03,871: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[32a182e2-ee5c-40ca-8816-73d9dfd6ce33] succeeded in 3.4891728250004235s: None 2024-06-19T00:44:04.586594928Z [2024-06-19 00:44:04,585: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2af1567b-58a3-41d2-b5fe-9c90cc9134a4] succeeded in 4.237096328000916s: None 2024-06-19T00:45:00.233013173Z [2024-06-19 00:45:00,232: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e5ddd06a-6ba1-4034-8454-f35a360afc6e] received 2024-06-19T00:45:00.238063858Z [2024-06-19 00:45:00,237: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1555dcfd-eadf-4bc8-9e6f-4e265db750bc] received 2024-06-19T00:45:00.246042424Z [2024-06-19 00:45:00,245: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a4737754-839d-43df-92da-dfbf298233a6] received 2024-06-19T00:45:00.249683497Z [2024-06-19 00:45:00,249: INFO/ForkPoolWorker-15] [e5ddd06a-6ba1-4034-8454-f35a360afc6e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-19T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T00:45:00.252171447Z [2024-06-19 00:45:00,251: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[34e74122-c4a2-4c55-8c27-6e6695c25ed1] received 2024-06-19T00:45:00.263417784Z [2024-06-19 00:45:00,263: INFO/ForkPoolWorker-16] [1555dcfd-eadf-4bc8-9e6f-4e265db750bc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T00:45:00.267124871Z [2024-06-19 00:45:00,266: INFO/ForkPoolWorker-2] [34e74122-c4a2-4c55-8c27-6e6695c25ed1] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T00:45:00.270729940Z [2024-06-19 00:45:00,270: INFO/ForkPoolWorker-1] [a4737754-839d-43df-92da-dfbf298233a6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T00:45:00.565249281Z [2024-06-19 00:45:00,560: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T00:45:00.565927785Z [2024-06-19 00:45:00,562: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T00:45:00.681442464Z [2024-06-19 00:45:00,678: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T00:45:00.686652305Z [2024-06-19 00:45:00,683: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T00:45:00.773835499Z [2024-06-19 00:45:00,773: INFO/ForkPoolWorker-2] Getting SDNC list 2024-06-19T00:45:00.777751160Z [2024-06-19 00:45:00,777: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:45:00.803678899Z [2024-06-19 00:45:00,803: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T00:45:00.813740662Z [2024-06-19 00:45:00,813: INFO/ForkPoolWorker-2] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T00:45:00.814289288Z [2024-06-19 00:45:00,814: INFO/ForkPoolWorker-2] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T00:45:00.814618273Z [2024-06-19 00:45:00,814: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-06-19T00:45:00.815033059Z [2024-06-19 00:45:00,814: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T00:45:00.930638744Z [2024-06-19 00:45:00,930: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:45:01.524800163Z [2024-06-19 00:45:01,524: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[34e74122-c4a2-4c55-8c27-6e6695c25ed1] succeeded in 1.270477836000282s: None 2024-06-19T00:45:01.851639791Z [2024-06-19 00:45:01,851: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T00:45:01.854631528Z [2024-06-19 00:45:01,854: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:45:01.874114867Z [2024-06-19 00:45:01,873: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T00:45:01.875455576Z [2024-06-19 00:45:01,875: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:45:01.875645260Z [2024-06-19 00:45:01,875: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:45:01.875917231Z [2024-06-19 00:45:01,875: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:45:01.876045384Z [2024-06-19 00:45:01,875: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T00:45:01.876337973Z [2024-06-19 00:45:01,876: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-19T00:45:01.876488226Z [2024-06-19 00:45:01,876: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:45:01.959233485Z [2024-06-19 00:45:01,958: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T00:45:01.962396617Z [2024-06-19 00:45:01,961: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:45:01.967276556Z [2024-06-19 00:45:01,967: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:45:02.005926903Z [2024-06-19 00:45:02,005: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T00:45:02.008233331Z [2024-06-19 00:45:02,007: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T00:45:02.008841195Z [2024-06-19 00:45:02,008: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:45:02.010427026Z [2024-06-19 00:45:02,008: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:45:02.010614273Z [2024-06-19 00:45:02,010: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:45:02.010729553Z [2024-06-19 00:45:02,010: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T00:45:02.011130388Z [2024-06-19 00:45:02,010: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T00:45:02.011140647Z [2024-06-19 00:45:02,011: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:45:02.027173248Z [2024-06-19 00:45:02,026: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:45:02.063059253Z [2024-06-19 00:45:02,062: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T00:45:02.072070017Z [2024-06-19 00:45:02,071: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:45:02.072089718Z [2024-06-19 00:45:02,071: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:45:02.072284518Z [2024-06-19 00:45:02,071: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:45:02.072447521Z [2024-06-19 00:45:02,072: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T00:45:02.072737403Z [2024-06-19 00:45:02,072: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T00:45:02.072933998Z [2024-06-19 00:45:02,072: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:45:02.143344509Z [2024-06-19 00:45:02,143: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:45:02.153193412Z [2024-06-19 00:45:02,152: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:45:02.827225051Z [2024-06-19 00:45:02,826: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e5ddd06a-6ba1-4034-8454-f35a360afc6e] succeeded in 2.591498166000747s: None 2024-06-19T00:45:02.858719211Z [2024-06-19 00:45:02,858: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8a48dcd6-c108-4c3a-9407-3c7769f85882] received 2024-06-19T00:45:02.867379542Z [2024-06-19 00:45:02,866: INFO/ForkPoolWorker-15] [8a48dcd6-c108-4c3a-9407-3c7769f85882] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'split_metrics', 'scheduled__2024-06-19T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T00:45:03.171739330Z [2024-06-19 00:45:03,168: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T00:45:03.708946093Z [2024-06-19 00:45:03,708: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a4737754-839d-43df-92da-dfbf298233a6] succeeded in 3.4523829040008422s: None 2024-06-19T00:45:04.084122485Z [2024-06-19 00:45:04,083: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1555dcfd-eadf-4bc8-9e6f-4e265db750bc] succeeded in 3.843112882999776s: None 2024-06-19T00:45:04.388349571Z [2024-06-19 00:45:04,387: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T00:45:04.391613663Z [2024-06-19 00:45:04,391: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:45:04.413270222Z [2024-06-19 00:45:04,413: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T00:45:04.417077240Z [2024-06-19 00:45:04,416: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:45:04.417091557Z [2024-06-19 00:45:04,416: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:45:04.417303101Z [2024-06-19 00:45:04,416: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:45:04.417502272Z [2024-06-19 00:45:04,417: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T00:45:04.417962781Z [2024-06-19 00:45:04,417: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T00:45:04.417973673Z [2024-06-19 00:45:04,417: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:45:04.514368873Z [2024-06-19 00:45:04,514: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:45:05.162538434Z [2024-06-19 00:45:05,161: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8a48dcd6-c108-4c3a-9407-3c7769f85882] succeeded in 2.301598827998532s: None 2024-06-19T00:45:05.666660231Z [2024-06-19 00:45:05,666: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[244421fb-09f6-42e4-b3e7-1055838b29fa] received 2024-06-19T00:45:05.673489465Z [2024-06-19 00:45:05,673: INFO/ForkPoolWorker-15] [244421fb-09f6-42e4-b3e7-1055838b29fa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'collect_metrics', 'scheduled__2024-06-19T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-19T00:45:05.988015161Z [2024-06-19 00:45:05,984: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T00:45:07.044183815Z [2024-06-19 00:45:07,043: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T00:45:07.049534959Z [2024-06-19 00:45:07,048: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:45:07.082977959Z [2024-06-19 00:45:07,082: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T00:45:07.084507117Z [2024-06-19 00:45:07,084: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:45:07.084535424Z [2024-06-19 00:45:07,084: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:45:07.084727582Z [2024-06-19 00:45:07,084: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:45:07.084797510Z [2024-06-19 00:45:07,084: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T00:45:07.085182969Z [2024-06-19 00:45:07,084: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T00:45:07.085322582Z [2024-06-19 00:45:07,085: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:45:07.198218772Z [2024-06-19 00:45:07,197: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:45:07.830520826Z [2024-06-19 00:45:07,829: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[244421fb-09f6-42e4-b3e7-1055838b29fa] succeeded in 2.161747648999153s: None 2024-06-19T00:45:07.980178481Z [2024-06-19 00:45:07,979: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c4dc5449-2692-4bbe-8caa-d8cfc47b03f2] received 2024-06-19T00:45:07.990765698Z [2024-06-19 00:45:07,990: INFO/ForkPoolWorker-15] [c4dc5449-2692-4bbe-8caa-d8cfc47b03f2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'send_prometheus', 'scheduled__2024-06-19T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T00:45:08.244613723Z [2024-06-19 00:45:08,241: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T00:45:09.253936913Z [2024-06-19 00:45:09,253: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T00:45:09.257070653Z [2024-06-19 00:45:09,256: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:45:09.274999005Z [2024-06-19 00:45:09,274: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T00:45:09.276436720Z [2024-06-19 00:45:09,276: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:45:09.276451581Z [2024-06-19 00:45:09,276: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:45:09.276680478Z [2024-06-19 00:45:09,276: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:45:09.276761852Z [2024-06-19 00:45:09,276: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T00:45:09.277059335Z [2024-06-19 00:45:09,276: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T00:45:09.277173683Z [2024-06-19 00:45:09,276: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:45:09.355543034Z [2024-06-19 00:45:09,355: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:45:09.997050213Z [2024-06-19 00:45:09,996: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c4dc5449-2692-4bbe-8caa-d8cfc47b03f2] succeeded in 2.0138826290003635s: None 2024-06-19T00:46:01.246659648Z [2024-06-19 00:46:01,246: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[911c2e57-c907-4837-a010-4d85e5540c75] received 2024-06-19T00:46:01.249781177Z [2024-06-19 00:46:01,249: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1ecff408-3ae9-424f-ad3b-ed5331316907] received 2024-06-19T00:46:01.258336288Z [2024-06-19 00:46:01,256: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[26ed7de4-53ac-47ca-9780-aded6694e56c] received 2024-06-19T00:46:01.259554336Z [2024-06-19 00:46:01,259: INFO/ForkPoolWorker-15] [911c2e57-c907-4837-a010-4d85e5540c75] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-19T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-19T00:46:01.264139115Z [2024-06-19 00:46:01,263: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ef6f392b-7914-4656-a7a8-32545c6cb7cb] received 2024-06-19T00:46:01.265284432Z [2024-06-19 00:46:01,264: INFO/ForkPoolWorker-16] [1ecff408-3ae9-424f-ad3b-ed5331316907] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T00:46:01.274298364Z [2024-06-19 00:46:01,273: INFO/ForkPoolWorker-1] [26ed7de4-53ac-47ca-9780-aded6694e56c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T00:46:01.287974349Z [2024-06-19 00:46:01,284: INFO/ForkPoolWorker-2] [ef6f392b-7914-4656-a7a8-32545c6cb7cb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T00:46:01.570691752Z [2024-06-19 00:46:01,567: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-19T00:46:01.613703331Z [2024-06-19 00:46:01,610: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T00:46:01.675964715Z [2024-06-19 00:46:01,672: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T00:46:01.720774767Z [2024-06-19 00:46:01,714: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T00:46:01.785276636Z [2024-06-19 00:46:01,779: INFO/ForkPoolWorker-1] Getting SDNC list 2024-06-19T00:46:01.792095776Z [2024-06-19 00:46:01,791: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:46:01.819661305Z [2024-06-19 00:46:01,819: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T00:46:01.824388706Z [2024-06-19 00:46:01,824: INFO/ForkPoolWorker-1] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T00:46:01.824708153Z [2024-06-19 00:46:01,824: INFO/ForkPoolWorker-1] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T00:46:01.824800386Z [2024-06-19 00:46:01,824: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-06-19T00:46:01.825030818Z [2024-06-19 00:46:01,824: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T00:46:01.833053359Z [2024-06-19 00:46:01,832: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:46:01.945036842Z [2024-06-19 00:46:01,944: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:46:02.521508571Z [2024-06-19 00:46:02,521: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[911c2e57-c907-4837-a010-4d85e5540c75] succeeded in 1.2721891350010992s: None 2024-06-19T00:46:02.631594092Z [2024-06-19 00:46:02,631: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[26ed7de4-53ac-47ca-9780-aded6694e56c] succeeded in 1.3639919310007826s: None 2024-06-19T00:46:02.984615975Z [2024-06-19 00:46:02,984: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T00:46:02.989337109Z [2024-06-19 00:46:02,988: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:46:03.019827956Z [2024-06-19 00:46:03,019: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-19T00:46:03.023353544Z [2024-06-19 00:46:03,023: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T00:46:03.023885071Z [2024-06-19 00:46:03,023: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:46:03.028718601Z [2024-06-19 00:46:03,028: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:46:03.028980810Z [2024-06-19 00:46:03,028: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:46:03.029246131Z [2024-06-19 00:46:03,029: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:46:03.029432115Z [2024-06-19 00:46:03,029: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T00:46:03.029815547Z [2024-06-19 00:46:03,029: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T00:46:03.030025206Z [2024-06-19 00:46:03,029: INFO/ForkPoolWorker-16] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:46:03.043139474Z [2024-06-19 00:46:03,042: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T00:46:03.045454709Z [2024-06-19 00:46:03,045: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:46:03.045467081Z [2024-06-19 00:46:03,045: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:46:03.045554335Z [2024-06-19 00:46:03,045: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:46:03.045600181Z [2024-06-19 00:46:03,045: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-19T00:46:03.045791434Z [2024-06-19 00:46:03,045: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-06-19T00:46:03.045861191Z [2024-06-19 00:46:03,045: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:46:03.122201702Z [2024-06-19 00:46:03,121: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:46:03.134453961Z [2024-06-19 00:46:03,133: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:46:04.731262610Z [2024-06-19 00:46:04,730: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1ecff408-3ae9-424f-ad3b-ed5331316907] succeeded in 3.4755576840016147s: None 2024-06-19T00:46:05.204353583Z [2024-06-19 00:46:05,203: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[ef6f392b-7914-4656-a7a8-32545c6cb7cb] succeeded in 3.9359308129987767s: None 2024-06-19T00:47:00.846336603Z [2024-06-19 00:47:00,845: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[076c03ee-a810-4967-86c2-04bc8ec1596a] received 2024-06-19T00:47:00.848390226Z [2024-06-19 00:47:00,848: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[67daf62e-f0ce-40d6-adc1-cfe8ac4e86ee] received 2024-06-19T00:47:00.851139358Z [2024-06-19 00:47:00,850: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[00064615-45d8-447e-b7f7-db3a50e818ee] received 2024-06-19T00:47:00.858029362Z [2024-06-19 00:47:00,857: INFO/ForkPoolWorker-15] [076c03ee-a810-4967-86c2-04bc8ec1596a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T00:47:00.866522483Z [2024-06-19 00:47:00,865: INFO/ForkPoolWorker-16] [67daf62e-f0ce-40d6-adc1-cfe8ac4e86ee] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T00:47:00.866549257Z [2024-06-19 00:47:00,866: INFO/ForkPoolWorker-1] [00064615-45d8-447e-b7f7-db3a50e818ee] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T00:47:01.125190886Z [2024-06-19 00:47:01,121: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T00:47:01.142851744Z [2024-06-19 00:47:01,139: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T00:47:01.221313479Z [2024-06-19 00:47:01,217: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T00:47:01.424780335Z [2024-06-19 00:47:01,424: INFO/ForkPoolWorker-1] Getting SDNC list 2024-06-19T00:47:01.428925972Z [2024-06-19 00:47:01,428: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:47:01.461029808Z [2024-06-19 00:47:01,460: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T00:47:01.462346268Z [2024-06-19 00:47:01,462: INFO/ForkPoolWorker-1] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T00:47:01.462534027Z [2024-06-19 00:47:01,462: INFO/ForkPoolWorker-1] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T00:47:01.462671939Z [2024-06-19 00:47:01,462: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-06-19T00:47:01.462952404Z [2024-06-19 00:47:01,462: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T00:47:01.580449638Z [2024-06-19 00:47:01,580: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:47:02.205188638Z [2024-06-19 00:47:02,204: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[00064615-45d8-447e-b7f7-db3a50e818ee] succeeded in 1.3462387480012694s: None 2024-06-19T00:47:02.413539003Z [2024-06-19 00:47:02,413: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T00:47:02.416681125Z [2024-06-19 00:47:02,416: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:47:02.435450790Z [2024-06-19 00:47:02,435: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T00:47:02.436787340Z [2024-06-19 00:47:02,436: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:47:02.436800578Z [2024-06-19 00:47:02,436: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:47:02.437024468Z [2024-06-19 00:47:02,436: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:47:02.437032594Z [2024-06-19 00:47:02,436: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T00:47:02.437344975Z [2024-06-19 00:47:02,437: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-06-19T00:47:02.437501545Z [2024-06-19 00:47:02,437: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:47:02.448070996Z [2024-06-19 00:47:02,447: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T00:47:02.451743194Z [2024-06-19 00:47:02,451: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:47:02.471317914Z [2024-06-19 00:47:02,471: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T00:47:02.472571564Z [2024-06-19 00:47:02,472: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:47:02.472584842Z [2024-06-19 00:47:02,472: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:47:02.472782225Z [2024-06-19 00:47:02,472: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:47:02.472794523Z [2024-06-19 00:47:02,472: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T00:47:02.472992375Z [2024-06-19 00:47:02,472: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T00:47:02.473007161Z [2024-06-19 00:47:02,472: INFO/ForkPoolWorker-16] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:47:02.530226330Z [2024-06-19 00:47:02,529: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:47:02.588014787Z [2024-06-19 00:47:02,587: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:47:04.698899616Z [2024-06-19 00:47:04,698: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[67daf62e-f0ce-40d6-adc1-cfe8ac4e86ee] succeeded in 3.8456313089991454s: None 2024-06-19T00:47:05.049573155Z [2024-06-19 00:47:05,049: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[076c03ee-a810-4967-86c2-04bc8ec1596a] succeeded in 4.201296958000967s: None 2024-06-19T00:48:01.127330876Z [2024-06-19 00:48:01,127: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cfcbf543-27d6-41cb-940d-f225d149cd51] received 2024-06-19T00:48:01.134244695Z [2024-06-19 00:48:01,134: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3ba42aca-256b-46b0-8f11-07dfced931f2] received 2024-06-19T00:48:01.139794109Z [2024-06-19 00:48:01,139: INFO/ForkPoolWorker-15] [cfcbf543-27d6-41cb-940d-f225d149cd51] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-19T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-19T00:48:01.157461892Z [2024-06-19 00:48:01,157: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[998d03a7-983c-4725-9f09-f14010d9dc09] received 2024-06-19T00:48:01.160872076Z [2024-06-19 00:48:01,160: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b7c92bda-3424-4c80-9252-5cb517f95c88] received 2024-06-19T00:48:01.162067193Z [2024-06-19 00:48:01,161: INFO/ForkPoolWorker-16] [3ba42aca-256b-46b0-8f11-07dfced931f2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T00:48:01.203217233Z [2024-06-19 00:48:01,202: INFO/ForkPoolWorker-1] [998d03a7-983c-4725-9f09-f14010d9dc09] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T00:48:01.204001666Z [2024-06-19 00:48:01,203: INFO/ForkPoolWorker-2] [b7c92bda-3424-4c80-9252-5cb517f95c88] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T00:48:01.503517538Z [2024-06-19 00:48:01,500: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T00:48:01.640419566Z [2024-06-19 00:48:01,637: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T00:48:01.654492390Z [2024-06-19 00:48:01,651: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-19T00:48:01.680123074Z [2024-06-19 00:48:01,676: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T00:48:01.884212062Z [2024-06-19 00:48:01,883: INFO/ForkPoolWorker-16] Getting SDNC list 2024-06-19T00:48:01.886027442Z [2024-06-19 00:48:01,885: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:48:01.895137170Z [2024-06-19 00:48:01,894: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:48:01.944708663Z [2024-06-19 00:48:01,944: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T00:48:01.949213443Z [2024-06-19 00:48:01,948: INFO/ForkPoolWorker-16] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T00:48:01.949282497Z [2024-06-19 00:48:01,949: INFO/ForkPoolWorker-16] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T00:48:01.949337921Z [2024-06-19 00:48:01,949: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-06-19T00:48:01.955090282Z [2024-06-19 00:48:01,954: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T00:48:02.146861135Z [2024-06-19 00:48:02,146: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:48:02.572023818Z [2024-06-19 00:48:02,571: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cfcbf543-27d6-41cb-940d-f225d149cd51] succeeded in 1.442390856998827s: None 2024-06-19T00:48:02.785223385Z [2024-06-19 00:48:02,784: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-19T00:48:02.788552273Z [2024-06-19 00:48:02,788: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:48:02.804547563Z [2024-06-19 00:48:02,804: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T00:48:02.806023122Z [2024-06-19 00:48:02,805: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:48:02.806178646Z [2024-06-19 00:48:02,805: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:48:02.806378940Z [2024-06-19 00:48:02,806: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:48:02.806611068Z [2024-06-19 00:48:02,806: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-19T00:48:02.806978174Z [2024-06-19 00:48:02,806: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T00:48:02.807137230Z [2024-06-19 00:48:02,807: INFO/ForkPoolWorker-2] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:48:02.823785791Z [2024-06-19 00:48:02,823: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3ba42aca-256b-46b0-8f11-07dfced931f2] succeeded in 1.6755347569996957s: None 2024-06-19T00:48:02.922342979Z [2024-06-19 00:48:02,921: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:48:02.922805342Z [2024-06-19 00:48:02,922: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T00:48:02.926483296Z [2024-06-19 00:48:02,926: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:48:02.947069750Z [2024-06-19 00:48:02,946: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T00:48:02.948456605Z [2024-06-19 00:48:02,947: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:48:02.948472994Z [2024-06-19 00:48:02,947: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:48:02.948476938Z [2024-06-19 00:48:02,947: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:48:02.948480622Z [2024-06-19 00:48:02,947: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T00:48:02.948483752Z [2024-06-19 00:48:02,947: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-06-19T00:48:02.948486896Z [2024-06-19 00:48:02,948: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:48:03.059775700Z [2024-06-19 00:48:03,059: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:48:04.385036905Z [2024-06-19 00:48:04,384: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b7c92bda-3424-4c80-9252-5cb517f95c88] succeeded in 3.2208792500005075s: None 2024-06-19T00:48:05.060204218Z [2024-06-19 00:48:05,059: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[998d03a7-983c-4725-9f09-f14010d9dc09] succeeded in 3.899494068000422s: None 2024-06-19T00:49:00.425732148Z [2024-06-19 00:49:00,425: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8b2e7ece-2ea4-4a99-86c0-e69dc8f49cc5] received 2024-06-19T00:49:00.436606530Z [2024-06-19 00:49:00,436: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[65b57bf0-9a8e-4e46-9e64-1ddb35e4c6e1] received 2024-06-19T00:49:00.441552558Z [2024-06-19 00:49:00,441: INFO/ForkPoolWorker-15] [8b2e7ece-2ea4-4a99-86c0-e69dc8f49cc5] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T00:49:00.452320899Z [2024-06-19 00:49:00,452: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[256f1459-d3c4-485b-b4bb-1065f5111181] received 2024-06-19T00:49:00.452342364Z [2024-06-19 00:49:00,452: INFO/ForkPoolWorker-16] [65b57bf0-9a8e-4e46-9e64-1ddb35e4c6e1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T00:49:00.468085613Z [2024-06-19 00:49:00,467: INFO/ForkPoolWorker-1] [256f1459-d3c4-485b-b4bb-1065f5111181] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T00:49:00.776151471Z [2024-06-19 00:49:00,772: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T00:49:00.863745168Z [2024-06-19 00:49:00,860: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T00:49:00.944372575Z [2024-06-19 00:49:00,943: INFO/ForkPoolWorker-15] Getting SDNC list 2024-06-19T00:49:00.948885611Z [2024-06-19 00:49:00,948: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:49:00.979573254Z [2024-06-19 00:49:00,979: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T00:49:00.981151071Z [2024-06-19 00:49:00,980: INFO/ForkPoolWorker-15] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T00:49:00.981432033Z [2024-06-19 00:49:00,981: INFO/ForkPoolWorker-15] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T00:49:00.981587905Z [2024-06-19 00:49:00,981: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-06-19T00:49:00.981926343Z [2024-06-19 00:49:00,981: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T00:49:01.002242143Z [2024-06-19 00:49:00,998: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T00:49:01.124489975Z [2024-06-19 00:49:01,124: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:49:01.768582891Z [2024-06-19 00:49:01,768: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8b2e7ece-2ea4-4a99-86c0-e69dc8f49cc5] succeeded in 1.3371628419990884s: None 2024-06-19T00:49:02.117936169Z [2024-06-19 00:49:02,117: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T00:49:02.123948169Z [2024-06-19 00:49:02,120: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:49:02.154712060Z [2024-06-19 00:49:02,154: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T00:49:02.156550913Z [2024-06-19 00:49:02,156: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:49:02.156723628Z [2024-06-19 00:49:02,156: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:49:02.156988513Z [2024-06-19 00:49:02,156: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:49:02.157140598Z [2024-06-19 00:49:02,156: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T00:49:02.157522584Z [2024-06-19 00:49:02,157: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T00:49:02.157673213Z [2024-06-19 00:49:02,157: INFO/ForkPoolWorker-16] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:49:02.257123795Z [2024-06-19 00:49:02,256: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:49:02.448105676Z [2024-06-19 00:49:02,447: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T00:49:02.451556345Z [2024-06-19 00:49:02,451: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:49:02.481168432Z [2024-06-19 00:49:02,480: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T00:49:02.482475580Z [2024-06-19 00:49:02,482: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:49:02.482605285Z [2024-06-19 00:49:02,482: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:49:02.482793089Z [2024-06-19 00:49:02,482: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:49:02.482911022Z [2024-06-19 00:49:02,482: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T00:49:02.483262143Z [2024-06-19 00:49:02,483: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-06-19T00:49:02.483395509Z [2024-06-19 00:49:02,483: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:49:02.564057882Z [2024-06-19 00:49:02,563: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:49:03.851528463Z [2024-06-19 00:49:03,850: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[65b57bf0-9a8e-4e46-9e64-1ddb35e4c6e1] succeeded in 3.4119198589996813s: None 2024-06-19T00:49:04.666804062Z [2024-06-19 00:49:04,666: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[256f1459-d3c4-485b-b4bb-1065f5111181] succeeded in 4.21186805599973s: None 2024-06-19T00:50:01.271507087Z [2024-06-19 00:50:01,271: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a3bd8f38-93f2-4b26-94c1-a0ba300dc3d0] received 2024-06-19T00:50:01.273934550Z [2024-06-19 00:50:01,273: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b1b3e9f6-fdc6-4f94-bf89-bbdf3a85ac02] received 2024-06-19T00:50:01.280638532Z [2024-06-19 00:50:01,280: INFO/ForkPoolWorker-15] [a3bd8f38-93f2-4b26-94c1-a0ba300dc3d0] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T00:50:01.286249799Z [2024-06-19 00:50:01,285: INFO/ForkPoolWorker-16] [b1b3e9f6-fdc6-4f94-bf89-bbdf3a85ac02] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T00:50:01.287901910Z [2024-06-19 00:50:01,285: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[74b15c9a-772a-415e-bd2b-8e1e34016f24] received 2024-06-19T00:50:01.293849133Z [2024-06-19 00:50:01,293: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[69ec1ed5-59f6-407b-bb10-0abc4bdeffb1] received 2024-06-19T00:50:01.303360707Z [2024-06-19 00:50:01,303: INFO/ForkPoolWorker-1] [74b15c9a-772a-415e-bd2b-8e1e34016f24] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-19T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T00:50:01.304825271Z [2024-06-19 00:50:01,304: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7944a7d3-8eb0-46ad-b260-dd7662cb0d7b] received 2024-06-19T00:50:01.311778029Z [2024-06-19 00:50:01,311: INFO/ForkPoolWorker-2] [69ec1ed5-59f6-407b-bb10-0abc4bdeffb1] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-19T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-19T00:50:01.337195361Z [2024-06-19 00:50:01,336: INFO/ForkPoolWorker-3] [7944a7d3-8eb0-46ad-b260-dd7662cb0d7b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T00:50:01.744449892Z [2024-06-19 00:50:01,740: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T00:50:01.809300395Z [2024-06-19 00:50:01,805: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T00:50:01.844469672Z [2024-06-19 00:50:01,840: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T00:50:01.892409675Z [2024-06-19 00:50:01,886: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T00:50:01.915351847Z [2024-06-19 00:50:01,911: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-19T00:50:02.333785107Z [2024-06-19 00:50:02,332: INFO/ForkPoolWorker-15] Getting SDNC list 2024-06-19T00:50:02.347987470Z [2024-06-19 00:50:02,344: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:50:02.408772526Z [2024-06-19 00:50:02,408: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T00:50:02.409905235Z [2024-06-19 00:50:02,409: INFO/ForkPoolWorker-15] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T00:50:02.410056992Z [2024-06-19 00:50:02,409: INFO/ForkPoolWorker-15] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T00:50:02.410184307Z [2024-06-19 00:50:02,410: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-06-19T00:50:02.410366908Z [2024-06-19 00:50:02,410: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T00:50:02.502048865Z [2024-06-19 00:50:02,501: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:50:02.553682339Z [2024-06-19 00:50:02,553: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:50:03.185601565Z [2024-06-19 00:50:03,185: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[69ec1ed5-59f6-407b-bb10-0abc4bdeffb1] succeeded in 1.8876321949992416s: None 2024-06-19T00:50:03.247495337Z [2024-06-19 00:50:03,247: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T00:50:03.250797268Z [2024-06-19 00:50:03,250: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:50:03.280789136Z [2024-06-19 00:50:03,280: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T00:50:03.282348826Z [2024-06-19 00:50:03,282: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:50:03.282531653Z [2024-06-19 00:50:03,282: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:50:03.282760429Z [2024-06-19 00:50:03,282: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:50:03.282851975Z [2024-06-19 00:50:03,282: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T00:50:03.283123161Z [2024-06-19 00:50:03,282: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-19T00:50:03.283263888Z [2024-06-19 00:50:03,283: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:50:03.296281902Z [2024-06-19 00:50:03,295: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a3bd8f38-93f2-4b26-94c1-a0ba300dc3d0] succeeded in 2.022229154001252s: None 2024-06-19T00:50:03.365933661Z [2024-06-19 00:50:03,365: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:50:03.367066000Z [2024-06-19 00:50:03,366: INFO/ForkPoolWorker-3] Getting VIM list 2024-06-19T00:50:03.370531611Z [2024-06-19 00:50:03,370: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:50:03.410201798Z [2024-06-19 00:50:03,409: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-06-19T00:50:03.411754160Z [2024-06-19 00:50:03,411: INFO/ForkPoolWorker-3] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:50:03.411996079Z [2024-06-19 00:50:03,411: INFO/ForkPoolWorker-3] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:50:03.412419822Z [2024-06-19 00:50:03,412: INFO/ForkPoolWorker-3] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:50:03.412647241Z [2024-06-19 00:50:03,412: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-06-19T00:50:03.413241135Z [2024-06-19 00:50:03,413: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T00:50:03.413715669Z [2024-06-19 00:50:03,413: INFO/ForkPoolWorker-3] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:50:03.525304301Z [2024-06-19 00:50:03,525: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:50:03.604585352Z [2024-06-19 00:50:03,604: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T00:50:03.609899291Z [2024-06-19 00:50:03,609: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:50:03.657677823Z [2024-06-19 00:50:03,657: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T00:50:03.660524897Z [2024-06-19 00:50:03,660: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:50:03.660755113Z [2024-06-19 00:50:03,660: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:50:03.660975651Z [2024-06-19 00:50:03,660: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:50:03.661100915Z [2024-06-19 00:50:03,660: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T00:50:03.661357270Z [2024-06-19 00:50:03,661: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T00:50:03.661800718Z [2024-06-19 00:50:03,661: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:50:03.741469049Z [2024-06-19 00:50:03,741: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:50:04.449315485Z [2024-06-19 00:50:04,448: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[74b15c9a-772a-415e-bd2b-8e1e34016f24] succeeded in 3.1582038260003173s: None 2024-06-19T00:50:05.093320438Z [2024-06-19 00:50:05,092: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[7944a7d3-8eb0-46ad-b260-dd7662cb0d7b] succeeded in 3.7859738690003724s: None 2024-06-19T00:50:05.313967890Z [2024-06-19 00:50:05,313: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a0a93e7e-8192-4739-b25a-449b09c3aa78] received 2024-06-19T00:50:05.323661812Z [2024-06-19 00:50:05,323: INFO/ForkPoolWorker-15] [a0a93e7e-8192-4739-b25a-449b09c3aa78] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'split_metrics', 'scheduled__2024-06-19T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T00:50:05.635513547Z [2024-06-19 00:50:05,632: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T00:50:06.700211002Z [2024-06-19 00:50:06,699: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T00:50:06.703854516Z [2024-06-19 00:50:06,703: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:50:06.737904223Z [2024-06-19 00:50:06,737: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T00:50:06.739387270Z [2024-06-19 00:50:06,739: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:50:06.739544130Z [2024-06-19 00:50:06,739: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:50:06.739873640Z [2024-06-19 00:50:06,739: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:50:06.740047210Z [2024-06-19 00:50:06,739: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T00:50:06.740402837Z [2024-06-19 00:50:06,740: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T00:50:06.740604468Z [2024-06-19 00:50:06,740: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:50:06.843841166Z [2024-06-19 00:50:06,843: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:50:07.076327168Z [2024-06-19 00:50:07,075: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b1b3e9f6-fdc6-4f94-bf89-bbdf3a85ac02] succeeded in 5.800301146999118s: None 2024-06-19T00:50:07.570395010Z [2024-06-19 00:50:07,569: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a0a93e7e-8192-4739-b25a-449b09c3aa78] succeeded in 2.254758605000461s: None 2024-06-19T00:50:07.898780264Z [2024-06-19 00:50:07,898: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[14985409-1213-4d7b-944b-014d5ce98882] received 2024-06-19T00:50:07.925236129Z [2024-06-19 00:50:07,923: INFO/ForkPoolWorker-15] [14985409-1213-4d7b-944b-014d5ce98882] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'collect_metrics', 'scheduled__2024-06-19T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-19T00:50:08.313958392Z [2024-06-19 00:50:08,310: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T00:50:09.313010716Z [2024-06-19 00:50:09,312: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T00:50:09.316307393Z [2024-06-19 00:50:09,315: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:50:09.331571642Z [2024-06-19 00:50:09,330: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T00:50:09.331588894Z [2024-06-19 00:50:09,331: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:50:09.331630580Z [2024-06-19 00:50:09,331: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:50:09.331655624Z [2024-06-19 00:50:09,331: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:50:09.331662062Z [2024-06-19 00:50:09,331: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T00:50:09.331667635Z [2024-06-19 00:50:09,331: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T00:50:09.331681336Z [2024-06-19 00:50:09,331: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:50:09.423277475Z [2024-06-19 00:50:09,422: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:50:10.036591566Z [2024-06-19 00:50:10,036: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[14985409-1213-4d7b-944b-014d5ce98882] succeeded in 2.123778973998924s: None 2024-06-19T00:50:10.371911785Z [2024-06-19 00:50:10,371: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[df8b9063-301d-4065-9788-62f54e2982f3] received 2024-06-19T00:50:10.380093073Z [2024-06-19 00:50:10,379: INFO/ForkPoolWorker-15] [df8b9063-301d-4065-9788-62f54e2982f3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'send_prometheus', 'scheduled__2024-06-19T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T00:50:10.668255611Z [2024-06-19 00:50:10,665: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T00:50:11.685825340Z [2024-06-19 00:50:11,685: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T00:50:11.688929609Z [2024-06-19 00:50:11,688: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:50:11.708604596Z [2024-06-19 00:50:11,708: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T00:50:11.709896804Z [2024-06-19 00:50:11,709: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:50:11.709984769Z [2024-06-19 00:50:11,709: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:50:11.710140372Z [2024-06-19 00:50:11,709: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:50:11.710230295Z [2024-06-19 00:50:11,710: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T00:50:11.710480925Z [2024-06-19 00:50:11,710: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T00:50:11.710577315Z [2024-06-19 00:50:11,710: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:50:11.815944541Z [2024-06-19 00:50:11,815: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:50:12.488384051Z [2024-06-19 00:50:12,487: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[df8b9063-301d-4065-9788-62f54e2982f3] succeeded in 2.114366190999135s: None 2024-06-19T00:51:00.239464615Z [2024-06-19 00:51:00,238: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f3f5cf7f-58be-4842-a222-7fefd43c2361] received 2024-06-19T00:51:00.246551301Z [2024-06-19 00:51:00,246: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a0007b2e-52aa-4564-8ee4-790785be0eab] received 2024-06-19T00:51:00.251230737Z [2024-06-19 00:51:00,250: INFO/ForkPoolWorker-15] [f3f5cf7f-58be-4842-a222-7fefd43c2361] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T00:51:00.256081836Z [2024-06-19 00:51:00,253: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2be2c07b-5e68-4e55-a529-34ba58789642] received 2024-06-19T00:51:00.258886361Z [2024-06-19 00:51:00,258: INFO/ForkPoolWorker-16] [a0007b2e-52aa-4564-8ee4-790785be0eab] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T00:51:00.267370314Z [2024-06-19 00:51:00,267: INFO/ForkPoolWorker-1] [2be2c07b-5e68-4e55-a529-34ba58789642] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T00:51:00.573415142Z [2024-06-19 00:51:00,569: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T00:51:00.574875417Z [2024-06-19 00:51:00,571: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T00:51:00.592312788Z [2024-06-19 00:51:00,589: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T00:51:00.748357044Z [2024-06-19 00:51:00,747: INFO/ForkPoolWorker-1] Getting SDNC list 2024-06-19T00:51:00.752099634Z [2024-06-19 00:51:00,751: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:51:00.777504771Z [2024-06-19 00:51:00,777: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T00:51:00.778715474Z [2024-06-19 00:51:00,778: INFO/ForkPoolWorker-1] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T00:51:00.778806830Z [2024-06-19 00:51:00,778: INFO/ForkPoolWorker-1] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T00:51:00.778820311Z [2024-06-19 00:51:00,778: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-06-19T00:51:00.779025224Z [2024-06-19 00:51:00,778: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T00:51:00.870918659Z [2024-06-19 00:51:00,870: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:51:01.423476161Z [2024-06-19 00:51:01,422: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2be2c07b-5e68-4e55-a529-34ba58789642] succeeded in 1.165022217999649s: None 2024-06-19T00:51:01.634939898Z [2024-06-19 00:51:01,634: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T00:51:01.638147829Z [2024-06-19 00:51:01,637: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:51:01.666998520Z [2024-06-19 00:51:01,666: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T00:51:01.669347876Z [2024-06-19 00:51:01,669: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:51:01.669459754Z [2024-06-19 00:51:01,669: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:51:01.669902385Z [2024-06-19 00:51:01,669: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:51:01.669913482Z [2024-06-19 00:51:01,669: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T00:51:01.670283002Z [2024-06-19 00:51:01,669: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-19T00:51:01.670423653Z [2024-06-19 00:51:01,670: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:51:01.725624088Z [2024-06-19 00:51:01,725: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T00:51:01.728959014Z [2024-06-19 00:51:01,728: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:51:01.758415332Z [2024-06-19 00:51:01,758: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T00:51:01.759441006Z [2024-06-19 00:51:01,759: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:51:01.760922697Z [2024-06-19 00:51:01,760: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:51:01.761275485Z [2024-06-19 00:51:01,760: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:51:01.761591089Z [2024-06-19 00:51:01,761: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:51:01.761818495Z [2024-06-19 00:51:01,761: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T00:51:01.762327319Z [2024-06-19 00:51:01,762: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T00:51:01.762511690Z [2024-06-19 00:51:01,762: INFO/ForkPoolWorker-15] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:51:01.838954958Z [2024-06-19 00:51:01,838: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:51:03.319011027Z [2024-06-19 00:51:03,318: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f3f5cf7f-58be-4842-a222-7fefd43c2361] succeeded in 3.07722855800057s: None 2024-06-19T00:51:03.530593958Z [2024-06-19 00:51:03,529: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a0007b2e-52aa-4564-8ee4-790785be0eab] succeeded in 3.28139723500135s: None 2024-06-19T00:52:00.243101758Z [2024-06-19 00:52:00,242: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[585315e5-0f31-4cd3-ae3e-2f83bd14c77b] received 2024-06-19T00:52:00.249126468Z [2024-06-19 00:52:00,248: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5ad0898b-e0b1-4fc1-af1e-6111ce881394] received 2024-06-19T00:52:00.250699338Z [2024-06-19 00:52:00,250: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d18a3207-3a63-4a6a-8924-e49284fbd9df] received 2024-06-19T00:52:00.254268211Z [2024-06-19 00:52:00,254: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5a189e2d-c12b-441a-8945-0aedc41e68e5] received 2024-06-19T00:52:00.257240898Z [2024-06-19 00:52:00,256: INFO/ForkPoolWorker-16] [5ad0898b-e0b1-4fc1-af1e-6111ce881394] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T00:52:00.262353075Z [2024-06-19 00:52:00,262: INFO/ForkPoolWorker-15] [585315e5-0f31-4cd3-ae3e-2f83bd14c77b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-19T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-19T00:52:00.269145536Z [2024-06-19 00:52:00,268: INFO/ForkPoolWorker-2] [5a189e2d-c12b-441a-8945-0aedc41e68e5] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T00:52:00.275791175Z [2024-06-19 00:52:00,275: INFO/ForkPoolWorker-1] [d18a3207-3a63-4a6a-8924-e49284fbd9df] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T00:52:00.556360823Z [2024-06-19 00:52:00,552: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T00:52:00.588444884Z [2024-06-19 00:52:00,585: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-19T00:52:00.646393904Z [2024-06-19 00:52:00,643: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T00:52:00.708643584Z [2024-06-19 00:52:00,708: INFO/ForkPoolWorker-2] Getting SDNC list 2024-06-19T00:52:00.712575524Z [2024-06-19 00:52:00,712: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:52:00.729094179Z [2024-06-19 00:52:00,720: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T00:52:00.737978792Z [2024-06-19 00:52:00,737: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T00:52:00.739322211Z [2024-06-19 00:52:00,739: INFO/ForkPoolWorker-2] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T00:52:00.739486805Z [2024-06-19 00:52:00,739: INFO/ForkPoolWorker-2] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T00:52:00.739571736Z [2024-06-19 00:52:00,739: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-06-19T00:52:00.739821049Z [2024-06-19 00:52:00,739: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T00:52:00.828166588Z [2024-06-19 00:52:00,827: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:52:00.884654191Z [2024-06-19 00:52:00,884: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:52:01.412535001Z [2024-06-19 00:52:01,412: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[5a189e2d-c12b-441a-8945-0aedc41e68e5] succeeded in 1.1565406640002038s: None 2024-06-19T00:52:01.432745574Z [2024-06-19 00:52:01,432: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[585315e5-0f31-4cd3-ae3e-2f83bd14c77b] succeeded in 1.1868710230010038s: None 2024-06-19T00:52:02.092408192Z [2024-06-19 00:52:02,092: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T00:52:02.096113603Z [2024-06-19 00:52:02,095: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:52:02.104633276Z [2024-06-19 00:52:02,104: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T00:52:02.115330190Z [2024-06-19 00:52:02,112: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:52:02.127485388Z [2024-06-19 00:52:02,127: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T00:52:02.129226637Z [2024-06-19 00:52:02,128: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:52:02.129256125Z [2024-06-19 00:52:02,129: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:52:02.129469910Z [2024-06-19 00:52:02,129: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:52:02.129489853Z [2024-06-19 00:52:02,129: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T00:52:02.129781803Z [2024-06-19 00:52:02,129: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-19T00:52:02.129863963Z [2024-06-19 00:52:02,129: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:52:02.146875566Z [2024-06-19 00:52:02,146: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T00:52:02.148513005Z [2024-06-19 00:52:02,148: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:52:02.148568760Z [2024-06-19 00:52:02,148: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:52:02.148801860Z [2024-06-19 00:52:02,148: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:52:02.148879226Z [2024-06-19 00:52:02,148: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T00:52:02.149311094Z [2024-06-19 00:52:02,149: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T00:52:02.149473143Z [2024-06-19 00:52:02,149: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:52:02.257330110Z [2024-06-19 00:52:02,256: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:52:02.272997393Z [2024-06-19 00:52:02,271: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:52:03.778686926Z [2024-06-19 00:52:03,778: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d18a3207-3a63-4a6a-8924-e49284fbd9df] succeeded in 3.521899609000684s: None 2024-06-19T00:52:04.122477098Z [2024-06-19 00:52:04,120: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5ad0898b-e0b1-4fc1-af1e-6111ce881394] succeeded in 3.8687048490010056s: None 2024-06-19T00:53:00.498692017Z [2024-06-19 00:53:00,498: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[411d74c2-16bb-4c2d-be2b-6a8ce9d85582] received 2024-06-19T00:53:00.505200401Z [2024-06-19 00:53:00,504: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[11b460b0-30a3-4d01-9f10-d39a3191b472] received 2024-06-19T00:53:00.514526673Z [2024-06-19 00:53:00,514: INFO/ForkPoolWorker-15] [411d74c2-16bb-4c2d-be2b-6a8ce9d85582] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T00:53:00.516939668Z [2024-06-19 00:53:00,516: INFO/ForkPoolWorker-16] [11b460b0-30a3-4d01-9f10-d39a3191b472] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T00:53:00.524460031Z [2024-06-19 00:53:00,524: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b234d3c8-c43d-441b-b923-8017f38852d5] received 2024-06-19T00:53:00.541453348Z [2024-06-19 00:53:00,541: INFO/ForkPoolWorker-1] [b234d3c8-c43d-441b-b923-8017f38852d5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T00:53:00.819793467Z [2024-06-19 00:53:00,816: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T00:53:00.821202661Z [2024-06-19 00:53:00,817: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T00:53:00.842455920Z [2024-06-19 00:53:00,839: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T00:53:00.960713820Z [2024-06-19 00:53:00,960: INFO/ForkPoolWorker-16] Getting SDNC list 2024-06-19T00:53:00.964201282Z [2024-06-19 00:53:00,963: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:53:00.993751646Z [2024-06-19 00:53:00,993: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T00:53:00.994704830Z [2024-06-19 00:53:00,994: INFO/ForkPoolWorker-16] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T00:53:00.994761658Z [2024-06-19 00:53:00,994: INFO/ForkPoolWorker-16] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T00:53:00.994796895Z [2024-06-19 00:53:00,994: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-06-19T00:53:00.994938516Z [2024-06-19 00:53:00,994: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T00:53:01.079947492Z [2024-06-19 00:53:01,079: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:53:01.616823439Z [2024-06-19 00:53:01,616: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[11b460b0-30a3-4d01-9f10-d39a3191b472] succeeded in 1.1097899560008955s: None 2024-06-19T00:53:01.958275975Z [2024-06-19 00:53:01,957: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T00:53:01.966194269Z [2024-06-19 00:53:01,965: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:53:01.994650176Z [2024-06-19 00:53:01,994: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T00:53:01.997211605Z [2024-06-19 00:53:01,996: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:53:01.997460738Z [2024-06-19 00:53:01,997: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:53:01.997863196Z [2024-06-19 00:53:01,997: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:53:01.998140555Z [2024-06-19 00:53:01,997: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T00:53:01.998895109Z [2024-06-19 00:53:01,998: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T00:53:02.006383033Z [2024-06-19 00:53:02,005: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:53:02.077009427Z [2024-06-19 00:53:02,076: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T00:53:02.080215654Z [2024-06-19 00:53:02,079: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:53:02.099554822Z [2024-06-19 00:53:02,099: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T00:53:02.101130686Z [2024-06-19 00:53:02,100: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:53:02.101274450Z [2024-06-19 00:53:02,101: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:53:02.101433784Z [2024-06-19 00:53:02,101: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:53:02.101535171Z [2024-06-19 00:53:02,101: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T00:53:02.102046561Z [2024-06-19 00:53:02,101: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-06-19T00:53:02.102098789Z [2024-06-19 00:53:02,101: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:53:02.108312632Z [2024-06-19 00:53:02,108: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:53:02.218174033Z [2024-06-19 00:53:02,215: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:53:03.613478748Z [2024-06-19 00:53:03,612: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b234d3c8-c43d-441b-b923-8017f38852d5] succeeded in 3.0853269759991235s: None 2024-06-19T00:53:04.118338823Z [2024-06-19 00:53:04,117: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[411d74c2-16bb-4c2d-be2b-6a8ce9d85582] succeeded in 3.616909143000157s: None 2024-06-19T00:54:00.779423548Z [2024-06-19 00:54:00,779: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ea7a4ee8-0a3f-4490-850f-08df3e761058] received 2024-06-19T00:54:00.782665800Z [2024-06-19 00:54:00,782: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5b94c23a-4a3a-43af-950b-4c280bb7ede8] received 2024-06-19T00:54:00.791940053Z [2024-06-19 00:54:00,791: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ff8352ed-2ea2-41ca-a17a-a6e2bd1b16f9] received 2024-06-19T00:54:00.792799909Z [2024-06-19 00:54:00,792: INFO/ForkPoolWorker-16] [5b94c23a-4a3a-43af-950b-4c280bb7ede8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T00:54:00.798319378Z [2024-06-19 00:54:00,797: INFO/ForkPoolWorker-15] [ea7a4ee8-0a3f-4490-850f-08df3e761058] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-19T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-19T00:54:00.804006075Z [2024-06-19 00:54:00,803: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0eaf6702-02e5-46c1-b10d-4c385a8764ae] received 2024-06-19T00:54:00.809559404Z [2024-06-19 00:54:00,809: INFO/ForkPoolWorker-1] [ff8352ed-2ea2-41ca-a17a-a6e2bd1b16f9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T00:54:00.816020554Z [2024-06-19 00:54:00,815: INFO/ForkPoolWorker-2] [0eaf6702-02e5-46c1-b10d-4c385a8764ae] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T00:54:01.108619847Z [2024-06-19 00:54:01,105: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T00:54:01.122709414Z [2024-06-19 00:54:01,119: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-19T00:54:01.126380979Z [2024-06-19 00:54:01,122: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T00:54:01.178437893Z [2024-06-19 00:54:01,175: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T00:54:01.332246336Z [2024-06-19 00:54:01,331: INFO/ForkPoolWorker-2] Getting SDNC list 2024-06-19T00:54:01.336198031Z [2024-06-19 00:54:01,335: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:54:01.365494492Z [2024-06-19 00:54:01,365: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T00:54:01.369686154Z [2024-06-19 00:54:01,369: INFO/ForkPoolWorker-2] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T00:54:01.369725215Z [2024-06-19 00:54:01,369: INFO/ForkPoolWorker-2] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T00:54:01.369774363Z [2024-06-19 00:54:01,369: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-06-19T00:54:01.369955706Z [2024-06-19 00:54:01,369: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T00:54:01.432068091Z [2024-06-19 00:54:01,431: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:54:01.496309595Z [2024-06-19 00:54:01,496: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:54:01.963869444Z [2024-06-19 00:54:01,963: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ea7a4ee8-0a3f-4490-850f-08df3e761058] succeeded in 1.1810176039998623s: None 2024-06-19T00:54:02.089410362Z [2024-06-19 00:54:02,088: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[0eaf6702-02e5-46c1-b10d-4c385a8764ae] succeeded in 1.280880670001352s: None 2024-06-19T00:54:02.521626509Z [2024-06-19 00:54:02,521: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T00:54:02.524777855Z [2024-06-19 00:54:02,524: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:54:02.545586426Z [2024-06-19 00:54:02,545: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T00:54:02.546981726Z [2024-06-19 00:54:02,546: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:54:02.547158004Z [2024-06-19 00:54:02,546: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:54:02.547391767Z [2024-06-19 00:54:02,547: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:54:02.547546128Z [2024-06-19 00:54:02,547: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T00:54:02.548053633Z [2024-06-19 00:54:02,547: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T00:54:02.548242851Z [2024-06-19 00:54:02,548: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:54:02.604953110Z [2024-06-19 00:54:02,604: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T00:54:02.614112489Z [2024-06-19 00:54:02,613: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:54:02.641347096Z [2024-06-19 00:54:02,640: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T00:54:02.642224043Z [2024-06-19 00:54:02,642: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:54:02.642420342Z [2024-06-19 00:54:02,642: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:54:02.642648733Z [2024-06-19 00:54:02,642: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:54:02.642827199Z [2024-06-19 00:54:02,642: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T00:54:02.643289392Z [2024-06-19 00:54:02,643: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-19T00:54:02.643491000Z [2024-06-19 00:54:02,643: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:54:02.674554624Z [2024-06-19 00:54:02,674: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:54:02.735939204Z [2024-06-19 00:54:02,735: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:54:04.245885813Z [2024-06-19 00:54:04,245: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ff8352ed-2ea2-41ca-a17a-a6e2bd1b16f9] succeeded in 3.446807575001003s: None 2024-06-19T00:54:06.272064193Z [2024-06-19 00:54:06,271: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5b94c23a-4a3a-43af-950b-4c280bb7ede8] succeeded in 5.48528957400049s: None 2024-06-19T00:55:01.086558663Z [2024-06-19 00:55:01,086: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ff709cd3-9879-4f71-b473-f1b38afe42a7] received 2024-06-19T00:55:01.089514256Z [2024-06-19 00:55:01,089: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d17c093c-bd0a-41c1-9d27-7421869df3f7] received 2024-06-19T00:55:01.092566763Z [2024-06-19 00:55:01,092: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6d18e0d3-d4ff-4f4a-a41f-903353b31386] received 2024-06-19T00:55:01.095256515Z [2024-06-19 00:55:01,095: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d855ffbf-9c9d-4f7d-aa3c-86a603e7cc14] received 2024-06-19T00:55:01.101083764Z [2024-06-19 00:55:01,100: INFO/ForkPoolWorker-16] [d17c093c-bd0a-41c1-9d27-7421869df3f7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T00:55:01.102465431Z [2024-06-19 00:55:01,102: INFO/ForkPoolWorker-15] [ff709cd3-9879-4f71-b473-f1b38afe42a7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-19T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T00:55:01.106563371Z [2024-06-19 00:55:01,105: INFO/ForkPoolWorker-1] [6d18e0d3-d4ff-4f4a-a41f-903353b31386] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T00:55:01.111050958Z [2024-06-19 00:55:01,110: INFO/ForkPoolWorker-2] [d855ffbf-9c9d-4f7d-aa3c-86a603e7cc14] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T00:55:01.429499274Z [2024-06-19 00:55:01,425: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T00:55:01.441254952Z [2024-06-19 00:55:01,432: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T00:55:01.531301858Z [2024-06-19 00:55:01,528: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T00:55:01.569964062Z [2024-06-19 00:55:01,566: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T00:55:01.605028839Z [2024-06-19 00:55:01,604: INFO/ForkPoolWorker-2] Getting SDNC list 2024-06-19T00:55:01.608934186Z [2024-06-19 00:55:01,608: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:55:01.637204913Z [2024-06-19 00:55:01,636: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T00:55:01.648366227Z [2024-06-19 00:55:01,648: INFO/ForkPoolWorker-2] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T00:55:01.655455237Z [2024-06-19 00:55:01,655: INFO/ForkPoolWorker-2] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T00:55:01.655494256Z [2024-06-19 00:55:01,655: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-06-19T00:55:01.655822663Z [2024-06-19 00:55:01,655: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T00:55:01.740576294Z [2024-06-19 00:55:01,740: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:55:02.397978562Z [2024-06-19 00:55:02,397: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d855ffbf-9c9d-4f7d-aa3c-86a603e7cc14] succeeded in 1.2985268630000064s: None 2024-06-19T00:55:02.710704042Z [2024-06-19 00:55:02,710: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T00:55:02.714018841Z [2024-06-19 00:55:02,713: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:55:02.736075474Z [2024-06-19 00:55:02,735: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T00:55:02.737581225Z [2024-06-19 00:55:02,737: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:55:02.737777440Z [2024-06-19 00:55:02,737: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T00:55:02.737906039Z [2024-06-19 00:55:02,737: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:55:02.738164478Z [2024-06-19 00:55:02,737: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:55:02.738355023Z [2024-06-19 00:55:02,738: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T00:55:02.738846791Z [2024-06-19 00:55:02,738: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T00:55:02.739024071Z [2024-06-19 00:55:02,738: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:55:02.740983163Z [2024-06-19 00:55:02,740: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:55:02.768231808Z [2024-06-19 00:55:02,767: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T00:55:02.771030660Z [2024-06-19 00:55:02,770: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:55:02.771167031Z [2024-06-19 00:55:02,770: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:55:02.771501466Z [2024-06-19 00:55:02,771: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:55:02.771654733Z [2024-06-19 00:55:02,771: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T00:55:02.772344072Z [2024-06-19 00:55:02,772: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T00:55:02.772473443Z [2024-06-19 00:55:02,772: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:55:02.834006385Z [2024-06-19 00:55:02,833: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T00:55:02.837406676Z [2024-06-19 00:55:02,836: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:55:02.838810463Z [2024-06-19 00:55:02,838: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:55:02.859293547Z [2024-06-19 00:55:02,859: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T00:55:02.860774554Z [2024-06-19 00:55:02,860: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:55:02.860787502Z [2024-06-19 00:55:02,860: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:55:02.860955373Z [2024-06-19 00:55:02,860: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:55:02.860966333Z [2024-06-19 00:55:02,860: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T00:55:02.861308483Z [2024-06-19 00:55:02,861: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-19T00:55:02.861395233Z [2024-06-19 00:55:02,861: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:55:02.911298990Z [2024-06-19 00:55:02,910: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:55:02.947088983Z [2024-06-19 00:55:02,946: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:55:03.478596399Z [2024-06-19 00:55:03,478: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ff709cd3-9879-4f71-b473-f1b38afe42a7] succeeded in 2.389189138999427s: None 2024-06-19T00:55:03.712311525Z [2024-06-19 00:55:03,712: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[91da7011-abf8-4db0-873b-ca6970b41a1c] received 2024-06-19T00:55:03.721200222Z [2024-06-19 00:55:03,720: INFO/ForkPoolWorker-15] [91da7011-abf8-4db0-873b-ca6970b41a1c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'split_metrics', 'scheduled__2024-06-19T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T00:55:04.052902463Z [2024-06-19 00:55:04,049: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T00:55:04.520494734Z [2024-06-19 00:55:04,518: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6d18e0d3-d4ff-4f4a-a41f-903353b31386] succeeded in 3.4239000310008123s: None 2024-06-19T00:55:04.790472604Z [2024-06-19 00:55:04,789: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d17c093c-bd0a-41c1-9d27-7421869df3f7] succeeded in 3.698129849999532s: None 2024-06-19T00:55:05.273291446Z [2024-06-19 00:55:05,272: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T00:55:05.276392141Z [2024-06-19 00:55:05,276: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:55:05.298784642Z [2024-06-19 00:55:05,298: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T00:55:05.300220377Z [2024-06-19 00:55:05,300: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:55:05.300387129Z [2024-06-19 00:55:05,300: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:55:05.300554273Z [2024-06-19 00:55:05,300: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:55:05.300649551Z [2024-06-19 00:55:05,300: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T00:55:05.300923774Z [2024-06-19 00:55:05,300: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T00:55:05.301022924Z [2024-06-19 00:55:05,300: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:55:05.373821706Z [2024-06-19 00:55:05,373: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:55:06.038708224Z [2024-06-19 00:55:06,038: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[91da7011-abf8-4db0-873b-ca6970b41a1c] succeeded in 2.324687078998977s: None 2024-06-19T00:55:06.518462977Z [2024-06-19 00:55:06,518: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e3ffa9c8-119d-41d6-a249-b0c15972be88] received 2024-06-19T00:55:06.527207657Z [2024-06-19 00:55:06,526: INFO/ForkPoolWorker-15] [e3ffa9c8-119d-41d6-a249-b0c15972be88] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'collect_metrics', 'scheduled__2024-06-19T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-19T00:55:06.786631914Z [2024-06-19 00:55:06,783: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T00:55:07.855280298Z [2024-06-19 00:55:07,854: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T00:55:07.858318149Z [2024-06-19 00:55:07,857: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:55:07.879265815Z [2024-06-19 00:55:07,878: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T00:55:07.880913592Z [2024-06-19 00:55:07,880: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:55:07.880957429Z [2024-06-19 00:55:07,880: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:55:07.881172394Z [2024-06-19 00:55:07,880: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:55:07.881194728Z [2024-06-19 00:55:07,881: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T00:55:07.881460485Z [2024-06-19 00:55:07,881: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T00:55:07.881479520Z [2024-06-19 00:55:07,881: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:55:07.967967460Z [2024-06-19 00:55:07,967: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:55:08.576224929Z [2024-06-19 00:55:08,575: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e3ffa9c8-119d-41d6-a249-b0c15972be88] succeeded in 2.0549224389997107s: None 2024-06-19T00:55:08.926171259Z [2024-06-19 00:55:08,925: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[517505f5-f07a-4971-9a7f-9d6f51da2361] received 2024-06-19T00:55:08.936486040Z [2024-06-19 00:55:08,936: INFO/ForkPoolWorker-15] [517505f5-f07a-4971-9a7f-9d6f51da2361] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'send_prometheus', 'scheduled__2024-06-19T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T00:55:09.235092495Z [2024-06-19 00:55:09,232: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T00:55:10.235189148Z [2024-06-19 00:55:10,234: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T00:55:10.238322884Z [2024-06-19 00:55:10,237: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:55:10.265983282Z [2024-06-19 00:55:10,265: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T00:55:10.267204152Z [2024-06-19 00:55:10,267: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:55:10.267331960Z [2024-06-19 00:55:10,267: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:55:10.267518257Z [2024-06-19 00:55:10,267: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:55:10.267568823Z [2024-06-19 00:55:10,267: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T00:55:10.268178387Z [2024-06-19 00:55:10,267: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T00:55:10.268503652Z [2024-06-19 00:55:10,268: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:55:10.364190963Z [2024-06-19 00:55:10,363: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:55:11.060884147Z [2024-06-19 00:55:11,060: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[517505f5-f07a-4971-9a7f-9d6f51da2361] succeeded in 2.1316067460011254s: None 2024-06-19T00:56:00.296235116Z [2024-06-19 00:56:00,295: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a69927ed-8e30-489c-9cd1-f3a7eb95de58] received 2024-06-19T00:56:00.299118261Z [2024-06-19 00:56:00,298: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ae6f1a8e-9d59-4384-93b5-d94ec36967de] received 2024-06-19T00:56:00.307050935Z [2024-06-19 00:56:00,306: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9e7d7d66-8616-4bd9-8d76-3a338ff0e49c] received 2024-06-19T00:56:00.308698962Z [2024-06-19 00:56:00,308: INFO/ForkPoolWorker-16] [ae6f1a8e-9d59-4384-93b5-d94ec36967de] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-19T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-19T00:56:00.312701246Z [2024-06-19 00:56:00,312: INFO/ForkPoolWorker-15] [a69927ed-8e30-489c-9cd1-f3a7eb95de58] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T00:56:00.330577277Z [2024-06-19 00:56:00,330: INFO/ForkPoolWorker-1] [9e7d7d66-8616-4bd9-8d76-3a338ff0e49c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T00:56:00.335062817Z [2024-06-19 00:56:00,334: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fe6648c5-0e93-417a-8d02-d027d7e128c8] received 2024-06-19T00:56:00.341954824Z [2024-06-19 00:56:00,341: INFO/ForkPoolWorker-2] [fe6648c5-0e93-417a-8d02-d027d7e128c8] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T00:56:00.651917196Z [2024-06-19 00:56:00,639: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T00:56:00.669352852Z [2024-06-19 00:56:00,666: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T00:56:00.679933410Z [2024-06-19 00:56:00,670: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-19T00:56:00.696527748Z [2024-06-19 00:56:00,692: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T00:56:00.854570016Z [2024-06-19 00:56:00,854: INFO/ForkPoolWorker-2] Getting SDNC list 2024-06-19T00:56:00.859306112Z [2024-06-19 00:56:00,858: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:56:00.900524330Z [2024-06-19 00:56:00,900: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T00:56:00.901477640Z [2024-06-19 00:56:00,901: INFO/ForkPoolWorker-2] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T00:56:00.901556642Z [2024-06-19 00:56:00,901: INFO/ForkPoolWorker-2] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T00:56:00.901604425Z [2024-06-19 00:56:00,901: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-06-19T00:56:00.901788464Z [2024-06-19 00:56:00,901: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T00:56:00.950116813Z [2024-06-19 00:56:00,949: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:56:01.008021081Z [2024-06-19 00:56:01,007: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:56:01.601950288Z [2024-06-19 00:56:01,601: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ae6f1a8e-9d59-4384-93b5-d94ec36967de] succeeded in 1.3011633249989245s: None 2024-06-19T00:56:01.679616584Z [2024-06-19 00:56:01,679: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[fe6648c5-0e93-417a-8d02-d027d7e128c8] succeeded in 1.3427965009996115s: None 2024-06-19T00:56:01.931313179Z [2024-06-19 00:56:01,930: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T00:56:01.934573476Z [2024-06-19 00:56:01,934: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:56:01.953926033Z [2024-06-19 00:56:01,953: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T00:56:01.955325952Z [2024-06-19 00:56:01,955: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:56:01.955468084Z [2024-06-19 00:56:01,955: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:56:01.955654299Z [2024-06-19 00:56:01,955: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:56:01.955850900Z [2024-06-19 00:56:01,955: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T00:56:01.956137183Z [2024-06-19 00:56:01,956: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T00:56:01.956250733Z [2024-06-19 00:56:01,956: INFO/ForkPoolWorker-15] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:56:02.024886986Z [2024-06-19 00:56:02,024: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:56:02.065621832Z [2024-06-19 00:56:02,065: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T00:56:02.068847459Z [2024-06-19 00:56:02,068: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:56:02.091925090Z [2024-06-19 00:56:02,091: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T00:56:02.093519743Z [2024-06-19 00:56:02,093: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:56:02.093665480Z [2024-06-19 00:56:02,093: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:56:02.093931873Z [2024-06-19 00:56:02,093: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:56:02.094104376Z [2024-06-19 00:56:02,093: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T00:56:02.094641996Z [2024-06-19 00:56:02,094: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-06-19T00:56:02.095162027Z [2024-06-19 00:56:02,094: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:56:02.186573411Z [2024-06-19 00:56:02,186: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:56:03.567477897Z [2024-06-19 00:56:03,566: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a69927ed-8e30-489c-9cd1-f3a7eb95de58] succeeded in 3.266090928000267s: None 2024-06-19T00:56:04.242716915Z [2024-06-19 00:56:04,242: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9e7d7d66-8616-4bd9-8d76-3a338ff0e49c] succeeded in 3.9322599110000738s: None 2024-06-19T00:57:01.154783569Z [2024-06-19 00:57:01,154: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8437395d-4d59-482a-904d-471cb11b90f4] received 2024-06-19T00:57:01.160939282Z [2024-06-19 00:57:01,160: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5c49db70-f513-4fd7-a014-f90d9df42b37] received 2024-06-19T00:57:01.168332946Z [2024-06-19 00:57:01,168: INFO/ForkPoolWorker-15] [8437395d-4d59-482a-904d-471cb11b90f4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T00:57:01.175003576Z [2024-06-19 00:57:01,174: INFO/ForkPoolWorker-16] [5c49db70-f513-4fd7-a014-f90d9df42b37] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T00:57:01.180565093Z [2024-06-19 00:57:01,180: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d6788071-748c-40f1-b6d7-e6a31224a2ec] received 2024-06-19T00:57:01.189262787Z [2024-06-19 00:57:01,188: INFO/ForkPoolWorker-1] [d6788071-748c-40f1-b6d7-e6a31224a2ec] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T00:57:01.436124653Z [2024-06-19 00:57:01,433: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T00:57:01.483009618Z [2024-06-19 00:57:01,479: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T00:57:01.498615406Z [2024-06-19 00:57:01,494: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T00:57:01.697866968Z [2024-06-19 00:57:01,697: INFO/ForkPoolWorker-1] Getting SDNC list 2024-06-19T00:57:01.701421815Z [2024-06-19 00:57:01,701: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:57:01.724747763Z [2024-06-19 00:57:01,724: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T00:57:01.725819493Z [2024-06-19 00:57:01,725: INFO/ForkPoolWorker-1] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T00:57:01.725977704Z [2024-06-19 00:57:01,725: INFO/ForkPoolWorker-1] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T00:57:01.726030318Z [2024-06-19 00:57:01,725: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-06-19T00:57:01.726266776Z [2024-06-19 00:57:01,726: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T00:57:01.844546316Z [2024-06-19 00:57:01,844: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:57:02.540780135Z [2024-06-19 00:57:02,540: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d6788071-748c-40f1-b6d7-e6a31224a2ec] succeeded in 1.3586543840010563s: None 2024-06-19T00:57:02.690827635Z [2024-06-19 00:57:02,690: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T00:57:02.694019152Z [2024-06-19 00:57:02,693: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:57:02.717969010Z [2024-06-19 00:57:02,717: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T00:57:02.720227587Z [2024-06-19 00:57:02,720: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:57:02.720276829Z [2024-06-19 00:57:02,720: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:57:02.720442211Z [2024-06-19 00:57:02,720: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:57:02.720497087Z [2024-06-19 00:57:02,720: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T00:57:02.720737495Z [2024-06-19 00:57:02,720: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-06-19T00:57:02.720779956Z [2024-06-19 00:57:02,720: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:57:02.788137260Z [2024-06-19 00:57:02,787: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T00:57:02.791279619Z [2024-06-19 00:57:02,790: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:57:02.800095774Z [2024-06-19 00:57:02,799: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:57:02.806971963Z [2024-06-19 00:57:02,806: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T00:57:02.808828742Z [2024-06-19 00:57:02,808: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:57:02.809082286Z [2024-06-19 00:57:02,808: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:57:02.809316560Z [2024-06-19 00:57:02,809: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:57:02.809350167Z [2024-06-19 00:57:02,809: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T00:57:02.809617146Z [2024-06-19 00:57:02,809: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T00:57:02.809927759Z [2024-06-19 00:57:02,809: INFO/ForkPoolWorker-16] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:57:02.884917124Z [2024-06-19 00:57:02,884: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:57:04.522447805Z [2024-06-19 00:57:04,522: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5c49db70-f513-4fd7-a014-f90d9df42b37] succeeded in 3.3591755739998916s: None 2024-06-19T00:57:04.990268622Z [2024-06-19 00:57:04,989: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8437395d-4d59-482a-904d-471cb11b90f4] succeeded in 3.8335061779998796s: None 2024-06-19T00:58:00.473659394Z [2024-06-19 00:58:00,473: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8908cf41-3cff-421b-8ba4-4752b62877f4] received 2024-06-19T00:58:00.476263546Z [2024-06-19 00:58:00,476: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a3a7b377-2911-4d63-96b8-72604c39d74c] received 2024-06-19T00:58:00.489177086Z [2024-06-19 00:58:00,488: INFO/ForkPoolWorker-15] [8908cf41-3cff-421b-8ba4-4752b62877f4] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-19T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-19T00:58:00.489448663Z [2024-06-19 00:58:00,489: INFO/ForkPoolWorker-16] [a3a7b377-2911-4d63-96b8-72604c39d74c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T00:58:00.508496567Z [2024-06-19 00:58:00,508: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e88db5fa-cfae-4d8d-8934-ac827c6a5d85] received 2024-06-19T00:58:00.511564461Z [2024-06-19 00:58:00,511: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2ae386d9-044a-4132-850c-ecbc099901fe] received 2024-06-19T00:58:00.525003282Z [2024-06-19 00:58:00,524: INFO/ForkPoolWorker-1] [e88db5fa-cfae-4d8d-8934-ac827c6a5d85] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T00:58:00.537640876Z [2024-06-19 00:58:00,537: INFO/ForkPoolWorker-2] [2ae386d9-044a-4132-850c-ecbc099901fe] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T00:58:00.991154834Z [2024-06-19 00:58:00,986: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-19T00:58:01.040402864Z [2024-06-19 00:58:01,036: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T00:58:01.042096949Z [2024-06-19 00:58:01,034: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T00:58:01.260594607Z [2024-06-19 00:58:01,255: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T00:58:01.322084913Z [2024-06-19 00:58:01,321: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:58:01.382095554Z [2024-06-19 00:58:01,381: INFO/ForkPoolWorker-2] Getting SDNC list 2024-06-19T00:58:01.385956556Z [2024-06-19 00:58:01,385: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:58:01.413028645Z [2024-06-19 00:58:01,412: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T00:58:01.414142670Z [2024-06-19 00:58:01,413: INFO/ForkPoolWorker-2] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T00:58:01.414256175Z [2024-06-19 00:58:01,414: INFO/ForkPoolWorker-2] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T00:58:01.414339458Z [2024-06-19 00:58:01,414: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-06-19T00:58:01.414593808Z [2024-06-19 00:58:01,414: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T00:58:01.538187814Z [2024-06-19 00:58:01,537: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:58:02.157895648Z [2024-06-19 00:58:02,157: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8908cf41-3cff-421b-8ba4-4752b62877f4] succeeded in 1.6788690369994583s: None 2024-06-19T00:58:02.257709932Z [2024-06-19 00:58:02,256: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[2ae386d9-044a-4132-850c-ecbc099901fe] succeeded in 1.7403156550008134s: None 2024-06-19T00:58:02.475282715Z [2024-06-19 00:58:02,474: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T00:58:02.478748518Z [2024-06-19 00:58:02,478: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:58:02.501172467Z [2024-06-19 00:58:02,500: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T00:58:02.502514881Z [2024-06-19 00:58:02,502: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:58:02.502840352Z [2024-06-19 00:58:02,502: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:58:02.503090941Z [2024-06-19 00:58:02,502: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:58:02.503251628Z [2024-06-19 00:58:02,503: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T00:58:02.503587192Z [2024-06-19 00:58:02,503: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-19T00:58:02.503799472Z [2024-06-19 00:58:02,503: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:58:02.594273371Z [2024-06-19 00:58:02,593: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T00:58:02.597353447Z [2024-06-19 00:58:02,597: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:58:02.602330509Z [2024-06-19 00:58:02,602: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:58:02.640288816Z [2024-06-19 00:58:02,640: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T00:58:02.643032880Z [2024-06-19 00:58:02,642: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:58:02.643475924Z [2024-06-19 00:58:02,643: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:58:02.643895286Z [2024-06-19 00:58:02,643: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:58:02.644306457Z [2024-06-19 00:58:02,644: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T00:58:02.644671559Z [2024-06-19 00:58:02,644: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T00:58:02.644833616Z [2024-06-19 00:58:02,644: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:58:02.720957034Z [2024-06-19 00:58:02,720: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:58:04.556905931Z [2024-06-19 00:58:04,556: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e88db5fa-cfae-4d8d-8934-ac827c6a5d85] succeeded in 4.041379682999832s: None 2024-06-19T00:58:04.788138231Z [2024-06-19 00:58:04,787: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a3a7b377-2911-4d63-96b8-72604c39d74c] succeeded in 4.308044788000188s: None 2024-06-19T00:59:00.850640494Z [2024-06-19 00:59:00,850: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aa679fb4-43b0-4e3d-ad99-b6259b76cf91] received 2024-06-19T00:59:00.853200098Z [2024-06-19 00:59:00,852: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2e093756-5530-4c7c-b034-6c1f081af19f] received 2024-06-19T00:59:00.862470464Z [2024-06-19 00:59:00,862: INFO/ForkPoolWorker-16] [2e093756-5530-4c7c-b034-6c1f081af19f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T00:59:00.864731364Z [2024-06-19 00:59:00,864: INFO/ForkPoolWorker-15] [aa679fb4-43b0-4e3d-ad99-b6259b76cf91] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T00:59:00.896419233Z [2024-06-19 00:59:00,896: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[78c23888-aa13-429b-b21d-ed54b5f354d7] received 2024-06-19T00:59:00.904771043Z [2024-06-19 00:59:00,904: INFO/ForkPoolWorker-1] [78c23888-aa13-429b-b21d-ed54b5f354d7] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T00:59:01.170644223Z [2024-06-19 00:59:01,167: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T00:59:01.192375403Z [2024-06-19 00:59:01,189: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T00:59:01.357083628Z [2024-06-19 00:59:01,353: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T00:59:01.559803870Z [2024-06-19 00:59:01,559: INFO/ForkPoolWorker-1] Getting SDNC list 2024-06-19T00:59:01.563475269Z [2024-06-19 00:59:01,563: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:59:01.585998030Z [2024-06-19 00:59:01,585: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T00:59:01.586863507Z [2024-06-19 00:59:01,586: INFO/ForkPoolWorker-1] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T00:59:01.586974861Z [2024-06-19 00:59:01,586: INFO/ForkPoolWorker-1] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T00:59:01.587087921Z [2024-06-19 00:59:01,586: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-06-19T00:59:01.587367515Z [2024-06-19 00:59:01,587: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T00:59:01.692039686Z [2024-06-19 00:59:01,691: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:59:02.394256053Z [2024-06-19 00:59:02,393: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[78c23888-aa13-429b-b21d-ed54b5f354d7] succeeded in 1.495941764998861s: None 2024-06-19T00:59:02.453956139Z [2024-06-19 00:59:02,453: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T00:59:02.457362567Z [2024-06-19 00:59:02,456: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:59:02.490412983Z [2024-06-19 00:59:02,490: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T00:59:02.498946939Z [2024-06-19 00:59:02,498: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:59:02.501149948Z [2024-06-19 00:59:02,500: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:59:02.501479201Z [2024-06-19 00:59:02,501: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:59:02.501669300Z [2024-06-19 00:59:02,501: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T00:59:02.502208375Z [2024-06-19 00:59:02,501: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-19T00:59:02.502372396Z [2024-06-19 00:59:02,502: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:59:02.593652744Z [2024-06-19 00:59:02,593: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:59:02.679509606Z [2024-06-19 00:59:02,679: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T00:59:02.697283512Z [2024-06-19 00:59:02,696: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T00:59:02.721748635Z [2024-06-19 00:59:02,721: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T00:59:02.728467499Z [2024-06-19 00:59:02,728: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T00:59:02.730476407Z [2024-06-19 00:59:02,730: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T00:59:02.730709232Z [2024-06-19 00:59:02,730: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T00:59:02.730849240Z [2024-06-19 00:59:02,730: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T00:59:02.731169077Z [2024-06-19 00:59:02,731: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T00:59:02.731390050Z [2024-06-19 00:59:02,731: INFO/ForkPoolWorker-15] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T00:59:02.815418809Z [2024-06-19 00:59:02,815: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T00:59:04.436003328Z [2024-06-19 00:59:04,435: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[aa679fb4-43b0-4e3d-ad99-b6259b76cf91] succeeded in 3.582487186000435s: None 2024-06-19T00:59:04.920227228Z [2024-06-19 00:59:04,919: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2e093756-5530-4c7c-b034-6c1f081af19f] succeeded in 4.065144959999088s: None 2024-06-19T01:00:00.939504366Z [2024-06-19 01:00:00,939: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6f404227-4c0f-4fd4-919a-693eee82f492] received 2024-06-19T01:00:00.946559626Z [2024-06-19 01:00:00,946: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a34ab4e4-ca11-41ab-865e-c69532ce6252] received 2024-06-19T01:00:00.948925028Z [2024-06-19 01:00:00,948: INFO/ForkPoolWorker-15] [6f404227-4c0f-4fd4-919a-693eee82f492] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-19T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T01:00:00.951045994Z [2024-06-19 01:00:00,950: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[272b2ab9-e2e3-4c1e-8026-a98daecfa6f6] received 2024-06-19T01:00:00.955367488Z [2024-06-19 01:00:00,955: INFO/ForkPoolWorker-16] [a34ab4e4-ca11-41ab-865e-c69532ce6252] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-19T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-19T01:00:00.962523918Z [2024-06-19 01:00:00,962: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[428f0cfa-f2aa-403b-8079-9f6da272f0da] received 2024-06-19T01:00:00.968255170Z [2024-06-19 01:00:00,966: INFO/ForkPoolWorker-1] [272b2ab9-e2e3-4c1e-8026-a98daecfa6f6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T01:00:00.975297221Z [2024-06-19 01:00:00,974: INFO/ForkPoolWorker-2] [428f0cfa-f2aa-403b-8079-9f6da272f0da] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T01:00:00.982811761Z [2024-06-19 01:00:00,982: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[45475b61-85ed-418b-9744-8dd3cdf5ccb3] received 2024-06-19T01:00:01.003910732Z [2024-06-19 01:00:01,003: INFO/ForkPoolWorker-3] [45475b61-85ed-418b-9744-8dd3cdf5ccb3] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T00:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T01:00:01.373142203Z [2024-06-19 01:00:01,365: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T01:00:01.395670374Z [2024-06-19 01:00:01,389: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T01:00:01.402298436Z [2024-06-19 01:00:01,398: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T01:00:01.433038923Z [2024-06-19 01:00:01,427: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T01:00:01.541063794Z [2024-06-19 01:00:01,522: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-19T01:00:01.600946805Z [2024-06-19 01:00:01,600: INFO/ForkPoolWorker-3] Getting SDNC list 2024-06-19T01:00:01.605354582Z [2024-06-19 01:00:01,604: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:00:01.652604544Z [2024-06-19 01:00:01,652: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-06-19T01:00:01.656616186Z [2024-06-19 01:00:01,656: INFO/ForkPoolWorker-3] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T01:00:01.656656794Z [2024-06-19 01:00:01,656: INFO/ForkPoolWorker-3] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T01:00:01.656703105Z [2024-06-19 01:00:01,656: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-06-19T01:00:01.656940164Z [2024-06-19 01:00:01,656: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T01:00:01.793514691Z [2024-06-19 01:00:01,793: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:00:01.997028334Z [2024-06-19 01:00:01,996: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:00:02.603800528Z [2024-06-19 01:00:02,603: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[45475b61-85ed-418b-9744-8dd3cdf5ccb3] succeeded in 1.6184821919996466s: None 2024-06-19T01:00:02.897741985Z [2024-06-19 01:00:02,897: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a34ab4e4-ca11-41ab-865e-c69532ce6252] succeeded in 1.9490520210001705s: None 2024-06-19T01:00:02.955917048Z [2024-06-19 01:00:02,955: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-19T01:00:02.959704283Z [2024-06-19 01:00:02,959: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:00:02.983819428Z [2024-06-19 01:00:02,983: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T01:00:02.985212203Z [2024-06-19 01:00:02,984: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:00:02.985245061Z [2024-06-19 01:00:02,985: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:00:02.985395200Z [2024-06-19 01:00:02,985: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:00:02.985528079Z [2024-06-19 01:00:02,985: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-19T01:00:02.985704980Z [2024-06-19 01:00:02,985: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T01:00:02.985709178Z [2024-06-19 01:00:02,985: INFO/ForkPoolWorker-2] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:00:03.058524835Z [2024-06-19 01:00:03,058: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:00:03.221457123Z [2024-06-19 01:00:03,221: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T01:00:03.224823034Z [2024-06-19 01:00:03,224: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:00:03.243116244Z [2024-06-19 01:00:03,242: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T01:00:03.247030419Z [2024-06-19 01:00:03,246: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:00:03.247807722Z [2024-06-19 01:00:03,247: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T01:00:03.249126122Z [2024-06-19 01:00:03,248: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:00:03.249252687Z [2024-06-19 01:00:03,249: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:00:03.249411316Z [2024-06-19 01:00:03,249: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:00:03.249490689Z [2024-06-19 01:00:03,249: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T01:00:03.249765884Z [2024-06-19 01:00:03,249: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-06-19T01:00:03.250226684Z [2024-06-19 01:00:03,250: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:00:03.270740113Z [2024-06-19 01:00:03,270: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T01:00:03.272043091Z [2024-06-19 01:00:03,271: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:00:03.272140504Z [2024-06-19 01:00:03,271: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:00:03.272323879Z [2024-06-19 01:00:03,272: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:00:03.272384651Z [2024-06-19 01:00:03,272: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T01:00:03.272708876Z [2024-06-19 01:00:03,272: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T01:00:03.272822960Z [2024-06-19 01:00:03,272: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:00:03.361509068Z [2024-06-19 01:00:03,361: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:00:03.374315876Z [2024-06-19 01:00:03,373: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:00:04.027788762Z [2024-06-19 01:00:04,027: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6f404227-4c0f-4fd4-919a-693eee82f492] succeeded in 3.086104553000041s: None 2024-06-19T01:00:04.435512024Z [2024-06-19 01:00:04,434: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[428f0cfa-f2aa-403b-8079-9f6da272f0da] succeeded in 3.470768547998887s: None 2024-06-19T01:00:04.742404691Z [2024-06-19 01:00:04,742: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[50fc1d5c-60ee-4252-97c1-f88663e1dd8b] received 2024-06-19T01:00:04.753083337Z [2024-06-19 01:00:04,752: INFO/ForkPoolWorker-15] [50fc1d5c-60ee-4252-97c1-f88663e1dd8b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'split_metrics', 'scheduled__2024-06-19T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T01:00:05.019793188Z [2024-06-19 01:00:05,016: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T01:00:05.273102082Z [2024-06-19 01:00:05,271: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[272b2ab9-e2e3-4c1e-8026-a98daecfa6f6] succeeded in 4.31704887900014s: None 2024-06-19T01:00:06.159635396Z [2024-06-19 01:00:06,159: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T01:00:06.162781601Z [2024-06-19 01:00:06,162: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:00:06.188344788Z [2024-06-19 01:00:06,188: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T01:00:06.189964114Z [2024-06-19 01:00:06,189: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:00:06.190147520Z [2024-06-19 01:00:06,190: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:00:06.190304630Z [2024-06-19 01:00:06,190: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:00:06.190430660Z [2024-06-19 01:00:06,190: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T01:00:06.190656254Z [2024-06-19 01:00:06,190: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T01:00:06.190809278Z [2024-06-19 01:00:06,190: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:00:06.262814390Z [2024-06-19 01:00:06,262: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:00:06.922524423Z [2024-06-19 01:00:06,922: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[50fc1d5c-60ee-4252-97c1-f88663e1dd8b] succeeded in 2.1781570320017636s: None 2024-06-19T01:00:07.150015008Z [2024-06-19 01:00:07,149: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[712db822-7739-4be7-9b30-e57c13095646] received 2024-06-19T01:00:07.158736009Z [2024-06-19 01:00:07,158: INFO/ForkPoolWorker-15] [712db822-7739-4be7-9b30-e57c13095646] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'collect_metrics', 'scheduled__2024-06-19T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-19T01:00:07.432767129Z [2024-06-19 01:00:07,429: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T01:00:08.494770123Z [2024-06-19 01:00:08,494: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T01:00:08.497877940Z [2024-06-19 01:00:08,497: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:00:08.521928338Z [2024-06-19 01:00:08,521: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T01:00:08.523417521Z [2024-06-19 01:00:08,523: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:00:08.523432369Z [2024-06-19 01:00:08,523: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:00:08.523517826Z [2024-06-19 01:00:08,523: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:00:08.523566860Z [2024-06-19 01:00:08,523: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T01:00:08.523869849Z [2024-06-19 01:00:08,523: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T01:00:08.523892449Z [2024-06-19 01:00:08,523: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:00:08.614960004Z [2024-06-19 01:00:08,614: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:00:09.165530688Z [2024-06-19 01:00:09,165: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[712db822-7739-4be7-9b30-e57c13095646] succeeded in 2.0127395460003754s: None 2024-06-19T01:00:09.528422701Z [2024-06-19 01:00:09,528: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c4384e48-1d79-44ac-abd6-0da16d3f9e0b] received 2024-06-19T01:00:09.541431521Z [2024-06-19 01:00:09,540: INFO/ForkPoolWorker-15] [c4384e48-1d79-44ac-abd6-0da16d3f9e0b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'send_prometheus', 'scheduled__2024-06-19T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T01:00:09.810507626Z [2024-06-19 01:00:09,807: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T01:00:10.845517532Z [2024-06-19 01:00:10,845: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T01:00:10.848624114Z [2024-06-19 01:00:10,848: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:00:10.871525172Z [2024-06-19 01:00:10,871: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T01:00:10.874658736Z [2024-06-19 01:00:10,874: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:00:10.874943759Z [2024-06-19 01:00:10,874: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:00:10.875326878Z [2024-06-19 01:00:10,874: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:00:10.875415561Z [2024-06-19 01:00:10,875: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T01:00:10.876270764Z [2024-06-19 01:00:10,875: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T01:00:10.876349621Z [2024-06-19 01:00:10,876: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:00:10.974746446Z [2024-06-19 01:00:10,974: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:00:11.572479901Z [2024-06-19 01:00:11,571: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c4384e48-1d79-44ac-abd6-0da16d3f9e0b] succeeded in 2.0387246379996213s: None 2024-06-19T01:01:00.941457184Z [2024-06-19 01:01:00,936: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[423cecc1-ce38-4e57-813e-d7a496851957] received 2024-06-19T01:01:00.941518617Z [2024-06-19 01:01:00,939: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0bfa92cd-14d4-4b70-adcd-024b69ac75a6] received 2024-06-19T01:01:00.944256188Z [2024-06-19 01:01:00,944: INFO/ForkPoolWorker-15] [423cecc1-ce38-4e57-813e-d7a496851957] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T01:01:00.946255786Z [2024-06-19 01:01:00,946: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a4529823-cd33-4f6e-ac70-5c443bbda634] received 2024-06-19T01:01:00.949486000Z [2024-06-19 01:01:00,949: INFO/ForkPoolWorker-16] [0bfa92cd-14d4-4b70-adcd-024b69ac75a6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T01:01:00.961083520Z [2024-06-19 01:01:00,960: INFO/ForkPoolWorker-1] [a4529823-cd33-4f6e-ac70-5c443bbda634] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T01:01:01.246863705Z [2024-06-19 01:01:01,242: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T01:01:01.251927519Z [2024-06-19 01:01:01,248: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T01:01:01.319788075Z [2024-06-19 01:01:01,316: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T01:01:01.504340359Z [2024-06-19 01:01:01,503: INFO/ForkPoolWorker-1] Getting SDNC list 2024-06-19T01:01:01.510386779Z [2024-06-19 01:01:01,509: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:01:01.538321550Z [2024-06-19 01:01:01,538: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T01:01:01.540049827Z [2024-06-19 01:01:01,539: INFO/ForkPoolWorker-1] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T01:01:01.540290904Z [2024-06-19 01:01:01,539: INFO/ForkPoolWorker-1] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T01:01:01.540366399Z [2024-06-19 01:01:01,540: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-06-19T01:01:01.540641548Z [2024-06-19 01:01:01,540: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T01:01:01.688404588Z [2024-06-19 01:01:01,688: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:01:02.308218848Z [2024-06-19 01:01:02,307: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a4529823-cd33-4f6e-ac70-5c443bbda634] succeeded in 1.3601707960006024s: None 2024-06-19T01:01:02.431487197Z [2024-06-19 01:01:02,431: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T01:01:02.434618284Z [2024-06-19 01:01:02,434: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:01:02.455585307Z [2024-06-19 01:01:02,455: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T01:01:02.456906874Z [2024-06-19 01:01:02,456: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:01:02.456927516Z [2024-06-19 01:01:02,456: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:01:02.457075770Z [2024-06-19 01:01:02,456: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:01:02.457119909Z [2024-06-19 01:01:02,457: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T01:01:02.457415332Z [2024-06-19 01:01:02,457: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-06-19T01:01:02.457523369Z [2024-06-19 01:01:02,457: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:01:02.515534876Z [2024-06-19 01:01:02,515: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T01:01:02.519602975Z [2024-06-19 01:01:02,519: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:01:02.530551604Z [2024-06-19 01:01:02,530: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:01:02.538136533Z [2024-06-19 01:01:02,537: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T01:01:02.541008190Z [2024-06-19 01:01:02,540: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:01:02.541156026Z [2024-06-19 01:01:02,541: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:01:02.541312345Z [2024-06-19 01:01:02,541: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:01:02.542010189Z [2024-06-19 01:01:02,541: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T01:01:02.542357150Z [2024-06-19 01:01:02,542: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T01:01:02.542459452Z [2024-06-19 01:01:02,542: INFO/ForkPoolWorker-16] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:01:02.630832909Z [2024-06-19 01:01:02,630: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:01:04.124044995Z [2024-06-19 01:01:04,123: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0bfa92cd-14d4-4b70-adcd-024b69ac75a6] succeeded in 3.1807156830000167s: None 2024-06-19T01:01:04.409806405Z [2024-06-19 01:01:04,408: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[423cecc1-ce38-4e57-813e-d7a496851957] succeeded in 3.470422516000326s: None 2024-06-19T01:02:00.429591975Z [2024-06-19 01:02:00,429: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b449355a-dd51-4305-84f0-1ac8fd929d20] received 2024-06-19T01:02:00.437338691Z [2024-06-19 01:02:00,436: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e47da918-da27-45fa-a2bd-76f87f486ed4] received 2024-06-19T01:02:00.441655304Z [2024-06-19 01:02:00,441: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c4870946-8846-4573-b2ad-a02f9cf89f07] received 2024-06-19T01:02:00.443184984Z [2024-06-19 01:02:00,442: INFO/ForkPoolWorker-15] [b449355a-dd51-4305-84f0-1ac8fd929d20] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-19T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-19T01:02:00.445826785Z [2024-06-19 01:02:00,445: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[27a05737-5cd6-4a54-9d9a-437214139217] received 2024-06-19T01:02:00.458322827Z [2024-06-19 01:02:00,457: INFO/ForkPoolWorker-2] [27a05737-5cd6-4a54-9d9a-437214139217] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T01:02:00.462662696Z [2024-06-19 01:02:00,462: INFO/ForkPoolWorker-1] [c4870946-8846-4573-b2ad-a02f9cf89f07] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T01:02:00.464266277Z [2024-06-19 01:02:00,463: INFO/ForkPoolWorker-16] [e47da918-da27-45fa-a2bd-76f87f486ed4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T01:02:00.726854739Z [2024-06-19 01:02:00,721: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-19T01:02:00.809038932Z [2024-06-19 01:02:00,805: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T01:02:00.895605702Z [2024-06-19 01:02:00,892: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T01:02:00.899777461Z [2024-06-19 01:02:00,896: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T01:02:01.060417588Z [2024-06-19 01:02:01,060: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:02:01.095315298Z [2024-06-19 01:02:01,092: INFO/ForkPoolWorker-2] Getting SDNC list 2024-06-19T01:02:01.101534060Z [2024-06-19 01:02:01,101: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:02:01.127119772Z [2024-06-19 01:02:01,126: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T01:02:01.128206778Z [2024-06-19 01:02:01,128: INFO/ForkPoolWorker-2] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T01:02:01.128387021Z [2024-06-19 01:02:01,128: INFO/ForkPoolWorker-2] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T01:02:01.128559186Z [2024-06-19 01:02:01,128: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-06-19T01:02:01.128775934Z [2024-06-19 01:02:01,128: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T01:02:01.243789593Z [2024-06-19 01:02:01,243: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:02:01.715930063Z [2024-06-19 01:02:01,715: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b449355a-dd51-4305-84f0-1ac8fd929d20] succeeded in 1.2819859869996435s: None 2024-06-19T01:02:01.828291336Z [2024-06-19 01:02:01,827: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[27a05737-5cd6-4a54-9d9a-437214139217] succeeded in 1.3803800009991392s: None 2024-06-19T01:02:02.101199757Z [2024-06-19 01:02:02,100: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T01:02:02.105471668Z [2024-06-19 01:02:02,104: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:02:02.118591611Z [2024-06-19 01:02:02,118: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T01:02:02.122407116Z [2024-06-19 01:02:02,122: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:02:02.132762756Z [2024-06-19 01:02:02,132: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T01:02:02.135072733Z [2024-06-19 01:02:02,134: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:02:02.135178530Z [2024-06-19 01:02:02,135: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:02:02.135554623Z [2024-06-19 01:02:02,135: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:02:02.135691744Z [2024-06-19 01:02:02,135: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T01:02:02.136186287Z [2024-06-19 01:02:02,135: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-19T01:02:02.136309306Z [2024-06-19 01:02:02,136: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:02:02.147312077Z [2024-06-19 01:02:02,147: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T01:02:02.148419359Z [2024-06-19 01:02:02,148: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:02:02.148430404Z [2024-06-19 01:02:02,148: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:02:02.148581214Z [2024-06-19 01:02:02,148: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:02:02.148636329Z [2024-06-19 01:02:02,148: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T01:02:02.148989255Z [2024-06-19 01:02:02,148: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T01:02:02.149033920Z [2024-06-19 01:02:02,148: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:02:02.279912107Z [2024-06-19 01:02:02,277: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:02:02.286748647Z [2024-06-19 01:02:02,286: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:02:03.774330905Z [2024-06-19 01:02:03,773: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c4870946-8846-4573-b2ad-a02f9cf89f07] succeeded in 3.3306337279991567s: None 2024-06-19T01:02:04.135615561Z [2024-06-19 01:02:04,133: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e47da918-da27-45fa-a2bd-76f87f486ed4] succeeded in 3.6935619359992415s: None 2024-06-19T01:03:00.240937365Z [2024-06-19 01:03:00,240: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[75279b3a-5386-4c66-921d-0d91be451702] received 2024-06-19T01:03:00.249410116Z [2024-06-19 01:03:00,249: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[25ed1af1-1f7d-41a3-b470-45c4e0ee0cbf] received 2024-06-19T01:03:00.251325404Z [2024-06-19 01:03:00,251: INFO/ForkPoolWorker-15] [75279b3a-5386-4c66-921d-0d91be451702] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T01:03:00.251352154Z [2024-06-19 01:03:00,251: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[735817f5-07a6-46e1-a0ce-43fa6da7b543] received 2024-06-19T01:03:00.265170676Z [2024-06-19 01:03:00,264: INFO/ForkPoolWorker-1] [735817f5-07a6-46e1-a0ce-43fa6da7b543] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T01:03:00.267180818Z [2024-06-19 01:03:00,266: INFO/ForkPoolWorker-16] [25ed1af1-1f7d-41a3-b470-45c4e0ee0cbf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T01:03:00.550654734Z [2024-06-19 01:03:00,547: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T01:03:00.552826364Z [2024-06-19 01:03:00,549: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T01:03:00.570800455Z [2024-06-19 01:03:00,563: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T01:03:00.738028899Z [2024-06-19 01:03:00,737: INFO/ForkPoolWorker-1] Getting SDNC list 2024-06-19T01:03:00.741979370Z [2024-06-19 01:03:00,741: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:03:00.773028668Z [2024-06-19 01:03:00,772: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T01:03:00.774700943Z [2024-06-19 01:03:00,774: INFO/ForkPoolWorker-1] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T01:03:00.774816931Z [2024-06-19 01:03:00,774: INFO/ForkPoolWorker-1] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T01:03:00.774890735Z [2024-06-19 01:03:00,774: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-06-19T01:03:00.775114503Z [2024-06-19 01:03:00,774: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T01:03:00.883007734Z [2024-06-19 01:03:00,882: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:03:01.433385252Z [2024-06-19 01:03:01,432: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[735817f5-07a6-46e1-a0ce-43fa6da7b543] succeeded in 1.1788200249993679s: None 2024-06-19T01:03:01.708385892Z [2024-06-19 01:03:01,707: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T01:03:01.712901988Z [2024-06-19 01:03:01,712: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:03:01.718338498Z [2024-06-19 01:03:01,717: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T01:03:01.722154516Z [2024-06-19 01:03:01,721: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:03:01.732066920Z [2024-06-19 01:03:01,731: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T01:03:01.733182385Z [2024-06-19 01:03:01,732: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:03:01.733201814Z [2024-06-19 01:03:01,733: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:03:01.733332193Z [2024-06-19 01:03:01,733: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:03:01.733367669Z [2024-06-19 01:03:01,733: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T01:03:01.733655739Z [2024-06-19 01:03:01,733: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-06-19T01:03:01.733710021Z [2024-06-19 01:03:01,733: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:03:01.741674199Z [2024-06-19 01:03:01,741: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T01:03:01.743865796Z [2024-06-19 01:03:01,743: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:03:01.744020547Z [2024-06-19 01:03:01,743: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:03:01.744197496Z [2024-06-19 01:03:01,743: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:03:01.744276813Z [2024-06-19 01:03:01,744: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T01:03:01.744601030Z [2024-06-19 01:03:01,744: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T01:03:01.744713021Z [2024-06-19 01:03:01,744: INFO/ForkPoolWorker-16] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:03:01.815860895Z [2024-06-19 01:03:01,815: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:03:01.873956514Z [2024-06-19 01:03:01,873: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:03:03.475799636Z [2024-06-19 01:03:03,475: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[25ed1af1-1f7d-41a3-b470-45c4e0ee0cbf] succeeded in 3.222967683001116s: None 2024-06-19T01:03:03.911334256Z [2024-06-19 01:03:03,910: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[75279b3a-5386-4c66-921d-0d91be451702] succeeded in 3.6665452099987306s: None 2024-06-19T01:04:00.254283189Z [2024-06-19 01:04:00,253: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[72d09366-0376-42f4-a2aa-58085d2306cc] received 2024-06-19T01:04:00.258746866Z [2024-06-19 01:04:00,258: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f65c348e-e1c6-467c-8bd8-c1ec49fe7920] received 2024-06-19T01:04:00.266497775Z [2024-06-19 01:04:00,266: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ea0be6b7-d080-4b1f-8fca-4c836efe2887] received 2024-06-19T01:04:00.269547670Z [2024-06-19 01:04:00,269: INFO/ForkPoolWorker-15] [72d09366-0376-42f4-a2aa-58085d2306cc] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-19T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-19T01:04:00.274248875Z [2024-06-19 01:04:00,273: INFO/ForkPoolWorker-16] [f65c348e-e1c6-467c-8bd8-c1ec49fe7920] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T01:04:00.283210225Z [2024-06-19 01:04:00,282: INFO/ForkPoolWorker-1] [ea0be6b7-d080-4b1f-8fca-4c836efe2887] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T01:04:00.287941102Z [2024-06-19 01:04:00,287: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[57a18324-4cc6-4ade-9dfa-e24793d53ff2] received 2024-06-19T01:04:00.317895608Z [2024-06-19 01:04:00,317: INFO/ForkPoolWorker-2] [57a18324-4cc6-4ade-9dfa-e24793d53ff2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T01:04:00.615548204Z [2024-06-19 01:04:00,612: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T01:04:00.718032582Z [2024-06-19 01:04:00,713: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T01:04:00.769368778Z [2024-06-19 01:04:00,768: INFO/ForkPoolWorker-2] Getting SDNC list 2024-06-19T01:04:00.773207526Z [2024-06-19 01:04:00,772: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:04:00.781368390Z [2024-06-19 01:04:00,775: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T01:04:00.810260378Z [2024-06-19 01:04:00,810: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T01:04:00.811751229Z [2024-06-19 01:04:00,811: INFO/ForkPoolWorker-2] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T01:04:00.812151301Z [2024-06-19 01:04:00,811: INFO/ForkPoolWorker-2] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T01:04:00.812319801Z [2024-06-19 01:04:00,812: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-06-19T01:04:00.812646653Z [2024-06-19 01:04:00,812: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T01:04:00.845576151Z [2024-06-19 01:04:00,826: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-19T01:04:00.918379468Z [2024-06-19 01:04:00,918: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:04:01.147828602Z [2024-06-19 01:04:01,147: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:04:01.553228170Z [2024-06-19 01:04:01,552: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[57a18324-4cc6-4ade-9dfa-e24793d53ff2] succeeded in 1.2615564379993884s: None 2024-06-19T01:04:01.730207721Z [2024-06-19 01:04:01,729: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[72d09366-0376-42f4-a2aa-58085d2306cc] succeeded in 1.4731465469994873s: None 2024-06-19T01:04:01.931017710Z [2024-06-19 01:04:01,930: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T01:04:01.934223455Z [2024-06-19 01:04:01,933: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:04:01.956828016Z [2024-06-19 01:04:01,956: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T01:04:01.958303957Z [2024-06-19 01:04:01,958: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:04:01.958318723Z [2024-06-19 01:04:01,958: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:04:01.958492240Z [2024-06-19 01:04:01,958: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:04:01.958567917Z [2024-06-19 01:04:01,958: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T01:04:01.958901510Z [2024-06-19 01:04:01,958: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T01:04:01.959002894Z [2024-06-19 01:04:01,958: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:04:02.064098934Z [2024-06-19 01:04:02,063: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:04:02.350688626Z [2024-06-19 01:04:02,350: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T01:04:02.356243131Z [2024-06-19 01:04:02,355: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:04:02.384424125Z [2024-06-19 01:04:02,384: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T01:04:02.386126114Z [2024-06-19 01:04:02,385: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:04:02.386254963Z [2024-06-19 01:04:02,386: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:04:02.386415749Z [2024-06-19 01:04:02,386: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:04:02.386527031Z [2024-06-19 01:04:02,386: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T01:04:02.386771068Z [2024-06-19 01:04:02,386: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-19T01:04:02.387209886Z [2024-06-19 01:04:02,386: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:04:02.475531289Z [2024-06-19 01:04:02,475: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:04:03.629907167Z [2024-06-19 01:04:03,628: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ea0be6b7-d080-4b1f-8fca-4c836efe2887] succeeded in 3.357749380000314s: None 2024-06-19T01:04:04.447354134Z [2024-06-19 01:04:04,446: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f65c348e-e1c6-467c-8bd8-c1ec49fe7920] succeeded in 4.185883445001309s: None 2024-06-19T01:05:00.290147344Z [2024-06-19 01:05:00,289: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8ab406ca-0339-4645-a08b-08c1a1e7954e] received 2024-06-19T01:05:00.297377943Z [2024-06-19 01:05:00,297: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[21d1c8b6-7dbc-4cfb-aee6-a24dc5d19b5d] received 2024-06-19T01:05:00.299126266Z [2024-06-19 01:05:00,298: INFO/ForkPoolWorker-15] [8ab406ca-0339-4645-a08b-08c1a1e7954e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-19T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T01:05:00.300094465Z [2024-06-19 01:05:00,299: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[90850407-27ee-496a-bc9d-138c395ad2a8] received 2024-06-19T01:05:00.306654105Z [2024-06-19 01:05:00,306: INFO/ForkPoolWorker-1] [90850407-27ee-496a-bc9d-138c395ad2a8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T01:05:00.312916502Z [2024-06-19 01:05:00,312: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[024e217f-65d0-4962-b564-b6061799b66f] received 2024-06-19T01:05:00.314137779Z [2024-06-19 01:05:00,313: INFO/ForkPoolWorker-16] [21d1c8b6-7dbc-4cfb-aee6-a24dc5d19b5d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T01:05:00.319485577Z [2024-06-19 01:05:00,319: INFO/ForkPoolWorker-2] [024e217f-65d0-4962-b564-b6061799b66f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T01:05:00.611490671Z [2024-06-19 01:05:00,607: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T01:05:00.679672643Z [2024-06-19 01:05:00,676: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T01:05:00.693774001Z [2024-06-19 01:05:00,690: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T01:05:00.831871377Z [2024-06-19 01:05:00,815: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T01:05:00.922998237Z [2024-06-19 01:05:00,922: INFO/ForkPoolWorker-2] Getting SDNC list 2024-06-19T01:05:00.926660341Z [2024-06-19 01:05:00,926: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:05:00.947406961Z [2024-06-19 01:05:00,947: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T01:05:00.948438249Z [2024-06-19 01:05:00,948: INFO/ForkPoolWorker-2] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T01:05:00.948612799Z [2024-06-19 01:05:00,948: INFO/ForkPoolWorker-2] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T01:05:00.948688711Z [2024-06-19 01:05:00,948: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-06-19T01:05:00.949148732Z [2024-06-19 01:05:00,949: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T01:05:01.033365081Z [2024-06-19 01:05:01,033: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:05:01.570968661Z [2024-06-19 01:05:01,570: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[024e217f-65d0-4962-b564-b6061799b66f] succeeded in 1.2566010970003845s: None 2024-06-19T01:05:01.962145177Z [2024-06-19 01:05:01,961: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T01:05:01.965958675Z [2024-06-19 01:05:01,965: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:05:01.970111590Z [2024-06-19 01:05:01,969: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T01:05:01.976977871Z [2024-06-19 01:05:01,976: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:05:02.004975531Z [2024-06-19 01:05:02,004: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T01:05:02.008529209Z [2024-06-19 01:05:02,008: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T01:05:02.008761544Z [2024-06-19 01:05:02,008: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:05:02.008835388Z [2024-06-19 01:05:02,008: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:05:02.009013857Z [2024-06-19 01:05:02,008: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:05:02.009081684Z [2024-06-19 01:05:02,009: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T01:05:02.009321592Z [2024-06-19 01:05:02,009: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-19T01:05:02.009660632Z [2024-06-19 01:05:02,009: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:05:02.009942846Z [2024-06-19 01:05:02,009: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:05:02.010134128Z [2024-06-19 01:05:02,009: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:05:02.010167693Z [2024-06-19 01:05:02,010: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:05:02.010258152Z [2024-06-19 01:05:02,010: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T01:05:02.010492659Z [2024-06-19 01:05:02,010: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T01:05:02.010556662Z [2024-06-19 01:05:02,010: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:05:02.104301113Z [2024-06-19 01:05:02,104: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:05:02.107193219Z [2024-06-19 01:05:02,106: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:05:02.129642130Z [2024-06-19 01:05:02,129: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T01:05:02.132743873Z [2024-06-19 01:05:02,132: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:05:02.160599320Z [2024-06-19 01:05:02,160: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T01:05:02.162200328Z [2024-06-19 01:05:02,161: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:05:02.162214230Z [2024-06-19 01:05:02,162: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:05:02.162379690Z [2024-06-19 01:05:02,162: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:05:02.162431798Z [2024-06-19 01:05:02,162: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T01:05:02.162695236Z [2024-06-19 01:05:02,162: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T01:05:02.162701387Z [2024-06-19 01:05:02,162: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:05:02.256969058Z [2024-06-19 01:05:02,256: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:05:02.749644936Z [2024-06-19 01:05:02,748: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8ab406ca-0339-4645-a08b-08c1a1e7954e] succeeded in 2.455914665000819s: None 2024-06-19T01:05:03.112355127Z [2024-06-19 01:05:03,112: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3dcd9009-1df8-410c-b70e-e77fdaf6664a] received 2024-06-19T01:05:03.122536298Z [2024-06-19 01:05:03,122: INFO/ForkPoolWorker-15] [3dcd9009-1df8-410c-b70e-e77fdaf6664a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'split_metrics', 'scheduled__2024-06-19T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T01:05:03.418871221Z [2024-06-19 01:05:03,415: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T01:05:03.791453855Z [2024-06-19 01:05:03,791: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[90850407-27ee-496a-bc9d-138c395ad2a8] succeeded in 3.489763124000092s: None 2024-06-19T01:05:04.052159335Z [2024-06-19 01:05:04,051: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[21d1c8b6-7dbc-4cfb-aee6-a24dc5d19b5d] succeeded in 3.7514186190001055s: None 2024-06-19T01:05:04.523436421Z [2024-06-19 01:05:04,522: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T01:05:04.526457925Z [2024-06-19 01:05:04,525: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:05:04.551454662Z [2024-06-19 01:05:04,551: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T01:05:04.552882763Z [2024-06-19 01:05:04,552: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:05:04.552898485Z [2024-06-19 01:05:04,552: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:05:04.553077044Z [2024-06-19 01:05:04,552: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:05:04.553090039Z [2024-06-19 01:05:04,552: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T01:05:04.553340337Z [2024-06-19 01:05:04,553: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T01:05:04.553351985Z [2024-06-19 01:05:04,553: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:05:04.667168986Z [2024-06-19 01:05:04,666: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:05:05.375379965Z [2024-06-19 01:05:05,374: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3dcd9009-1df8-410c-b70e-e77fdaf6664a] succeeded in 2.2607021419989906s: None 2024-06-19T01:05:05.466366561Z [2024-06-19 01:05:05,466: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d458e4bb-da5b-4d65-adc4-7da6181eb365] received 2024-06-19T01:05:05.473614368Z [2024-06-19 01:05:05,473: INFO/ForkPoolWorker-15] [d458e4bb-da5b-4d65-adc4-7da6181eb365] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'collect_metrics', 'scheduled__2024-06-19T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-19T01:05:05.824187350Z [2024-06-19 01:05:05,820: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T01:05:06.913320679Z [2024-06-19 01:05:06,912: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T01:05:06.916317074Z [2024-06-19 01:05:06,915: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:05:06.939019638Z [2024-06-19 01:05:06,938: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T01:05:06.940619429Z [2024-06-19 01:05:06,940: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:05:06.940642511Z [2024-06-19 01:05:06,940: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:05:06.940749149Z [2024-06-19 01:05:06,940: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:05:06.940759034Z [2024-06-19 01:05:06,940: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T01:05:06.941037273Z [2024-06-19 01:05:06,940: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T01:05:06.941577899Z [2024-06-19 01:05:06,940: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:05:07.073716499Z [2024-06-19 01:05:07,073: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:05:07.691185155Z [2024-06-19 01:05:07,690: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d458e4bb-da5b-4d65-adc4-7da6181eb365] succeeded in 2.2229416760001186s: None 2024-06-19T01:05:07.808194965Z [2024-06-19 01:05:07,807: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5eae8819-c5b6-438f-b6f5-c3a6be805787] received 2024-06-19T01:05:07.816667196Z [2024-06-19 01:05:07,816: INFO/ForkPoolWorker-15] [5eae8819-c5b6-438f-b6f5-c3a6be805787] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'send_prometheus', 'scheduled__2024-06-19T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T01:05:08.119415750Z [2024-06-19 01:05:08,116: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T01:05:09.318094115Z [2024-06-19 01:05:09,317: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T01:05:09.322470052Z [2024-06-19 01:05:09,321: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:05:09.352268426Z [2024-06-19 01:05:09,351: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T01:05:09.354529822Z [2024-06-19 01:05:09,353: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:05:09.354594933Z [2024-06-19 01:05:09,354: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:05:09.354708628Z [2024-06-19 01:05:09,354: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:05:09.354869523Z [2024-06-19 01:05:09,354: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T01:05:09.355545656Z [2024-06-19 01:05:09,355: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T01:05:09.355618183Z [2024-06-19 01:05:09,355: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:05:09.467644921Z [2024-06-19 01:05:09,467: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:05:10.130904137Z [2024-06-19 01:05:10,130: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5eae8819-c5b6-438f-b6f5-c3a6be805787] succeeded in 2.3209367219988053s: None 2024-06-19T01:06:01.033379627Z [2024-06-19 01:06:01,032: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e16c9e10-cffc-4738-9522-9904e3567d7e] received 2024-06-19T01:06:01.035074617Z [2024-06-19 01:06:01,034: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[323fde48-45d7-4e47-abb0-12309446331c] received 2024-06-19T01:06:01.046008748Z [2024-06-19 01:06:01,045: INFO/ForkPoolWorker-15] [e16c9e10-cffc-4738-9522-9904e3567d7e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-19T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-19T01:06:01.046259379Z [2024-06-19 01:06:01,045: INFO/ForkPoolWorker-16] [323fde48-45d7-4e47-abb0-12309446331c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T01:06:01.052498735Z [2024-06-19 01:06:01,052: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e06d3922-b244-42d4-82b7-13ed8d9bff2b] received 2024-06-19T01:06:01.053879225Z [2024-06-19 01:06:01,053: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ed094cf9-8bc7-4893-b796-c99c673b7e5d] received 2024-06-19T01:06:01.059808280Z [2024-06-19 01:06:01,059: INFO/ForkPoolWorker-1] [e06d3922-b244-42d4-82b7-13ed8d9bff2b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T01:06:01.063842966Z [2024-06-19 01:06:01,063: INFO/ForkPoolWorker-2] [ed094cf9-8bc7-4893-b796-c99c673b7e5d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T01:06:01.365341419Z [2024-06-19 01:06:01,362: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-19T01:06:01.375953105Z [2024-06-19 01:06:01,373: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T01:06:01.392430875Z [2024-06-19 01:06:01,385: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T01:06:01.398893210Z [2024-06-19 01:06:01,395: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T01:06:01.526941041Z [2024-06-19 01:06:01,526: INFO/ForkPoolWorker-2] Getting SDNC list 2024-06-19T01:06:01.530692953Z [2024-06-19 01:06:01,530: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:06:01.566329265Z [2024-06-19 01:06:01,566: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T01:06:01.568825581Z [2024-06-19 01:06:01,568: INFO/ForkPoolWorker-2] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T01:06:01.569027299Z [2024-06-19 01:06:01,568: INFO/ForkPoolWorker-2] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T01:06:01.569120931Z [2024-06-19 01:06:01,569: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-06-19T01:06:01.569445526Z [2024-06-19 01:06:01,569: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T01:06:01.627035089Z [2024-06-19 01:06:01,626: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:06:01.727794131Z [2024-06-19 01:06:01,727: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:06:02.210076581Z [2024-06-19 01:06:02,209: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e16c9e10-cffc-4738-9522-9904e3567d7e] succeeded in 1.1751953429993591s: None 2024-06-19T01:06:02.415375274Z [2024-06-19 01:06:02,414: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[ed094cf9-8bc7-4893-b796-c99c673b7e5d] succeeded in 1.3588804279988835s: None 2024-06-19T01:06:02.685382082Z [2024-06-19 01:06:02,684: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T01:06:02.688438009Z [2024-06-19 01:06:02,688: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:06:02.714660476Z [2024-06-19 01:06:02,714: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T01:06:02.716185764Z [2024-06-19 01:06:02,715: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:06:02.716219608Z [2024-06-19 01:06:02,716: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:06:02.716352958Z [2024-06-19 01:06:02,716: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:06:02.716412556Z [2024-06-19 01:06:02,716: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T01:06:02.716668334Z [2024-06-19 01:06:02,716: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T01:06:02.716840505Z [2024-06-19 01:06:02,716: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:06:02.830069211Z [2024-06-19 01:06:02,829: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:06:02.863340624Z [2024-06-19 01:06:02,862: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T01:06:02.867098063Z [2024-06-19 01:06:02,866: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:06:02.892690091Z [2024-06-19 01:06:02,892: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T01:06:02.894978133Z [2024-06-19 01:06:02,894: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:06:02.895333303Z [2024-06-19 01:06:02,895: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:06:02.895536073Z [2024-06-19 01:06:02,895: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:06:02.895603009Z [2024-06-19 01:06:02,895: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T01:06:02.895924541Z [2024-06-19 01:06:02,895: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-19T01:06:02.896001626Z [2024-06-19 01:06:02,895: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:06:03.025294327Z [2024-06-19 01:06:03,025: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:06:04.381130213Z [2024-06-19 01:06:04,380: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e06d3922-b244-42d4-82b7-13ed8d9bff2b] succeeded in 3.326904077001018s: None 2024-06-19T01:06:04.808446615Z [2024-06-19 01:06:04,807: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[323fde48-45d7-4e47-abb0-12309446331c] succeeded in 3.76961685400056s: None 2024-06-19T01:07:00.919619122Z [2024-06-19 01:07:00,919: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ff492158-2b87-494e-8f1d-55bd22f83e30] received 2024-06-19T01:07:00.932080839Z [2024-06-19 01:07:00,931: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d0e79dc7-2acd-4585-a3a9-10fab4ef59d3] received 2024-06-19T01:07:00.937606191Z [2024-06-19 01:07:00,936: INFO/ForkPoolWorker-15] [ff492158-2b87-494e-8f1d-55bd22f83e30] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T01:07:00.945075893Z [2024-06-19 01:07:00,944: INFO/ForkPoolWorker-16] [d0e79dc7-2acd-4585-a3a9-10fab4ef59d3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T01:07:00.946596112Z [2024-06-19 01:07:00,946: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8b20987f-b489-496f-87f8-abf749e0e252] received 2024-06-19T01:07:00.960538918Z [2024-06-19 01:07:00,960: INFO/ForkPoolWorker-1] [8b20987f-b489-496f-87f8-abf749e0e252] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T01:07:01.223831873Z [2024-06-19 01:07:01,220: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T01:07:01.238626938Z [2024-06-19 01:07:01,235: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T01:07:01.242263250Z [2024-06-19 01:07:01,239: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T01:07:01.416391845Z [2024-06-19 01:07:01,415: INFO/ForkPoolWorker-1] Getting SDNC list 2024-06-19T01:07:01.420275537Z [2024-06-19 01:07:01,419: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:07:01.446101872Z [2024-06-19 01:07:01,445: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T01:07:01.447266491Z [2024-06-19 01:07:01,447: INFO/ForkPoolWorker-1] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T01:07:01.447411108Z [2024-06-19 01:07:01,447: INFO/ForkPoolWorker-1] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T01:07:01.447568647Z [2024-06-19 01:07:01,447: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-06-19T01:07:01.447887034Z [2024-06-19 01:07:01,447: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T01:07:01.530828772Z [2024-06-19 01:07:01,530: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:07:02.154724335Z [2024-06-19 01:07:02,154: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8b20987f-b489-496f-87f8-abf749e0e252] succeeded in 1.2063121070004854s: None 2024-06-19T01:07:02.396011992Z [2024-06-19 01:07:02,391: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T01:07:02.399378134Z [2024-06-19 01:07:02,398: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:07:02.436890037Z [2024-06-19 01:07:02,436: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T01:07:02.439589140Z [2024-06-19 01:07:02,438: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:07:02.439878467Z [2024-06-19 01:07:02,439: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:07:02.440226054Z [2024-06-19 01:07:02,439: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:07:02.440417892Z [2024-06-19 01:07:02,440: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T01:07:02.440864250Z [2024-06-19 01:07:02,440: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T01:07:02.441118369Z [2024-06-19 01:07:02,440: INFO/ForkPoolWorker-16] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:07:02.492860173Z [2024-06-19 01:07:02,492: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T01:07:02.497017219Z [2024-06-19 01:07:02,496: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:07:02.519543970Z [2024-06-19 01:07:02,519: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T01:07:02.521716345Z [2024-06-19 01:07:02,521: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:07:02.521769612Z [2024-06-19 01:07:02,521: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:07:02.521822147Z [2024-06-19 01:07:02,521: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:07:02.521877960Z [2024-06-19 01:07:02,521: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T01:07:02.522057899Z [2024-06-19 01:07:02,521: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-06-19T01:07:02.522102924Z [2024-06-19 01:07:02,522: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:07:02.542831873Z [2024-06-19 01:07:02,542: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:07:02.608881388Z [2024-06-19 01:07:02,608: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:07:04.389508020Z [2024-06-19 01:07:04,388: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d0e79dc7-2acd-4585-a3a9-10fab4ef59d3] succeeded in 3.4550314150001213s: None 2024-06-19T01:07:05.337167580Z [2024-06-19 01:07:05,336: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ff492158-2b87-494e-8f1d-55bd22f83e30] succeeded in 4.412184568000157s: None 2024-06-19T01:08:00.861529774Z [2024-06-19 01:08:00,861: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e7aa77fe-bcb6-448c-8dec-faca26bb37aa] received 2024-06-19T01:08:00.866070372Z [2024-06-19 01:08:00,865: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[36259096-926d-49ce-8263-c648720ddb44] received 2024-06-19T01:08:00.869196066Z [2024-06-19 01:08:00,868: INFO/ForkPoolWorker-15] [e7aa77fe-bcb6-448c-8dec-faca26bb37aa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T01:08:00.876143419Z [2024-06-19 01:08:00,875: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[97ccae1c-9345-42b2-9f93-ce82135118bb] received 2024-06-19T01:08:00.877574479Z [2024-06-19 01:08:00,877: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[045fff7a-1264-40bf-89db-a5d3bf92f662] received 2024-06-19T01:08:00.882591742Z [2024-06-19 01:08:00,882: INFO/ForkPoolWorker-16] [36259096-926d-49ce-8263-c648720ddb44] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-19T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-19T01:08:00.889537955Z [2024-06-19 01:08:00,889: INFO/ForkPoolWorker-1] [97ccae1c-9345-42b2-9f93-ce82135118bb] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T01:08:00.913390371Z [2024-06-19 01:08:00,913: INFO/ForkPoolWorker-2] [045fff7a-1264-40bf-89db-a5d3bf92f662] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T01:08:01.244716814Z [2024-06-19 01:08:01,240: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-19T01:08:01.290476436Z [2024-06-19 01:08:01,287: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T01:08:01.300050584Z [2024-06-19 01:08:01,296: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T01:08:01.468626566Z [2024-06-19 01:08:01,468: INFO/ForkPoolWorker-1] Getting SDNC list 2024-06-19T01:08:01.473472469Z [2024-06-19 01:08:01,473: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:08:01.502390219Z [2024-06-19 01:08:01,483: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T01:08:01.505811278Z [2024-06-19 01:08:01,505: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T01:08:01.507111965Z [2024-06-19 01:08:01,506: INFO/ForkPoolWorker-1] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T01:08:01.507367817Z [2024-06-19 01:08:01,507: INFO/ForkPoolWorker-1] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T01:08:01.507673955Z [2024-06-19 01:08:01,507: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-06-19T01:08:01.508052579Z [2024-06-19 01:08:01,507: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T01:08:01.509401525Z [2024-06-19 01:08:01,509: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:08:01.599740043Z [2024-06-19 01:08:01,599: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:08:02.370050244Z [2024-06-19 01:08:02,369: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[97ccae1c-9345-42b2-9f93-ce82135118bb] succeeded in 1.492271704999439s: None 2024-06-19T01:08:02.395018289Z [2024-06-19 01:08:02,394: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[36259096-926d-49ce-8263-c648720ddb44] succeeded in 1.5266123019991937s: None 2024-06-19T01:08:02.785024502Z [2024-06-19 01:08:02,784: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-19T01:08:02.788311673Z [2024-06-19 01:08:02,787: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:08:02.811035339Z [2024-06-19 01:08:02,810: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T01:08:02.812182052Z [2024-06-19 01:08:02,812: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:08:02.812360446Z [2024-06-19 01:08:02,812: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:08:02.812516867Z [2024-06-19 01:08:02,812: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:08:02.812588297Z [2024-06-19 01:08:02,812: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-19T01:08:02.813068500Z [2024-06-19 01:08:02,812: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-06-19T01:08:02.813137225Z [2024-06-19 01:08:02,813: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:08:02.899150662Z [2024-06-19 01:08:02,898: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:08:03.144896750Z [2024-06-19 01:08:03,144: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T01:08:03.148063122Z [2024-06-19 01:08:03,147: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:08:03.177633094Z [2024-06-19 01:08:03,177: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T01:08:03.178740219Z [2024-06-19 01:08:03,178: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:08:03.178809300Z [2024-06-19 01:08:03,178: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:08:03.178963860Z [2024-06-19 01:08:03,178: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:08:03.179049897Z [2024-06-19 01:08:03,178: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T01:08:03.179316884Z [2024-06-19 01:08:03,179: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T01:08:03.179434071Z [2024-06-19 01:08:03,179: INFO/ForkPoolWorker-15] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:08:03.273564740Z [2024-06-19 01:08:03,273: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:08:04.822118147Z [2024-06-19 01:08:04,821: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[045fff7a-1264-40bf-89db-a5d3bf92f662] succeeded in 3.9424938690008275s: None 2024-06-19T01:08:05.264059491Z [2024-06-19 01:08:05,263: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e7aa77fe-bcb6-448c-8dec-faca26bb37aa] succeeded in 4.400901445000272s: None 2024-06-19T01:09:00.738067159Z [2024-06-19 01:09:00,737: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1bdca84c-c656-4d15-97d6-1d0d30892d5b] received 2024-06-19T01:09:00.745168600Z [2024-06-19 01:09:00,744: INFO/ForkPoolWorker-15] [1bdca84c-c656-4d15-97d6-1d0d30892d5b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T01:09:00.748691737Z [2024-06-19 01:09:00,748: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a2dda239-1260-48a7-a90c-b3199ac1a32a] received 2024-06-19T01:09:00.751512695Z [2024-06-19 01:09:00,751: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5c1e1a97-3ac3-4bb8-832d-95255f3692dd] received 2024-06-19T01:09:00.758039714Z [2024-06-19 01:09:00,757: INFO/ForkPoolWorker-16] [a2dda239-1260-48a7-a90c-b3199ac1a32a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T01:09:00.766458590Z [2024-06-19 01:09:00,766: INFO/ForkPoolWorker-1] [5c1e1a97-3ac3-4bb8-832d-95255f3692dd] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T01:09:01.023424542Z [2024-06-19 01:09:01,020: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T01:09:01.031173872Z [2024-06-19 01:09:01,027: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T01:09:01.047336889Z [2024-06-19 01:09:01,044: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T01:09:01.181992064Z [2024-06-19 01:09:01,181: INFO/ForkPoolWorker-1] Getting SDNC list 2024-06-19T01:09:01.185933755Z [2024-06-19 01:09:01,185: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:09:01.209057945Z [2024-06-19 01:09:01,208: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T01:09:01.210027988Z [2024-06-19 01:09:01,209: INFO/ForkPoolWorker-1] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T01:09:01.210104178Z [2024-06-19 01:09:01,209: INFO/ForkPoolWorker-1] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T01:09:01.210181287Z [2024-06-19 01:09:01,210: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-06-19T01:09:01.210369464Z [2024-06-19 01:09:01,210: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T01:09:01.289738856Z [2024-06-19 01:09:01,289: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:09:01.848659544Z [2024-06-19 01:09:01,848: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5c1e1a97-3ac3-4bb8-832d-95255f3692dd] succeeded in 1.0951879369986273s: None 2024-06-19T01:09:02.077487479Z [2024-06-19 01:09:02,077: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T01:09:02.080597070Z [2024-06-19 01:09:02,080: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:09:02.099654597Z [2024-06-19 01:09:02,099: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T01:09:02.102917421Z [2024-06-19 01:09:02,102: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:09:02.104390908Z [2024-06-19 01:09:02,104: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T01:09:02.107043569Z [2024-06-19 01:09:02,105: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:09:02.107401000Z [2024-06-19 01:09:02,107: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:09:02.107719380Z [2024-06-19 01:09:02,107: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:09:02.107940929Z [2024-06-19 01:09:02,107: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T01:09:02.108835492Z [2024-06-19 01:09:02,108: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T01:09:02.109501899Z [2024-06-19 01:09:02,108: INFO/ForkPoolWorker-16] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:09:02.121884128Z [2024-06-19 01:09:02,121: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T01:09:02.122990162Z [2024-06-19 01:09:02,122: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:09:02.123050288Z [2024-06-19 01:09:02,122: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:09:02.123059983Z [2024-06-19 01:09:02,122: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:09:02.123132292Z [2024-06-19 01:09:02,122: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T01:09:02.123301069Z [2024-06-19 01:09:02,123: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-06-19T01:09:02.123308612Z [2024-06-19 01:09:02,123: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:09:02.200909806Z [2024-06-19 01:09:02,200: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:09:02.207789068Z [2024-06-19 01:09:02,204: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:09:03.849086170Z [2024-06-19 01:09:03,848: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a2dda239-1260-48a7-a90c-b3199ac1a32a] succeeded in 3.0983276030001434s: None 2024-06-19T01:09:04.308351420Z [2024-06-19 01:09:04,307: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1bdca84c-c656-4d15-97d6-1d0d30892d5b] succeeded in 3.5685110139984317s: None 2024-06-19T01:09:38.599780584Z [2024-06-19 01:09:38,599: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8818b374-7ded-4835-b61c-3395556327eb] received 2024-06-19T01:09:38.615612908Z [2024-06-19 01:09:38,615: INFO/ForkPoolWorker-15] [8818b374-7ded-4835-b61c-3395556327eb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240619010937_985336', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-06-19T01:09:38.899828998Z [2024-06-19 01:09:38,896: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_down.py 2024-06-19T01:09:39.195144219Z [2024-06-19 01:09:39,194: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:09:39.819950025Z [2024-06-19 01:09:39,819: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8818b374-7ded-4835-b61c-3395556327eb] succeeded in 1.2177317599998787s: None 2024-06-19T01:10:00.808402699Z [2024-06-19 01:10:00,808: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4d445baf-bee4-47e2-b46a-d25acebf4481] received 2024-06-19T01:10:00.810005370Z [2024-06-19 01:10:00,809: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[08553673-1a6f-480b-b2b6-5a8057652e3d] received 2024-06-19T01:10:00.811587348Z [2024-06-19 01:10:00,811: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[32fbf150-22fc-4f45-a1e3-ac6c49325721] received 2024-06-19T01:10:00.813042168Z [2024-06-19 01:10:00,812: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3a5dfe8a-62d6-41b1-a264-b95efd1e99b9] received 2024-06-19T01:10:00.818612881Z [2024-06-19 01:10:00,818: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4e6f63b7-b5a6-4523-8599-3d51c9a45df6] received 2024-06-19T01:10:00.820235012Z [2024-06-19 01:10:00,819: INFO/ForkPoolWorker-16] [08553673-1a6f-480b-b2b6-5a8057652e3d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-19T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T01:10:00.820257765Z [2024-06-19 01:10:00,820: INFO/ForkPoolWorker-2] [3a5dfe8a-62d6-41b1-a264-b95efd1e99b9] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-19T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-19T01:10:00.833561016Z [2024-06-19 01:10:00,833: INFO/ForkPoolWorker-1] [32fbf150-22fc-4f45-a1e3-ac6c49325721] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T01:10:00.837933967Z [2024-06-19 01:10:00,837: INFO/ForkPoolWorker-3] [4e6f63b7-b5a6-4523-8599-3d51c9a45df6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T01:10:00.842410079Z [2024-06-19 01:10:00,842: INFO/ForkPoolWorker-15] [4d445baf-bee4-47e2-b46a-d25acebf4481] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T01:10:01.121503917Z [2024-06-19 01:10:01,117: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T01:10:01.172277428Z [2024-06-19 01:10:01,169: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-19T01:10:01.238032727Z [2024-06-19 01:10:01,234: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T01:10:01.300677309Z [2024-06-19 01:10:01,293: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T01:10:01.401695703Z [2024-06-19 01:10:01,398: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T01:10:01.504732539Z [2024-06-19 01:10:01,504: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:10:01.606568889Z [2024-06-19 01:10:01,606: INFO/ForkPoolWorker-15] Getting SDNC list 2024-06-19T01:10:01.611762337Z [2024-06-19 01:10:01,611: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:10:01.664755526Z [2024-06-19 01:10:01,664: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T01:10:01.666506341Z [2024-06-19 01:10:01,666: INFO/ForkPoolWorker-15] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T01:10:01.666683834Z [2024-06-19 01:10:01,666: INFO/ForkPoolWorker-15] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T01:10:01.666789842Z [2024-06-19 01:10:01,666: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-06-19T01:10:01.667422939Z [2024-06-19 01:10:01,667: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T01:10:01.756460992Z [2024-06-19 01:10:01,756: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:10:02.129592692Z [2024-06-19 01:10:02,129: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[3a5dfe8a-62d6-41b1-a264-b95efd1e99b9] succeeded in 1.3152384650002205s: None 2024-06-19T01:10:02.446515169Z [2024-06-19 01:10:02,446: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4d445baf-bee4-47e2-b46a-d25acebf4481] succeeded in 1.6350882700007787s: None 2024-06-19T01:10:02.546570082Z [2024-06-19 01:10:02,546: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T01:10:02.549817169Z [2024-06-19 01:10:02,549: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:10:02.573957930Z [2024-06-19 01:10:02,573: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T01:10:02.576013801Z [2024-06-19 01:10:02,575: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:10:02.576117866Z [2024-06-19 01:10:02,575: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:10:02.576253360Z [2024-06-19 01:10:02,576: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:10:02.576309563Z [2024-06-19 01:10:02,576: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T01:10:02.576568180Z [2024-06-19 01:10:02,576: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T01:10:02.576620655Z [2024-06-19 01:10:02,576: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:10:02.622183216Z [2024-06-19 01:10:02,621: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T01:10:02.625492509Z [2024-06-19 01:10:02,625: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:10:02.661047312Z [2024-06-19 01:10:02,660: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T01:10:02.665383815Z [2024-06-19 01:10:02,665: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:10:02.665609911Z [2024-06-19 01:10:02,664: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:10:02.665787689Z [2024-06-19 01:10:02,665: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:10:02.666007855Z [2024-06-19 01:10:02,665: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:10:02.666160997Z [2024-06-19 01:10:02,666: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T01:10:02.666598762Z [2024-06-19 01:10:02,666: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-06-19T01:10:02.666762204Z [2024-06-19 01:10:02,666: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:10:02.764894446Z [2024-06-19 01:10:02,764: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:10:02.818653691Z [2024-06-19 01:10:02,818: INFO/ForkPoolWorker-3] Getting VIM list 2024-06-19T01:10:02.821840135Z [2024-06-19 01:10:02,821: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:10:02.851807727Z [2024-06-19 01:10:02,851: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-06-19T01:10:02.856798481Z [2024-06-19 01:10:02,856: INFO/ForkPoolWorker-3] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:10:02.856842789Z [2024-06-19 01:10:02,856: INFO/ForkPoolWorker-3] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:10:02.856912647Z [2024-06-19 01:10:02,856: INFO/ForkPoolWorker-3] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:10:02.856943673Z [2024-06-19 01:10:02,856: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-06-19T01:10:02.857149874Z [2024-06-19 01:10:02,857: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T01:10:02.857166384Z [2024-06-19 01:10:02,857: INFO/ForkPoolWorker-3] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:10:02.968804320Z [2024-06-19 01:10:02,968: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:10:03.212373785Z [2024-06-19 01:10:03,211: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[08553673-1a6f-480b-b2b6-5a8057652e3d] succeeded in 2.400968298999942s: None 2024-06-19T01:10:03.996304209Z [2024-06-19 01:10:03,995: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e4566cc9-d412-4af7-8438-8d2f6b2495df] received 2024-06-19T01:10:04.017729942Z [2024-06-19 01:10:04,013: INFO/ForkPoolWorker-15] [e4566cc9-d412-4af7-8438-8d2f6b2495df] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'split_metrics', 'scheduled__2024-06-19T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T01:10:04.308834229Z [2024-06-19 01:10:04,305: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T01:10:04.487039638Z [2024-06-19 01:10:04,486: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[4e6f63b7-b5a6-4523-8599-3d51c9a45df6] succeeded in 3.6648121339985664s: None 2024-06-19T01:10:04.553118690Z [2024-06-19 01:10:04,552: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[32fbf150-22fc-4f45-a1e3-ac6c49325721] succeeded in 3.7382764640005917s: None 2024-06-19T01:10:05.443578263Z [2024-06-19 01:10:05,443: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T01:10:05.446528576Z [2024-06-19 01:10:05,445: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:10:05.469820340Z [2024-06-19 01:10:05,469: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T01:10:05.471806007Z [2024-06-19 01:10:05,471: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:10:05.471864363Z [2024-06-19 01:10:05,471: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:10:05.472000489Z [2024-06-19 01:10:05,471: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:10:05.472121260Z [2024-06-19 01:10:05,471: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T01:10:05.472363163Z [2024-06-19 01:10:05,472: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T01:10:05.472529611Z [2024-06-19 01:10:05,472: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:10:05.557201657Z [2024-06-19 01:10:05,556: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:10:06.221920994Z [2024-06-19 01:10:06,221: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e4566cc9-d412-4af7-8438-8d2f6b2495df] succeeded in 2.2226174090010318s: None 2024-06-19T01:10:06.529677611Z [2024-06-19 01:10:06,529: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e3d373a1-2fb6-4831-b1d3-171f43bb295e] received 2024-06-19T01:10:06.540261022Z [2024-06-19 01:10:06,539: INFO/ForkPoolWorker-15] [e3d373a1-2fb6-4831-b1d3-171f43bb295e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'collect_metrics', 'scheduled__2024-06-19T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-19T01:10:06.830595563Z [2024-06-19 01:10:06,827: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T01:10:07.859075384Z [2024-06-19 01:10:07,858: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T01:10:07.862154245Z [2024-06-19 01:10:07,861: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:10:07.877109115Z [2024-06-19 01:10:07,876: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T01:10:07.878073956Z [2024-06-19 01:10:07,877: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:10:07.878091537Z [2024-06-19 01:10:07,878: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:10:07.878207200Z [2024-06-19 01:10:07,878: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:10:07.878241891Z [2024-06-19 01:10:07,878: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T01:10:07.878441303Z [2024-06-19 01:10:07,878: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T01:10:07.878466297Z [2024-06-19 01:10:07,878: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:10:07.941849756Z [2024-06-19 01:10:07,941: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:10:08.546368302Z [2024-06-19 01:10:08,545: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e3d373a1-2fb6-4831-b1d3-171f43bb295e] succeeded in 2.0128138630007015s: None 2024-06-19T01:10:08.901038392Z [2024-06-19 01:10:08,900: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e786a102-4901-4fe6-93b3-2e1794fcfa76] received 2024-06-19T01:10:08.916148440Z [2024-06-19 01:10:08,915: INFO/ForkPoolWorker-15] [e786a102-4901-4fe6-93b3-2e1794fcfa76] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'send_prometheus', 'scheduled__2024-06-19T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T01:10:09.188463028Z [2024-06-19 01:10:09,185: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T01:10:10.286135259Z [2024-06-19 01:10:10,285: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T01:10:10.289450504Z [2024-06-19 01:10:10,288: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:10:10.317134880Z [2024-06-19 01:10:10,316: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T01:10:10.318437113Z [2024-06-19 01:10:10,318: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:10:10.318565700Z [2024-06-19 01:10:10,318: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:10:10.318733231Z [2024-06-19 01:10:10,318: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:10:10.318853146Z [2024-06-19 01:10:10,318: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T01:10:10.319192790Z [2024-06-19 01:10:10,319: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T01:10:10.319202812Z [2024-06-19 01:10:10,319: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:10:10.398653887Z [2024-06-19 01:10:10,398: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:10:11.070086066Z [2024-06-19 01:10:11,069: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e786a102-4901-4fe6-93b3-2e1794fcfa76] succeeded in 2.1651285810003174s: None 2024-06-19T01:11:00.764147760Z [2024-06-19 01:11:00,763: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0637b9dc-81ad-4723-bed5-8d464a0aac6f] received 2024-06-19T01:11:00.769706755Z [2024-06-19 01:11:00,769: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[be276d62-50d8-4596-be0f-a9e2001f0a92] received 2024-06-19T01:11:00.772073320Z [2024-06-19 01:11:00,771: INFO/ForkPoolWorker-15] [0637b9dc-81ad-4723-bed5-8d464a0aac6f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T01:11:00.772885663Z [2024-06-19 01:11:00,772: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[72f0e224-1f08-4db7-8e4a-691c6677a491] received 2024-06-19T01:11:00.780424162Z [2024-06-19 01:11:00,780: INFO/ForkPoolWorker-1] [72f0e224-1f08-4db7-8e4a-691c6677a491] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T01:11:00.780440293Z [2024-06-19 01:11:00,780: INFO/ForkPoolWorker-16] [be276d62-50d8-4596-be0f-a9e2001f0a92] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T01:11:01.090351442Z [2024-06-19 01:11:01,087: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T01:11:01.097907305Z [2024-06-19 01:11:01,094: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T01:11:01.119926967Z [2024-06-19 01:11:01,116: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T01:11:01.263387348Z [2024-06-19 01:11:01,262: INFO/ForkPoolWorker-16] Getting SDNC list 2024-06-19T01:11:01.267854031Z [2024-06-19 01:11:01,267: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:11:01.295399442Z [2024-06-19 01:11:01,295: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T01:11:01.296947355Z [2024-06-19 01:11:01,296: INFO/ForkPoolWorker-16] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T01:11:01.297166397Z [2024-06-19 01:11:01,296: INFO/ForkPoolWorker-16] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T01:11:01.297321377Z [2024-06-19 01:11:01,297: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-06-19T01:11:01.297581296Z [2024-06-19 01:11:01,297: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T01:11:01.394255105Z [2024-06-19 01:11:01,393: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:11:01.947237363Z [2024-06-19 01:11:01,946: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[be276d62-50d8-4596-be0f-a9e2001f0a92] succeeded in 1.1752757159993052s: None 2024-06-19T01:11:02.129582419Z [2024-06-19 01:11:02,129: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T01:11:02.132753900Z [2024-06-19 01:11:02,132: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:11:02.162279630Z [2024-06-19 01:11:02,162: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T01:11:02.164467987Z [2024-06-19 01:11:02,164: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:11:02.165063614Z [2024-06-19 01:11:02,164: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:11:02.165456072Z [2024-06-19 01:11:02,165: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:11:02.165748024Z [2024-06-19 01:11:02,165: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T01:11:02.166439675Z [2024-06-19 01:11:02,166: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-06-19T01:11:02.166700032Z [2024-06-19 01:11:02,166: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:11:02.228683910Z [2024-06-19 01:11:02,225: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T01:11:02.237908888Z [2024-06-19 01:11:02,232: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:11:02.285051297Z [2024-06-19 01:11:02,284: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:11:02.297328503Z [2024-06-19 01:11:02,297: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T01:11:02.299010064Z [2024-06-19 01:11:02,298: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:11:02.299048764Z [2024-06-19 01:11:02,298: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:11:02.299172279Z [2024-06-19 01:11:02,299: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:11:02.299198982Z [2024-06-19 01:11:02,299: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T01:11:02.299423027Z [2024-06-19 01:11:02,299: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T01:11:02.299437248Z [2024-06-19 01:11:02,299: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:11:02.378468020Z [2024-06-19 01:11:02,378: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:11:05.478100727Z [2024-06-19 01:11:05,477: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[72f0e224-1f08-4db7-8e4a-691c6677a491] succeeded in 4.703293365000718s: None 2024-06-19T01:11:06.493690282Z [2024-06-19 01:11:06,493: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0637b9dc-81ad-4723-bed5-8d464a0aac6f] succeeded in 5.7270600339998055s: None 2024-06-19T01:11:13.921036918Z [2024-06-19 01:11:13,920: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d52a6581-1a28-41ba-a16a-5e5ede506ac2] received 2024-06-19T01:11:13.929567303Z [2024-06-19 01:11:13,929: INFO/ForkPoolWorker-15] [d52a6581-1a28-41ba-a16a-5e5ede506ac2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_5a98d040-473b-42ce-a5e2-9d71d85930e3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T01:11:13.937135109Z [2024-06-19 01:11:13,936: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bf42983f-3aa2-4b6d-86eb-ab6f444ff8c7] received 2024-06-19T01:11:13.958469842Z [2024-06-19 01:11:13,958: INFO/ForkPoolWorker-16] [bf42983f-3aa2-4b6d-86eb-ab6f444ff8c7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_5a98d040-473b-42ce-a5e2-9d71d85930e3', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-19T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T01:11:14.248381971Z [2024-06-19 01:11:14,245: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T01:11:14.250279525Z [2024-06-19 01:11:14,247: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T01:11:15.255874196Z [2024-06-19 01:11:15,255: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T01:11:15.258884164Z [2024-06-19 01:11:15,258: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:11:15.272753633Z [2024-06-19 01:11:15,272: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T01:11:15.275912417Z [2024-06-19 01:11:15,275: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:11:15.287604057Z [2024-06-19 01:11:15,287: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T01:11:15.289356399Z [2024-06-19 01:11:15,289: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:11:15.289426326Z [2024-06-19 01:11:15,289: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:11:15.289485357Z [2024-06-19 01:11:15,289: INFO/ForkPoolWorker-16] Read VIM 5a98d040-473b-42ce-a5e2-9d71d85930e3 (basic01_797338) 2024-06-19T01:11:15.289684157Z [2024-06-19 01:11:15,289: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '5a98d040-473b-42ce-a5e2-9d71d85930e3', 'name': 'basic01_797338', 'vim_type': 'openstack'}] 2024-06-19T01:11:15.289721347Z [2024-06-19 01:11:15,289: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T01:11:15.290355258Z [2024-06-19 01:11:15,289: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T01:11:15.290447573Z [2024-06-19 01:11:15,290: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:11:15.297141860Z [2024-06-19 01:11:15,296: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_5a98d040-473b-42ce-a5e2-9d71d85930e3 2024-06-19T01:11:15.297150039Z [2024-06-19 01:11:15,297: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T01:11:15.298110900Z [2024-06-19 01:11:15,297: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:11:15.298136338Z [2024-06-19 01:11:15,298: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:11:15.298202473Z [2024-06-19 01:11:15,298: INFO/ForkPoolWorker-15] Read VIM 5a98d040-473b-42ce-a5e2-9d71d85930e3 (basic01_797338) 2024-06-19T01:11:15.298336300Z [2024-06-19 01:11:15,298: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '5a98d040-473b-42ce-a5e2-9d71d85930e3', 'name': 'basic01_797338', 'vim_type': 'openstack'}] 2024-06-19T01:11:15.298357161Z [2024-06-19 01:11:15,298: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T01:11:15.298532886Z [2024-06-19 01:11:15,298: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T01:11:15.298591046Z [2024-06-19 01:11:15,298: INFO/ForkPoolWorker-15] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:11:15.302511699Z [2024-06-19 01:11:15,302: INFO/ForkPoolWorker-15] Creating DAG vim_status_5a98d040-473b-42ce-a5e2-9d71d85930e3 2024-06-19T01:11:15.359580895Z [2024-06-19 01:11:15,359: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:11:15.367859627Z [2024-06-19 01:11:15,367: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:11:15.868452894Z [2024-06-19 01:11:15,868: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[bf42983f-3aa2-4b6d-86eb-ab6f444ff8c7] succeeded in 1.928338050000093s: None 2024-06-19T01:11:16.429069184Z [2024-06-19 01:11:16,428: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[159e7b5e-83c1-4f77-ad56-66e3f569b8b5] received 2024-06-19T01:11:16.433005651Z [2024-06-19 01:11:16,432: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[731174c4-f20a-4868-872f-a253d53f2401] received 2024-06-19T01:11:16.442371070Z [2024-06-19 01:11:16,442: INFO/ForkPoolWorker-16] [159e7b5e-83c1-4f77-ad56-66e3f569b8b5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_5a98d040-473b-42ce-a5e2-9d71d85930e3', 'split_metrics', 'scheduled__2024-06-19T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T01:11:16.446513757Z [2024-06-19 01:11:16,446: INFO/ForkPoolWorker-1] [731174c4-f20a-4868-872f-a253d53f2401] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_5a98d040-473b-42ce-a5e2-9d71d85930e3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T01:11:16.703122226Z [2024-06-19 01:11:16,699: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T01:11:16.715017469Z [2024-06-19 01:11:16,711: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T01:11:16.936732408Z [2024-06-19 01:11:16,936: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d52a6581-1a28-41ba-a16a-5e5ede506ac2] succeeded in 3.011593844001254s: None 2024-06-19T01:11:17.811906137Z [2024-06-19 01:11:17,811: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T01:11:17.814820816Z [2024-06-19 01:11:17,814: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:11:17.838867353Z [2024-06-19 01:11:17,838: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T01:11:17.840284118Z [2024-06-19 01:11:17,840: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:11:17.840349508Z [2024-06-19 01:11:17,840: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:11:17.840410831Z [2024-06-19 01:11:17,840: INFO/ForkPoolWorker-1] Read VIM 5a98d040-473b-42ce-a5e2-9d71d85930e3 (basic01_797338) 2024-06-19T01:11:17.840551619Z [2024-06-19 01:11:17,840: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '5a98d040-473b-42ce-a5e2-9d71d85930e3', 'name': 'basic01_797338', 'vim_type': 'openstack'}] 2024-06-19T01:11:17.840601913Z [2024-06-19 01:11:17,840: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T01:11:17.840822188Z [2024-06-19 01:11:17,840: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-06-19T01:11:17.840875352Z [2024-06-19 01:11:17,840: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:11:17.846166429Z [2024-06-19 01:11:17,845: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_5a98d040-473b-42ce-a5e2-9d71d85930e3 2024-06-19T01:11:17.853568146Z [2024-06-19 01:11:17,853: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T01:11:17.856529852Z [2024-06-19 01:11:17,856: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:11:17.873253969Z [2024-06-19 01:11:17,873: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T01:11:17.874295897Z [2024-06-19 01:11:17,874: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:11:17.874334654Z [2024-06-19 01:11:17,874: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:11:17.874372024Z [2024-06-19 01:11:17,874: INFO/ForkPoolWorker-16] Read VIM 5a98d040-473b-42ce-a5e2-9d71d85930e3 (basic01_797338) 2024-06-19T01:11:17.874475985Z [2024-06-19 01:11:17,874: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '5a98d040-473b-42ce-a5e2-9d71d85930e3', 'name': 'basic01_797338', 'vim_type': 'openstack'}] 2024-06-19T01:11:17.874509659Z [2024-06-19 01:11:17,874: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T01:11:17.874666445Z [2024-06-19 01:11:17,874: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T01:11:17.874699211Z [2024-06-19 01:11:17,874: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:11:17.879391177Z [2024-06-19 01:11:17,879: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_5a98d040-473b-42ce-a5e2-9d71d85930e3 2024-06-19T01:11:17.910052718Z [2024-06-19 01:11:17,909: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:11:17.981987671Z [2024-06-19 01:11:17,981: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:11:18.598806762Z [2024-06-19 01:11:18,597: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[159e7b5e-83c1-4f77-ad56-66e3f569b8b5] succeeded in 2.1641114009999s: None 2024-06-19T01:11:18.935907725Z [2024-06-19 01:11:18,935: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c19f9216-e6d4-43c2-bfa1-c6e7e98e42ce] received 2024-06-19T01:11:18.943358578Z [2024-06-19 01:11:18,943: INFO/ForkPoolWorker-15] [c19f9216-e6d4-43c2-bfa1-c6e7e98e42ce] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_5a98d040-473b-42ce-a5e2-9d71d85930e3', 'collect_metrics', 'scheduled__2024-06-19T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-19T01:11:19.207956620Z [2024-06-19 01:11:19,204: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T01:11:19.552814687Z [2024-06-19 01:11:19,552: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[731174c4-f20a-4868-872f-a253d53f2401] succeeded in 3.116948158000014s: None 2024-06-19T01:11:20.215295030Z [2024-06-19 01:11:20,214: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T01:11:20.218318119Z [2024-06-19 01:11:20,217: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:11:20.238166690Z [2024-06-19 01:11:20,237: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T01:11:20.239337919Z [2024-06-19 01:11:20,239: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:11:20.239351780Z [2024-06-19 01:11:20,239: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:11:20.239362021Z [2024-06-19 01:11:20,239: INFO/ForkPoolWorker-15] Read VIM 5a98d040-473b-42ce-a5e2-9d71d85930e3 (basic01_797338) 2024-06-19T01:11:20.239525064Z [2024-06-19 01:11:20,239: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '5a98d040-473b-42ce-a5e2-9d71d85930e3', 'name': 'basic01_797338', 'vim_type': 'openstack'}] 2024-06-19T01:11:20.239532736Z [2024-06-19 01:11:20,239: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T01:11:20.239757875Z [2024-06-19 01:11:20,239: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T01:11:20.240111273Z [2024-06-19 01:11:20,239: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:11:20.247295570Z [2024-06-19 01:11:20,247: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_5a98d040-473b-42ce-a5e2-9d71d85930e3 2024-06-19T01:11:20.327294679Z [2024-06-19 01:11:20,326: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:11:20.876861759Z [2024-06-19 01:11:20,876: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c19f9216-e6d4-43c2-bfa1-c6e7e98e42ce] succeeded in 1.9389434210006584s: None 2024-06-19T01:11:21.334751698Z [2024-06-19 01:11:21,334: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a38762a1-b40c-4308-81ca-3024f48d5a7b] received 2024-06-19T01:11:21.344988292Z [2024-06-19 01:11:21,344: INFO/ForkPoolWorker-15] [a38762a1-b40c-4308-81ca-3024f48d5a7b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_5a98d040-473b-42ce-a5e2-9d71d85930e3', 'send_prometheus', 'scheduled__2024-06-19T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T01:11:21.606432810Z [2024-06-19 01:11:21,603: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T01:11:22.611330555Z [2024-06-19 01:11:22,610: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T01:11:22.614425397Z [2024-06-19 01:11:22,614: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:11:22.633168231Z [2024-06-19 01:11:22,632: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T01:11:22.634689600Z [2024-06-19 01:11:22,634: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:11:22.634714191Z [2024-06-19 01:11:22,634: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:11:22.634872425Z [2024-06-19 01:11:22,634: INFO/ForkPoolWorker-15] Read VIM 5a98d040-473b-42ce-a5e2-9d71d85930e3 (basic01_797338) 2024-06-19T01:11:22.635033639Z [2024-06-19 01:11:22,634: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '5a98d040-473b-42ce-a5e2-9d71d85930e3', 'name': 'basic01_797338', 'vim_type': 'openstack'}] 2024-06-19T01:11:22.635046716Z [2024-06-19 01:11:22,634: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T01:11:22.635325372Z [2024-06-19 01:11:22,635: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T01:11:22.635343412Z [2024-06-19 01:11:22,635: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:11:22.640855589Z [2024-06-19 01:11:22,640: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_5a98d040-473b-42ce-a5e2-9d71d85930e3 2024-06-19T01:11:22.728798041Z [2024-06-19 01:11:22,728: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:11:23.309414836Z [2024-06-19 01:11:23,308: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a38762a1-b40c-4308-81ca-3024f48d5a7b] succeeded in 1.9720788119993813s: None 2024-06-19T01:11:39.265648991Z [2024-06-19 01:11:39,265: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f03ce196-96b3-4d8b-8e87-ba545d6a09c4] received 2024-06-19T01:11:39.282424125Z [2024-06-19 01:11:39,281: INFO/ForkPoolWorker-15] [f03ce196-96b3-4d8b-8e87-ba545d6a09c4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240619011137_573069', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-06-19T01:11:39.572654974Z [2024-06-19 01:11:39,569: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_down.py 2024-06-19T01:11:39.865713289Z [2024-06-19 01:11:39,865: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:11:40.472484338Z [2024-06-19 01:11:40,471: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f03ce196-96b3-4d8b-8e87-ba545d6a09c4] succeeded in 1.2017339909998555s: None 2024-06-19T01:12:00.797325669Z [2024-06-19 01:12:00,797: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a6f0b92f-fa17-4cda-97be-390609dfab53] received 2024-06-19T01:12:00.802194133Z [2024-06-19 01:12:00,801: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1fb5a0c6-56f1-4cda-98b7-d57819b51daf] received 2024-06-19T01:12:00.804044905Z [2024-06-19 01:12:00,803: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a6696e5f-9c48-44d5-a415-7bd65926510f] received 2024-06-19T01:12:00.805743777Z [2024-06-19 01:12:00,805: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7bab90a8-79da-46a0-acd2-65acab63c8d1] received 2024-06-19T01:12:00.808280318Z [2024-06-19 01:12:00,808: INFO/ForkPoolWorker-15] [a6f0b92f-fa17-4cda-97be-390609dfab53] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-19T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-19T01:12:00.811137130Z [2024-06-19 01:12:00,810: INFO/ForkPoolWorker-1] [a6696e5f-9c48-44d5-a415-7bd65926510f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_5a98d040-473b-42ce-a5e2-9d71d85930e3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T01:12:00.816228696Z [2024-06-19 01:12:00,816: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[05a0debc-b0fb-48b7-88ba-887a6c67d054] received 2024-06-19T01:12:00.817796630Z [2024-06-19 01:12:00,817: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[24f999c8-5526-402b-9360-754226d18c12] received 2024-06-19T01:12:00.819558247Z [2024-06-19 01:12:00,819: INFO/ForkPoolWorker-16] [1fb5a0c6-56f1-4cda-98b7-d57819b51daf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T01:12:00.824602541Z [2024-06-19 01:12:00,824: INFO/ForkPoolWorker-3] [05a0debc-b0fb-48b7-88ba-887a6c67d054] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T01:12:00.824904049Z [2024-06-19 01:12:00,824: INFO/ForkPoolWorker-2] [7bab90a8-79da-46a0-acd2-65acab63c8d1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_5a98d040-473b-42ce-a5e2-9d71d85930e3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T01:12:00.835091252Z [2024-06-19 01:12:00,834: INFO/ForkPoolWorker-4] [24f999c8-5526-402b-9360-754226d18c12] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T01:12:01.262566628Z [2024-06-19 01:12:01,257: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T01:12:01.285201608Z [2024-06-19 01:12:01,281: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-19T01:12:01.403786969Z [2024-06-19 01:12:01,400: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T01:12:01.422774322Z [2024-06-19 01:12:01,410: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T01:12:01.430340017Z [2024-06-19 01:12:01,421: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T01:12:01.500756378Z [2024-06-19 01:12:01,497: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T01:12:01.590140765Z [2024-06-19 01:12:01,589: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:12:01.712765109Z [2024-06-19 01:12:01,712: INFO/ForkPoolWorker-4] Getting SDNC list 2024-06-19T01:12:01.722774886Z [2024-06-19 01:12:01,722: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:12:01.792723383Z [2024-06-19 01:12:01,792: INFO/ForkPoolWorker-4] Connected to database osm version 1.2 2024-06-19T01:12:01.796775483Z [2024-06-19 01:12:01,796: INFO/ForkPoolWorker-4] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T01:12:01.796948444Z [2024-06-19 01:12:01,796: INFO/ForkPoolWorker-4] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T01:12:01.797039734Z [2024-06-19 01:12:01,796: INFO/ForkPoolWorker-4] Getting SDNC list OK 2024-06-19T01:12:01.797311532Z [2024-06-19 01:12:01,797: INFO/ForkPoolWorker-4] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T01:12:01.913861455Z [2024-06-19 01:12:01,913: INFO/ForkPoolWorker-4] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:12:02.393001923Z [2024-06-19 01:12:02,392: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a6f0b92f-fa17-4cda-97be-390609dfab53] succeeded in 1.5932512970011885s: None 2024-06-19T01:12:02.680541127Z [2024-06-19 01:12:02,680: INFO/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[24f999c8-5526-402b-9360-754226d18c12] succeeded in 1.859590489000766s: None 2024-06-19T01:12:02.924178908Z [2024-06-19 01:12:02,923: INFO/ForkPoolWorker-3] Getting VIM list 2024-06-19T01:12:02.927269422Z [2024-06-19 01:12:02,926: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:12:02.953946492Z [2024-06-19 01:12:02,953: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-06-19T01:12:02.956226033Z [2024-06-19 01:12:02,955: INFO/ForkPoolWorker-3] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:12:02.956239249Z [2024-06-19 01:12:02,956: INFO/ForkPoolWorker-3] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:12:02.956465965Z [2024-06-19 01:12:02,956: INFO/ForkPoolWorker-3] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:12:02.956577404Z [2024-06-19 01:12:02,956: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-06-19T01:12:02.956936180Z [2024-06-19 01:12:02,956: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T01:12:02.957149087Z [2024-06-19 01:12:02,956: INFO/ForkPoolWorker-3] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:12:02.991320930Z [2024-06-19 01:12:02,990: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T01:12:02.994599529Z [2024-06-19 01:12:02,994: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:12:03.012713895Z [2024-06-19 01:12:03,012: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T01:12:03.014124428Z [2024-06-19 01:12:03,013: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:12:03.014226105Z [2024-06-19 01:12:03,014: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:12:03.014478647Z [2024-06-19 01:12:03,014: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:12:03.014941786Z [2024-06-19 01:12:03,014: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T01:12:03.015274122Z [2024-06-19 01:12:03,015: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-19T01:12:03.015779670Z [2024-06-19 01:12:03,015: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:12:03.048376193Z [2024-06-19 01:12:03,048: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:12:03.120870836Z [2024-06-19 01:12:03,120: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:12:03.243588737Z [2024-06-19 01:12:03,243: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-19T01:12:03.246950797Z [2024-06-19 01:12:03,246: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:12:03.262764441Z [2024-06-19 01:12:03,262: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T01:12:03.263956760Z [2024-06-19 01:12:03,263: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:12:03.264111805Z [2024-06-19 01:12:03,263: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:12:03.264284987Z [2024-06-19 01:12:03,264: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:12:03.264380566Z [2024-06-19 01:12:03,264: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-19T01:12:03.264598547Z [2024-06-19 01:12:03,264: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T01:12:03.264733013Z [2024-06-19 01:12:03,264: INFO/ForkPoolWorker-2] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:12:03.270796051Z [2024-06-19 01:12:03,270: WARNING/ForkPoolWorker-2] Dag 'vim_status_5a98d040-473b-42ce-a5e2-9d71d85930e3' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T01:12:03.271671073Z [2024-06-19 01:12:03,271: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T01:12:03.272506133Z [2024-06-19 01:12:03,272: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-19T01:12:03.275173966Z [2024-06-19 01:12:03,274: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:12:03.304496864Z [2024-06-19 01:12:03,304: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T01:12:03.308576902Z [2024-06-19 01:12:03,308: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:12:03.308748902Z [2024-06-19 01:12:03,308: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:12:03.308977137Z [2024-06-19 01:12:03,308: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:12:03.309107925Z [2024-06-19 01:12:03,309: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-19T01:12:03.309387219Z [2024-06-19 01:12:03,309: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T01:12:03.309483646Z [2024-06-19 01:12:03,309: INFO/ForkPoolWorker-2] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:12:03.313126439Z [2024-06-19 01:12:03,312: ERROR/ForkPoolWorker-2] [7bab90a8-79da-46a0-acd2-65acab63c8d1] Failed to execute task Dag 'vim_status_5a98d040-473b-42ce-a5e2-9d71d85930e3' could not be found; either it does not exist or it failed to parse.. 2024-06-19T01:12:03.313143759Z Traceback (most recent call last): 2024-06-19T01:12:03.313148688Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-06-19T01:12:03.313153226Z args.func(args) 2024-06-19T01:12:03.313157299Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-06-19T01:12:03.313161717Z return func(*args, **kwargs) 2024-06-19T01:12:03.313164994Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-06-19T01:12:03.313168148Z return f(*args, **kwargs) 2024-06-19T01:12:03.313171108Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-06-19T01:12:03.313174233Z dag = get_dag(args.subdir, args.dag_id) 2024-06-19T01:12:03.313177602Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-06-19T01:12:03.313180686Z raise AirflowException( 2024-06-19T01:12:03.313185329Z airflow.exceptions.AirflowException: Dag 'vim_status_5a98d040-473b-42ce-a5e2-9d71d85930e3' could not be found; either it does not exist or it failed to parse. 2024-06-19T01:12:03.339564510Z [2024-06-19 01:12:03,339: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T01:12:03.343021564Z [2024-06-19 01:12:03,342: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:12:03.350655246Z [2024-06-19 01:12:03,350: ERROR/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[7bab90a8-79da-46a0-acd2-65acab63c8d1] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 7bab90a8-79da-46a0-acd2-65acab63c8d1') 2024-06-19T01:12:03.350684766Z Traceback (most recent call last): 2024-06-19T01:12:03.350689089Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-06-19T01:12:03.350692136Z R = retval = fun(*args, **kwargs) 2024-06-19T01:12:03.350695325Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-06-19T01:12:03.350698390Z return self.run(*args, **kwargs) 2024-06-19T01:12:03.350701793Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-06-19T01:12:03.350706371Z _execute_in_fork(command_to_exec, celery_task_id) 2024-06-19T01:12:03.350709304Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-06-19T01:12:03.350713697Z raise AirflowException(msg) 2024-06-19T01:12:03.350717154Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 7bab90a8-79da-46a0-acd2-65acab63c8d1 2024-06-19T01:12:03.367286549Z [2024-06-19 01:12:03,367: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T01:12:03.369438099Z [2024-06-19 01:12:03,369: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:12:03.369541553Z [2024-06-19 01:12:03,369: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:12:03.369705961Z [2024-06-19 01:12:03,369: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:12:03.369822405Z [2024-06-19 01:12:03,369: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T01:12:03.370073008Z [2024-06-19 01:12:03,369: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-06-19T01:12:03.370179140Z [2024-06-19 01:12:03,370: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:12:03.375762488Z [2024-06-19 01:12:03,375: WARNING/ForkPoolWorker-1] Dag 'vm_status_vim_5a98d040-473b-42ce-a5e2-9d71d85930e3' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T01:12:03.376469297Z [2024-06-19 01:12:03,375: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T01:12:03.377314209Z [2024-06-19 01:12:03,377: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T01:12:03.380171494Z [2024-06-19 01:12:03,379: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:12:03.391858119Z [2024-06-19 01:12:03,391: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T01:12:03.392804475Z [2024-06-19 01:12:03,392: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:12:03.392838679Z [2024-06-19 01:12:03,392: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:12:03.392946663Z [2024-06-19 01:12:03,392: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:12:03.393005542Z [2024-06-19 01:12:03,392: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T01:12:03.393238383Z [2024-06-19 01:12:03,393: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-06-19T01:12:03.393329707Z [2024-06-19 01:12:03,393: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:12:03.397052745Z [2024-06-19 01:12:03,396: ERROR/ForkPoolWorker-1] [a6696e5f-9c48-44d5-a415-7bd65926510f] Failed to execute task Dag 'vm_status_vim_5a98d040-473b-42ce-a5e2-9d71d85930e3' could not be found; either it does not exist or it failed to parse.. 2024-06-19T01:12:03.397065535Z Traceback (most recent call last): 2024-06-19T01:12:03.397069248Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-06-19T01:12:03.397072828Z args.func(args) 2024-06-19T01:12:03.397076422Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-06-19T01:12:03.397080148Z return func(*args, **kwargs) 2024-06-19T01:12:03.397083111Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-06-19T01:12:03.397086026Z return f(*args, **kwargs) 2024-06-19T01:12:03.397088941Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-06-19T01:12:03.397092068Z dag = get_dag(args.subdir, args.dag_id) 2024-06-19T01:12:03.397095391Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-06-19T01:12:03.397098346Z raise AirflowException( 2024-06-19T01:12:03.397102361Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_5a98d040-473b-42ce-a5e2-9d71d85930e3' could not be found; either it does not exist or it failed to parse. 2024-06-19T01:12:03.431535708Z [2024-06-19 01:12:03,430: ERROR/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a6696e5f-9c48-44d5-a415-7bd65926510f] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id a6696e5f-9c48-44d5-a415-7bd65926510f') 2024-06-19T01:12:03.431552861Z Traceback (most recent call last): 2024-06-19T01:12:03.431556785Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-06-19T01:12:03.431559825Z R = retval = fun(*args, **kwargs) 2024-06-19T01:12:03.431562959Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-06-19T01:12:03.431566398Z return self.run(*args, **kwargs) 2024-06-19T01:12:03.431570089Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-06-19T01:12:03.431573605Z _execute_in_fork(command_to_exec, celery_task_id) 2024-06-19T01:12:03.431576499Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-06-19T01:12:03.431580024Z raise AirflowException(msg) 2024-06-19T01:12:03.431583737Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id a6696e5f-9c48-44d5-a415-7bd65926510f 2024-06-19T01:12:04.511844069Z [2024-06-19 01:12:04,511: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[05a0debc-b0fb-48b7-88ba-887a6c67d054] succeeded in 3.6936110369988455s: None 2024-06-19T01:12:04.899892276Z [2024-06-19 01:12:04,899: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1fb5a0c6-56f1-4cda-98b7-d57819b51daf] succeeded in 4.094581303999803s: None 2024-06-19T01:12:13.966979898Z [2024-06-19 01:12:13,966: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3c91e8f3-ec2e-47a2-9abf-cfe20a88af9c] received 2024-06-19T01:12:13.973601581Z [2024-06-19 01:12:13,973: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b1365fe2-4b18-4ecf-bcea-f7daf6b8c823] received 2024-06-19T01:12:13.977036896Z [2024-06-19 01:12:13,976: INFO/ForkPoolWorker-15] [3c91e8f3-ec2e-47a2-9abf-cfe20a88af9c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_5a98d040-473b-42ce-a5e2-9d71d85930e3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T01:12:13.986127026Z [2024-06-19 01:12:13,985: INFO/ForkPoolWorker-16] [b1365fe2-4b18-4ecf-bcea-f7daf6b8c823] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_5a98d040-473b-42ce-a5e2-9d71d85930e3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T01:12:14.302893003Z [2024-06-19 01:12:14,299: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T01:12:14.310457931Z [2024-06-19 01:12:14,307: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T01:12:15.367763386Z [2024-06-19 01:12:15,367: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T01:12:15.370687790Z [2024-06-19 01:12:15,370: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:12:15.391787403Z [2024-06-19 01:12:15,391: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T01:12:15.393040057Z [2024-06-19 01:12:15,392: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:12:15.393130015Z [2024-06-19 01:12:15,393: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:12:15.393311129Z [2024-06-19 01:12:15,393: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:12:15.393389681Z [2024-06-19 01:12:15,393: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T01:12:15.393716082Z [2024-06-19 01:12:15,393: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T01:12:15.393784320Z [2024-06-19 01:12:15,393: INFO/ForkPoolWorker-16] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:12:15.403379465Z [2024-06-19 01:12:15,403: WARNING/ForkPoolWorker-16] Dag 'vim_status_5a98d040-473b-42ce-a5e2-9d71d85930e3' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T01:12:15.404107504Z [2024-06-19 01:12:15,403: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T01:12:15.404825383Z [2024-06-19 01:12:15,404: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T01:12:15.407301285Z [2024-06-19 01:12:15,407: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:12:15.410728335Z [2024-06-19 01:12:15,410: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T01:12:15.413681504Z [2024-06-19 01:12:15,413: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:12:15.418611081Z [2024-06-19 01:12:15,418: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T01:12:15.419828451Z [2024-06-19 01:12:15,419: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:12:15.420467521Z [2024-06-19 01:12:15,419: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:12:15.420641717Z [2024-06-19 01:12:15,420: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:12:15.420893564Z [2024-06-19 01:12:15,420: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T01:12:15.421576375Z [2024-06-19 01:12:15,421: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T01:12:15.421906205Z [2024-06-19 01:12:15,421: INFO/ForkPoolWorker-16] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:12:15.426150767Z [2024-06-19 01:12:15,425: ERROR/ForkPoolWorker-16] [b1365fe2-4b18-4ecf-bcea-f7daf6b8c823] Failed to execute task Dag 'vim_status_5a98d040-473b-42ce-a5e2-9d71d85930e3' could not be found; either it does not exist or it failed to parse.. 2024-06-19T01:12:15.426164038Z Traceback (most recent call last): 2024-06-19T01:12:15.426168304Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-06-19T01:12:15.426181338Z args.func(args) 2024-06-19T01:12:15.426185456Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-06-19T01:12:15.426189287Z return func(*args, **kwargs) 2024-06-19T01:12:15.426192973Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-06-19T01:12:15.426196420Z return f(*args, **kwargs) 2024-06-19T01:12:15.426199740Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-06-19T01:12:15.426203114Z dag = get_dag(args.subdir, args.dag_id) 2024-06-19T01:12:15.426206412Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-06-19T01:12:15.426209681Z raise AirflowException( 2024-06-19T01:12:15.426213410Z airflow.exceptions.AirflowException: Dag 'vim_status_5a98d040-473b-42ce-a5e2-9d71d85930e3' could not be found; either it does not exist or it failed to parse. 2024-06-19T01:12:15.429637938Z [2024-06-19 01:12:15,429: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T01:12:15.430598816Z [2024-06-19 01:12:15,430: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:12:15.430642182Z [2024-06-19 01:12:15,430: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:12:15.430730303Z [2024-06-19 01:12:15,430: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:12:15.430774209Z [2024-06-19 01:12:15,430: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T01:12:15.430974029Z [2024-06-19 01:12:15,430: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-06-19T01:12:15.430982516Z [2024-06-19 01:12:15,430: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:12:15.437188721Z [2024-06-19 01:12:15,437: WARNING/ForkPoolWorker-15] Dag 'vm_status_vim_5a98d040-473b-42ce-a5e2-9d71d85930e3' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T01:12:15.437835258Z [2024-06-19 01:12:15,437: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T01:12:15.438522024Z [2024-06-19 01:12:15,438: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T01:12:15.440938739Z [2024-06-19 01:12:15,440: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:12:15.451825196Z [2024-06-19 01:12:15,451: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T01:12:15.453143021Z [2024-06-19 01:12:15,453: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:12:15.453211794Z [2024-06-19 01:12:15,453: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:12:15.453308695Z [2024-06-19 01:12:15,453: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:12:15.453332418Z [2024-06-19 01:12:15,453: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T01:12:15.453564713Z [2024-06-19 01:12:15,453: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-06-19T01:12:15.453570118Z [2024-06-19 01:12:15,453: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:12:15.457416927Z [2024-06-19 01:12:15,456: ERROR/ForkPoolWorker-15] [3c91e8f3-ec2e-47a2-9abf-cfe20a88af9c] Failed to execute task Dag 'vm_status_vim_5a98d040-473b-42ce-a5e2-9d71d85930e3' could not be found; either it does not exist or it failed to parse.. 2024-06-19T01:12:15.457423787Z Traceback (most recent call last): 2024-06-19T01:12:15.457427856Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-06-19T01:12:15.457431410Z args.func(args) 2024-06-19T01:12:15.457435340Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-06-19T01:12:15.457438939Z return func(*args, **kwargs) 2024-06-19T01:12:15.457441893Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-06-19T01:12:15.457462039Z return f(*args, **kwargs) 2024-06-19T01:12:15.457465517Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-06-19T01:12:15.457468545Z dag = get_dag(args.subdir, args.dag_id) 2024-06-19T01:12:15.457471509Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-06-19T01:12:15.457474581Z raise AirflowException( 2024-06-19T01:12:15.457478091Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_5a98d040-473b-42ce-a5e2-9d71d85930e3' could not be found; either it does not exist or it failed to parse. 2024-06-19T01:12:15.477482594Z [2024-06-19 01:12:15,476: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b1365fe2-4b18-4ecf-bcea-f7daf6b8c823] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id b1365fe2-4b18-4ecf-bcea-f7daf6b8c823') 2024-06-19T01:12:15.477500315Z Traceback (most recent call last): 2024-06-19T01:12:15.477505330Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-06-19T01:12:15.477509200Z R = retval = fun(*args, **kwargs) 2024-06-19T01:12:15.477513229Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-06-19T01:12:15.477517267Z return self.run(*args, **kwargs) 2024-06-19T01:12:15.477521478Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-06-19T01:12:15.477526303Z _execute_in_fork(command_to_exec, celery_task_id) 2024-06-19T01:12:15.477530032Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-06-19T01:12:15.477534131Z raise AirflowException(msg) 2024-06-19T01:12:15.477538373Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id b1365fe2-4b18-4ecf-bcea-f7daf6b8c823 2024-06-19T01:12:15.501431044Z [2024-06-19 01:12:15,500: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3c91e8f3-ec2e-47a2-9abf-cfe20a88af9c] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 3c91e8f3-ec2e-47a2-9abf-cfe20a88af9c') 2024-06-19T01:12:15.501451315Z Traceback (most recent call last): 2024-06-19T01:12:15.501456702Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-06-19T01:12:15.501461098Z R = retval = fun(*args, **kwargs) 2024-06-19T01:12:15.501465169Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-06-19T01:12:15.501469273Z return self.run(*args, **kwargs) 2024-06-19T01:12:15.501473971Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-06-19T01:12:15.501478581Z _execute_in_fork(command_to_exec, celery_task_id) 2024-06-19T01:12:15.501482663Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-06-19T01:12:15.501487253Z raise AirflowException(msg) 2024-06-19T01:12:15.501492147Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 3c91e8f3-ec2e-47a2-9abf-cfe20a88af9c 2024-06-19T01:13:01.107781562Z [2024-06-19 01:13:01,107: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[61a3f811-bff9-4c58-8a3e-ff7b8051c3ec] received 2024-06-19T01:13:01.110774474Z [2024-06-19 01:13:01,110: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[892b4785-0bf1-44f6-8c4c-5a96fda000b1] received 2024-06-19T01:13:01.113815063Z [2024-06-19 01:13:01,113: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6ef39400-676f-4e74-935d-5dcf50b5ab3d] received 2024-06-19T01:13:01.119949697Z [2024-06-19 01:13:01,119: INFO/ForkPoolWorker-16] [892b4785-0bf1-44f6-8c4c-5a96fda000b1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_5a98d040-473b-42ce-a5e2-9d71d85930e3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T01:13:01.121445448Z [2024-06-19 01:13:01,121: INFO/ForkPoolWorker-15] [61a3f811-bff9-4c58-8a3e-ff7b8051c3ec] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T01:13:01.124427503Z [2024-06-19 01:13:01,124: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4927fd69-fc44-43e6-8a04-0b660f7ce9b8] received 2024-06-19T01:13:01.125454479Z [2024-06-19 01:13:01,125: INFO/ForkPoolWorker-1] [6ef39400-676f-4e74-935d-5dcf50b5ab3d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T01:13:01.132689023Z [2024-06-19 01:13:01,132: INFO/ForkPoolWorker-2] [4927fd69-fc44-43e6-8a04-0b660f7ce9b8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_5a98d040-473b-42ce-a5e2-9d71d85930e3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T01:13:01.133764826Z [2024-06-19 01:13:01,133: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fd08e3f9-4e32-4dc3-9de3-63f8d1be0383] received 2024-06-19T01:13:01.140844771Z [2024-06-19 01:13:01,140: INFO/ForkPoolWorker-3] [fd08e3f9-4e32-4dc3-9de3-63f8d1be0383] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T01:13:01.433580445Z [2024-06-19 01:13:01,430: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T01:13:01.462844070Z [2024-06-19 01:13:01,459: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T01:13:01.484860800Z [2024-06-19 01:13:01,481: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T01:13:01.700809286Z [2024-06-19 01:13:01,697: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T01:13:01.803115961Z [2024-06-19 01:13:01,795: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T01:13:01.998581464Z [2024-06-19 01:13:01,998: INFO/ForkPoolWorker-3] Getting SDNC list 2024-06-19T01:13:02.008149209Z [2024-06-19 01:13:02,007: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:13:02.064629193Z [2024-06-19 01:13:02,064: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-06-19T01:13:02.072351652Z [2024-06-19 01:13:02,066: INFO/ForkPoolWorker-3] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T01:13:02.072584431Z [2024-06-19 01:13:02,072: INFO/ForkPoolWorker-3] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T01:13:02.072662455Z [2024-06-19 01:13:02,072: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-06-19T01:13:02.072982271Z [2024-06-19 01:13:02,072: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T01:13:02.216283711Z [2024-06-19 01:13:02,216: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:13:02.968745934Z [2024-06-19 01:13:02,968: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[fd08e3f9-4e32-4dc3-9de3-63f8d1be0383] succeeded in 1.8332089070008806s: None 2024-06-19T01:13:03.099919571Z [2024-06-19 01:13:03,099: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-19T01:13:03.105602009Z [2024-06-19 01:13:03,105: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:13:03.140505296Z [2024-06-19 01:13:03,140: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T01:13:03.142398571Z [2024-06-19 01:13:03,142: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:13:03.142489942Z [2024-06-19 01:13:03,142: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:13:03.142646135Z [2024-06-19 01:13:03,142: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:13:03.142793662Z [2024-06-19 01:13:03,142: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-19T01:13:03.143156124Z [2024-06-19 01:13:03,143: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T01:13:03.143250695Z [2024-06-19 01:13:03,143: INFO/ForkPoolWorker-2] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:13:03.149946389Z [2024-06-19 01:13:03,149: WARNING/ForkPoolWorker-2] Dag 'vim_status_5a98d040-473b-42ce-a5e2-9d71d85930e3' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T01:13:03.150691286Z [2024-06-19 01:13:03,150: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T01:13:03.151471449Z [2024-06-19 01:13:03,151: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-19T01:13:03.154252903Z [2024-06-19 01:13:03,154: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:13:03.159315464Z [2024-06-19 01:13:03,159: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T01:13:03.162176819Z [2024-06-19 01:13:03,161: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T01:13:03.162902037Z [2024-06-19 01:13:03,162: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:13:03.170953783Z [2024-06-19 01:13:03,170: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:13:03.171336518Z [2024-06-19 01:13:03,171: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T01:13:03.173104417Z [2024-06-19 01:13:03,172: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:13:03.173202154Z [2024-06-19 01:13:03,173: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:13:03.173698153Z [2024-06-19 01:13:03,173: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:13:03.174010476Z [2024-06-19 01:13:03,173: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-19T01:13:03.174240174Z [2024-06-19 01:13:03,174: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T01:13:03.174329620Z [2024-06-19 01:13:03,174: INFO/ForkPoolWorker-2] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:13:03.177649904Z [2024-06-19 01:13:03,177: ERROR/ForkPoolWorker-2] [4927fd69-fc44-43e6-8a04-0b660f7ce9b8] Failed to execute task Dag 'vim_status_5a98d040-473b-42ce-a5e2-9d71d85930e3' could not be found; either it does not exist or it failed to parse.. 2024-06-19T01:13:03.177680164Z Traceback (most recent call last): 2024-06-19T01:13:03.177690299Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-06-19T01:13:03.177700468Z args.func(args) 2024-06-19T01:13:03.177709767Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-06-19T01:13:03.177718845Z return func(*args, **kwargs) 2024-06-19T01:13:03.177727067Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-06-19T01:13:03.177735987Z return f(*args, **kwargs) 2024-06-19T01:13:03.177744512Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-06-19T01:13:03.177753002Z dag = get_dag(args.subdir, args.dag_id) 2024-06-19T01:13:03.177761564Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-06-19T01:13:03.177770995Z raise AirflowException( 2024-06-19T01:13:03.177780074Z airflow.exceptions.AirflowException: Dag 'vim_status_5a98d040-473b-42ce-a5e2-9d71d85930e3' could not be found; either it does not exist or it failed to parse. 2024-06-19T01:13:03.198331881Z [2024-06-19 01:13:03,198: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T01:13:03.200599942Z [2024-06-19 01:13:03,199: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:13:03.200617777Z [2024-06-19 01:13:03,200: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:13:03.200622555Z [2024-06-19 01:13:03,200: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:13:03.200626982Z [2024-06-19 01:13:03,200: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T01:13:03.200933367Z [2024-06-19 01:13:03,200: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-06-19T01:13:03.201130755Z [2024-06-19 01:13:03,200: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:13:03.214726443Z [2024-06-19 01:13:03,214: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T01:13:03.215385188Z [2024-06-19 01:13:03,214: ERROR/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[4927fd69-fc44-43e6-8a04-0b660f7ce9b8] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 4927fd69-fc44-43e6-8a04-0b660f7ce9b8') 2024-06-19T01:13:03.215396793Z Traceback (most recent call last): 2024-06-19T01:13:03.215400812Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-06-19T01:13:03.215403894Z R = retval = fun(*args, **kwargs) 2024-06-19T01:13:03.215407133Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-06-19T01:13:03.215410241Z return self.run(*args, **kwargs) 2024-06-19T01:13:03.215413873Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-06-19T01:13:03.215417555Z _execute_in_fork(command_to_exec, celery_task_id) 2024-06-19T01:13:03.215420598Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-06-19T01:13:03.215424311Z raise AirflowException(msg) 2024-06-19T01:13:03.215428112Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 4927fd69-fc44-43e6-8a04-0b660f7ce9b8 2024-06-19T01:13:03.216767888Z [2024-06-19 01:13:03,216: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:13:03.216780761Z [2024-06-19 01:13:03,216: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:13:03.217061099Z [2024-06-19 01:13:03,216: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:13:03.217081876Z [2024-06-19 01:13:03,216: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T01:13:03.217461428Z [2024-06-19 01:13:03,217: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-19T01:13:03.217472126Z [2024-06-19 01:13:03,217: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:13:03.223880958Z [2024-06-19 01:13:03,223: WARNING/ForkPoolWorker-16] Dag 'vm_status_vim_5a98d040-473b-42ce-a5e2-9d71d85930e3' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T01:13:03.225301541Z [2024-06-19 01:13:03,224: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T01:13:03.226516940Z [2024-06-19 01:13:03,226: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T01:13:03.229732057Z [2024-06-19 01:13:03,229: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:13:03.250123138Z [2024-06-19 01:13:03,249: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T01:13:03.250874000Z [2024-06-19 01:13:03,250: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T01:13:03.251529109Z [2024-06-19 01:13:03,251: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:13:03.251541205Z [2024-06-19 01:13:03,251: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:13:03.251905119Z [2024-06-19 01:13:03,251: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:13:03.252034179Z [2024-06-19 01:13:03,251: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T01:13:03.252524308Z [2024-06-19 01:13:03,252: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-19T01:13:03.252664930Z [2024-06-19 01:13:03,252: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:13:03.254097482Z [2024-06-19 01:13:03,253: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:13:03.256792687Z [2024-06-19 01:13:03,256: ERROR/ForkPoolWorker-16] [892b4785-0bf1-44f6-8c4c-5a96fda000b1] Failed to execute task Dag 'vm_status_vim_5a98d040-473b-42ce-a5e2-9d71d85930e3' could not be found; either it does not exist or it failed to parse.. 2024-06-19T01:13:03.256805980Z Traceback (most recent call last): 2024-06-19T01:13:03.256810033Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-06-19T01:13:03.256814335Z args.func(args) 2024-06-19T01:13:03.256818303Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-06-19T01:13:03.256821835Z return func(*args, **kwargs) 2024-06-19T01:13:03.256825540Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-06-19T01:13:03.256828689Z return f(*args, **kwargs) 2024-06-19T01:13:03.256831900Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-06-19T01:13:03.256835160Z dag = get_dag(args.subdir, args.dag_id) 2024-06-19T01:13:03.256838307Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-06-19T01:13:03.256895587Z raise AirflowException( 2024-06-19T01:13:03.256900431Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_5a98d040-473b-42ce-a5e2-9d71d85930e3' could not be found; either it does not exist or it failed to parse. 2024-06-19T01:13:03.286019518Z [2024-06-19 01:13:03,285: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T01:13:03.287832301Z [2024-06-19 01:13:03,287: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:13:03.287851279Z [2024-06-19 01:13:03,287: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:13:03.288076873Z [2024-06-19 01:13:03,287: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:13:03.288095627Z [2024-06-19 01:13:03,287: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T01:13:03.288455462Z [2024-06-19 01:13:03,288: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T01:13:03.288467958Z [2024-06-19 01:13:03,288: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:13:03.313275257Z [2024-06-19 01:13:03,312: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:13:03.319298079Z [2024-06-19 01:13:03,318: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[892b4785-0bf1-44f6-8c4c-5a96fda000b1] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 892b4785-0bf1-44f6-8c4c-5a96fda000b1') 2024-06-19T01:13:03.319356880Z Traceback (most recent call last): 2024-06-19T01:13:03.319365791Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-06-19T01:13:03.319370119Z R = retval = fun(*args, **kwargs) 2024-06-19T01:13:03.319374536Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-06-19T01:13:03.319378764Z return self.run(*args, **kwargs) 2024-06-19T01:13:03.319383262Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-06-19T01:13:03.319389287Z _execute_in_fork(command_to_exec, celery_task_id) 2024-06-19T01:13:03.319394504Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-06-19T01:13:03.319399792Z raise AirflowException(msg) 2024-06-19T01:13:03.319457553Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 892b4785-0bf1-44f6-8c4c-5a96fda000b1 2024-06-19T01:13:03.379662914Z [2024-06-19 01:13:03,379: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:13:05.382859430Z [2024-06-19 01:13:05,382: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6ef39400-676f-4e74-935d-5dcf50b5ab3d] succeeded in 4.2669341610017s: None 2024-06-19T01:13:06.010112094Z [2024-06-19 01:13:06,009: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[61a3f811-bff9-4c58-8a3e-ff7b8051c3ec] succeeded in 4.900671121000414s: None 2024-06-19T01:14:00.467751995Z [2024-06-19 01:14:00,467: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[89ed77c0-0305-4dbf-a6b5-228417c0cbe6] received 2024-06-19T01:14:00.471578018Z [2024-06-19 01:14:00,471: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a2763370-46e2-412a-ac9c-1922d137010b] received 2024-06-19T01:14:00.473775246Z [2024-06-19 01:14:00,473: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[667bacfd-7a48-4704-9e55-5b43e70a7f76] received 2024-06-19T01:14:00.475680675Z [2024-06-19 01:14:00,475: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[48d9310d-609a-41e8-a6fc-709e2b3ee6bc] received 2024-06-19T01:14:00.483323274Z [2024-06-19 01:14:00,483: INFO/ForkPoolWorker-15] [89ed77c0-0305-4dbf-a6b5-228417c0cbe6] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-19T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-19T01:14:00.487375199Z [2024-06-19 01:14:00,487: INFO/ForkPoolWorker-1] [667bacfd-7a48-4704-9e55-5b43e70a7f76] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T01:14:00.487628359Z [2024-06-19 01:14:00,487: INFO/ForkPoolWorker-2] [48d9310d-609a-41e8-a6fc-709e2b3ee6bc] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T01:14:00.488552392Z [2024-06-19 01:14:00,488: INFO/ForkPoolWorker-16] [a2763370-46e2-412a-ac9c-1922d137010b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T01:14:00.797208719Z [2024-06-19 01:14:00,793: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-19T01:14:00.858009421Z [2024-06-19 01:14:00,854: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T01:14:00.877341568Z [2024-06-19 01:14:00,872: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T01:14:00.884154570Z [2024-06-19 01:14:00,880: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T01:14:01.075235603Z [2024-06-19 01:14:01,074: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:14:01.090089242Z [2024-06-19 01:14:01,089: INFO/ForkPoolWorker-2] Getting SDNC list 2024-06-19T01:14:01.094172617Z [2024-06-19 01:14:01,093: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:14:01.120711357Z [2024-06-19 01:14:01,120: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T01:14:01.121996620Z [2024-06-19 01:14:01,121: INFO/ForkPoolWorker-2] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T01:14:01.122191328Z [2024-06-19 01:14:01,121: INFO/ForkPoolWorker-2] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T01:14:01.122407003Z [2024-06-19 01:14:01,122: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-06-19T01:14:01.122897952Z [2024-06-19 01:14:01,122: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T01:14:01.235524484Z [2024-06-19 01:14:01,235: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:14:01.681082561Z [2024-06-19 01:14:01,680: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[89ed77c0-0305-4dbf-a6b5-228417c0cbe6] succeeded in 1.2109599209998123s: None 2024-06-19T01:14:01.871902251Z [2024-06-19 01:14:01,871: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[48d9310d-609a-41e8-a6fc-709e2b3ee6bc] succeeded in 1.3937471019999066s: None 2024-06-19T01:14:02.112535529Z [2024-06-19 01:14:02,112: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T01:14:02.115521190Z [2024-06-19 01:14:02,115: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:14:02.137640299Z [2024-06-19 01:14:02,137: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T01:14:02.138821648Z [2024-06-19 01:14:02,138: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:14:02.138863502Z [2024-06-19 01:14:02,138: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:14:02.139057521Z [2024-06-19 01:14:02,138: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:14:02.139119809Z [2024-06-19 01:14:02,139: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T01:14:02.139380618Z [2024-06-19 01:14:02,139: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T01:14:02.139454897Z [2024-06-19 01:14:02,139: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:14:02.215791957Z [2024-06-19 01:14:02,211: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T01:14:02.221756053Z [2024-06-19 01:14:02,215: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:14:02.221771875Z [2024-06-19 01:14:02,215: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:14:02.302742637Z [2024-06-19 01:14:02,302: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T01:14:02.304886235Z [2024-06-19 01:14:02,304: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:14:02.305086947Z [2024-06-19 01:14:02,304: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:14:02.305301994Z [2024-06-19 01:14:02,305: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:14:02.305623342Z [2024-06-19 01:14:02,305: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T01:14:02.305915423Z [2024-06-19 01:14:02,305: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-19T01:14:02.306155084Z [2024-06-19 01:14:02,306: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:14:02.390730053Z [2024-06-19 01:14:02,390: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:14:03.722961993Z [2024-06-19 01:14:03,722: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[667bacfd-7a48-4704-9e55-5b43e70a7f76] succeeded in 3.2466809560010006s: None 2024-06-19T01:14:04.227243958Z [2024-06-19 01:14:04,226: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a2763370-46e2-412a-ac9c-1922d137010b] succeeded in 3.7526167659998464s: None 2024-06-19T01:15:00.934358818Z [2024-06-19 01:15:00,933: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[05377359-9239-438e-b685-b9a0215d6f58] received 2024-06-19T01:15:00.940519488Z [2024-06-19 01:15:00,940: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9dbd5f8c-e69a-48c4-a757-3a40ee12b2ef] received 2024-06-19T01:15:00.950483287Z [2024-06-19 01:15:00,949: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8537a2d4-71b5-4308-8e80-c379c15dcf17] received 2024-06-19T01:15:00.952162239Z [2024-06-19 01:15:00,951: INFO/ForkPoolWorker-16] [9dbd5f8c-e69a-48c4-a757-3a40ee12b2ef] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T01:15:00.954988270Z [2024-06-19 01:15:00,954: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[554cabfb-5a2b-4715-81d1-ac4dc35f1888] received 2024-06-19T01:15:00.962261805Z [2024-06-19 01:15:00,961: INFO/ForkPoolWorker-1] [8537a2d4-71b5-4308-8e80-c379c15dcf17] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T01:15:00.964435607Z [2024-06-19 01:15:00,964: INFO/ForkPoolWorker-15] [05377359-9239-438e-b685-b9a0215d6f58] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-19T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T01:15:00.968439505Z [2024-06-19 01:15:00,968: INFO/ForkPoolWorker-2] [554cabfb-5a2b-4715-81d1-ac4dc35f1888] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T01:15:01.297021600Z [2024-06-19 01:15:01,293: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T01:15:01.340101364Z [2024-06-19 01:15:01,336: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T01:15:01.370560559Z [2024-06-19 01:15:01,367: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T01:15:01.466124576Z [2024-06-19 01:15:01,463: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T01:15:01.685114358Z [2024-06-19 01:15:01,684: INFO/ForkPoolWorker-2] Getting SDNC list 2024-06-19T01:15:01.688980231Z [2024-06-19 01:15:01,688: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:15:01.717170895Z [2024-06-19 01:15:01,716: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T01:15:01.719376737Z [2024-06-19 01:15:01,719: INFO/ForkPoolWorker-2] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T01:15:01.719416196Z [2024-06-19 01:15:01,719: INFO/ForkPoolWorker-2] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T01:15:01.719468189Z [2024-06-19 01:15:01,719: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-06-19T01:15:01.719658650Z [2024-06-19 01:15:01,719: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T01:15:01.810080157Z [2024-06-19 01:15:01,809: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:15:02.492846786Z [2024-06-19 01:15:02,492: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[554cabfb-5a2b-4715-81d1-ac4dc35f1888] succeeded in 1.53354730799947s: None 2024-06-19T01:15:02.622453092Z [2024-06-19 01:15:02,622: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T01:15:02.625781938Z [2024-06-19 01:15:02,625: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:15:02.678839031Z [2024-06-19 01:15:02,678: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T01:15:02.680136957Z [2024-06-19 01:15:02,679: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:15:02.680202725Z [2024-06-19 01:15:02,680: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:15:02.680418563Z [2024-06-19 01:15:02,680: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:15:02.680481223Z [2024-06-19 01:15:02,680: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T01:15:02.680886438Z [2024-06-19 01:15:02,680: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-19T01:15:02.681039387Z [2024-06-19 01:15:02,680: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:15:02.685656295Z [2024-06-19 01:15:02,685: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T01:15:02.689251754Z [2024-06-19 01:15:02,688: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:15:02.710182323Z [2024-06-19 01:15:02,709: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T01:15:02.711865220Z [2024-06-19 01:15:02,711: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:15:02.712002174Z [2024-06-19 01:15:02,711: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:15:02.712200280Z [2024-06-19 01:15:02,712: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:15:02.712215778Z [2024-06-19 01:15:02,711: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T01:15:02.712362989Z [2024-06-19 01:15:02,712: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T01:15:02.712677378Z [2024-06-19 01:15:02,712: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T01:15:02.712826843Z [2024-06-19 01:15:02,712: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:15:02.715652852Z [2024-06-19 01:15:02,715: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:15:02.747615349Z [2024-06-19 01:15:02,747: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T01:15:02.748978461Z [2024-06-19 01:15:02,748: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:15:02.749171784Z [2024-06-19 01:15:02,748: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:15:02.749511402Z [2024-06-19 01:15:02,749: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:15:02.749547265Z [2024-06-19 01:15:02,749: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T01:15:02.749943903Z [2024-06-19 01:15:02,749: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T01:15:02.750136302Z [2024-06-19 01:15:02,749: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:15:02.762594538Z [2024-06-19 01:15:02,762: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:15:02.814446176Z [2024-06-19 01:15:02,814: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:15:02.855951300Z [2024-06-19 01:15:02,855: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:15:03.483862247Z [2024-06-19 01:15:03,482: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[05377359-9239-438e-b685-b9a0215d6f58] succeeded in 2.543159745999219s: None 2024-06-19T01:15:04.228509580Z [2024-06-19 01:15:04,228: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[861ae635-634e-4c70-b72e-59d263575909] received 2024-06-19T01:15:04.235308620Z [2024-06-19 01:15:04,235: INFO/ForkPoolWorker-15] [861ae635-634e-4c70-b72e-59d263575909] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'split_metrics', 'scheduled__2024-06-19T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T01:15:04.355412267Z [2024-06-19 01:15:04,354: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8537a2d4-71b5-4308-8e80-c379c15dcf17] succeeded in 3.402100684999823s: None 2024-06-19T01:15:04.555361957Z [2024-06-19 01:15:04,552: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T01:15:05.579227687Z [2024-06-19 01:15:05,578: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T01:15:05.582289392Z [2024-06-19 01:15:05,581: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:15:05.603153448Z [2024-06-19 01:15:05,602: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T01:15:05.604417732Z [2024-06-19 01:15:05,604: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:15:05.604430708Z [2024-06-19 01:15:05,604: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:15:05.604660605Z [2024-06-19 01:15:05,604: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:15:05.604679130Z [2024-06-19 01:15:05,604: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T01:15:05.605136851Z [2024-06-19 01:15:05,604: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T01:15:05.605169594Z [2024-06-19 01:15:05,604: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:15:05.692323423Z [2024-06-19 01:15:05,691: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:15:06.354359185Z [2024-06-19 01:15:06,353: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[861ae635-634e-4c70-b72e-59d263575909] succeeded in 2.12355378599932s: None 2024-06-19T01:15:06.473526106Z [2024-06-19 01:15:06,473: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9dbd5f8c-e69a-48c4-a757-3a40ee12b2ef] succeeded in 5.5303390080007375s: None 2024-06-19T01:15:06.627540045Z [2024-06-19 01:15:06,627: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[82e7251a-0f66-4d89-8856-f5b88e4449eb] received 2024-06-19T01:15:06.639282521Z [2024-06-19 01:15:06,638: INFO/ForkPoolWorker-15] [82e7251a-0f66-4d89-8856-f5b88e4449eb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'collect_metrics', 'scheduled__2024-06-19T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-19T01:15:06.929186559Z [2024-06-19 01:15:06,925: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T01:15:08.038491048Z [2024-06-19 01:15:08,037: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T01:15:08.041571792Z [2024-06-19 01:15:08,041: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:15:08.063396750Z [2024-06-19 01:15:08,063: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T01:15:08.065606242Z [2024-06-19 01:15:08,065: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:15:08.065702222Z [2024-06-19 01:15:08,065: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:15:08.065984756Z [2024-06-19 01:15:08,065: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:15:08.066095527Z [2024-06-19 01:15:08,065: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T01:15:08.066526847Z [2024-06-19 01:15:08,066: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T01:15:08.066643770Z [2024-06-19 01:15:08,066: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:15:08.167504924Z [2024-06-19 01:15:08,167: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:15:08.748184025Z [2024-06-19 01:15:08,747: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5655aa46-9cb4-472f-9bea-76e5e7acb817] received 2024-06-19T01:15:08.756002116Z [2024-06-19 01:15:08,755: INFO/ForkPoolWorker-16] [5655aa46-9cb4-472f-9bea-76e5e7acb817] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'send_prometheus', 'scheduled__2024-06-19T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T01:15:08.792414843Z [2024-06-19 01:15:08,792: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[82e7251a-0f66-4d89-8856-f5b88e4449eb] succeeded in 2.1613749879998068s: None 2024-06-19T01:15:09.117789451Z [2024-06-19 01:15:09,114: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T01:15:10.192459058Z [2024-06-19 01:15:10,192: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T01:15:10.195501952Z [2024-06-19 01:15:10,195: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:15:10.219843728Z [2024-06-19 01:15:10,219: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T01:15:10.222498909Z [2024-06-19 01:15:10,222: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:15:10.222610205Z [2024-06-19 01:15:10,222: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:15:10.222811422Z [2024-06-19 01:15:10,222: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:15:10.222850506Z [2024-06-19 01:15:10,222: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T01:15:10.223026647Z [2024-06-19 01:15:10,222: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T01:15:10.223039186Z [2024-06-19 01:15:10,222: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:15:10.299632411Z [2024-06-19 01:15:10,299: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:15:10.923924942Z [2024-06-19 01:15:10,923: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5655aa46-9cb4-472f-9bea-76e5e7acb817] succeeded in 2.1733867629991437s: None 2024-06-19T01:16:00.412422905Z [2024-06-19 01:16:00,412: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[58d4233c-a2bf-4022-9f46-6403831e6e48] received 2024-06-19T01:16:00.416374083Z [2024-06-19 01:16:00,416: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f4a50ab4-75e9-46e9-bd3c-4a6d889d1eeb] received 2024-06-19T01:16:00.425208944Z [2024-06-19 01:16:00,424: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d9b5a7a8-7f84-49af-ac2a-81a82db0f36b] received 2024-06-19T01:16:00.425476783Z [2024-06-19 01:16:00,425: INFO/ForkPoolWorker-16] [f4a50ab4-75e9-46e9-bd3c-4a6d889d1eeb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T01:16:00.429043968Z [2024-06-19 01:16:00,428: INFO/ForkPoolWorker-15] [58d4233c-a2bf-4022-9f46-6403831e6e48] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-19T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-19T01:16:00.436690391Z [2024-06-19 01:16:00,436: INFO/ForkPoolWorker-1] [d9b5a7a8-7f84-49af-ac2a-81a82db0f36b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T01:16:00.437178214Z [2024-06-19 01:16:00,437: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e049f8ac-b6fb-4d06-b997-17cb987bc88c] received 2024-06-19T01:16:00.444829666Z [2024-06-19 01:16:00,444: INFO/ForkPoolWorker-2] [e049f8ac-b6fb-4d06-b997-17cb987bc88c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T01:16:00.715138634Z [2024-06-19 01:16:00,711: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T01:16:00.792727570Z [2024-06-19 01:16:00,788: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T01:16:00.941759593Z [2024-06-19 01:16:00,941: INFO/ForkPoolWorker-2] Getting SDNC list 2024-06-19T01:16:00.944880573Z [2024-06-19 01:16:00,937: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-19T01:16:00.945621279Z [2024-06-19 01:16:00,945: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:16:00.988278093Z [2024-06-19 01:16:00,988: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T01:16:00.992271451Z [2024-06-19 01:16:00,992: INFO/ForkPoolWorker-2] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T01:16:00.992454265Z [2024-06-19 01:16:00,992: INFO/ForkPoolWorker-2] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T01:16:00.992552881Z [2024-06-19 01:16:00,992: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-06-19T01:16:00.992752951Z [2024-06-19 01:16:00,992: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T01:16:01.086816310Z [2024-06-19 01:16:01,086: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:16:01.148952080Z [2024-06-19 01:16:01,145: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T01:16:01.270945892Z [2024-06-19 01:16:01,270: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:16:01.778510617Z [2024-06-19 01:16:01,778: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[e049f8ac-b6fb-4d06-b997-17cb987bc88c] succeeded in 1.339615455000967s: None 2024-06-19T01:16:01.974588244Z [2024-06-19 01:16:01,974: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[58d4233c-a2bf-4022-9f46-6403831e6e48] succeeded in 1.5561678249996476s: None 2024-06-19T01:16:02.193124796Z [2024-06-19 01:16:02,190: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T01:16:02.195750679Z [2024-06-19 01:16:02,194: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:16:02.248375547Z [2024-06-19 01:16:02,244: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T01:16:02.250254795Z [2024-06-19 01:16:02,249: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:16:02.250286750Z [2024-06-19 01:16:02,250: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:16:02.250345056Z [2024-06-19 01:16:02,250: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:16:02.250389477Z [2024-06-19 01:16:02,250: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T01:16:02.250593931Z [2024-06-19 01:16:02,250: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T01:16:02.250640281Z [2024-06-19 01:16:02,250: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:16:02.382775548Z [2024-06-19 01:16:02,382: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:16:02.764672696Z [2024-06-19 01:16:02,764: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T01:16:02.767937019Z [2024-06-19 01:16:02,767: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:16:02.797031577Z [2024-06-19 01:16:02,796: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T01:16:02.799066324Z [2024-06-19 01:16:02,798: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:16:02.799317099Z [2024-06-19 01:16:02,799: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:16:02.799640428Z [2024-06-19 01:16:02,799: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:16:02.799908226Z [2024-06-19 01:16:02,799: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T01:16:02.800549370Z [2024-06-19 01:16:02,800: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-19T01:16:02.800831859Z [2024-06-19 01:16:02,800: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:16:02.910327746Z [2024-06-19 01:16:02,909: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:16:03.868790068Z [2024-06-19 01:16:03,868: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d9b5a7a8-7f84-49af-ac2a-81a82db0f36b] succeeded in 3.4409080810000887s: None 2024-06-19T01:16:05.431249490Z [2024-06-19 01:16:05,430: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f4a50ab4-75e9-46e9-bd3c-4a6d889d1eeb] succeeded in 5.013126033001754s: None 2024-06-19T01:17:00.828275384Z [2024-06-19 01:17:00,822: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4327cff5-77a1-4d80-b8e0-1095a55e4095] received 2024-06-19T01:17:00.838640622Z [2024-06-19 01:17:00,837: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b56b9311-fb2f-4a42-b669-b90e58052485] received 2024-06-19T01:17:00.848123767Z [2024-06-19 01:17:00,846: INFO/ForkPoolWorker-15] [4327cff5-77a1-4d80-b8e0-1095a55e4095] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T01:17:00.848437200Z [2024-06-19 01:17:00,848: INFO/ForkPoolWorker-16] [b56b9311-fb2f-4a42-b669-b90e58052485] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T01:17:01.062431180Z [2024-06-19 01:17:01,062: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[00826a3d-1fb1-44c9-abcb-9f55264f6869] received 2024-06-19T01:17:01.081833705Z [2024-06-19 01:17:01,081: INFO/ForkPoolWorker-1] [00826a3d-1fb1-44c9-abcb-9f55264f6869] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T01:17:01.150615423Z [2024-06-19 01:17:01,147: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T01:17:01.161537385Z [2024-06-19 01:17:01,158: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T01:17:01.410918360Z [2024-06-19 01:17:01,407: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T01:17:01.562801927Z [2024-06-19 01:17:01,562: INFO/ForkPoolWorker-1] Getting SDNC list 2024-06-19T01:17:01.566916107Z [2024-06-19 01:17:01,566: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:17:01.624633935Z [2024-06-19 01:17:01,624: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T01:17:01.625681629Z [2024-06-19 01:17:01,625: INFO/ForkPoolWorker-1] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T01:17:01.625881762Z [2024-06-19 01:17:01,625: INFO/ForkPoolWorker-1] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T01:17:01.625989015Z [2024-06-19 01:17:01,625: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-06-19T01:17:01.626222071Z [2024-06-19 01:17:01,626: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T01:17:01.744654260Z [2024-06-19 01:17:01,744: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:17:02.417956426Z [2024-06-19 01:17:02,417: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[00826a3d-1fb1-44c9-abcb-9f55264f6869] succeeded in 1.3538272130008409s: None 2024-06-19T01:17:02.782835553Z [2024-06-19 01:17:02,782: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T01:17:02.791052079Z [2024-06-19 01:17:02,790: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:17:02.807065547Z [2024-06-19 01:17:02,806: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T01:17:02.810697845Z [2024-06-19 01:17:02,810: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:17:02.825803289Z [2024-06-19 01:17:02,825: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T01:17:02.829621179Z [2024-06-19 01:17:02,829: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:17:02.830115095Z [2024-06-19 01:17:02,829: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T01:17:02.831376429Z [2024-06-19 01:17:02,831: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:17:02.831431854Z [2024-06-19 01:17:02,831: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:17:02.831614232Z [2024-06-19 01:17:02,829: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:17:02.831738566Z [2024-06-19 01:17:02,831: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:17:02.831865598Z [2024-06-19 01:17:02,831: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:17:02.832041747Z [2024-06-19 01:17:02,831: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T01:17:02.832114423Z [2024-06-19 01:17:02,831: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T01:17:02.832423769Z [2024-06-19 01:17:02,832: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T01:17:02.832499322Z [2024-06-19 01:17:02,832: INFO/ForkPoolWorker-16] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:17:02.836311070Z [2024-06-19 01:17:02,835: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-06-19T01:17:02.836618059Z [2024-06-19 01:17:02,836: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:17:02.905161411Z [2024-06-19 01:17:02,904: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:17:02.955745870Z [2024-06-19 01:17:02,955: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:17:05.089148856Z [2024-06-19 01:17:05,088: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b56b9311-fb2f-4a42-b669-b90e58052485] succeeded in 4.249276282998835s: None 2024-06-19T01:17:05.231162905Z [2024-06-19 01:17:05,230: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4327cff5-77a1-4d80-b8e0-1095a55e4095] succeeded in 4.398899844998596s: None 2024-06-19T01:18:01.283203310Z [2024-06-19 01:18:01,282: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4426a70b-73d2-47a7-bba6-add09e0a2d24] received 2024-06-19T01:18:01.287553432Z [2024-06-19 01:18:01,287: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4ac09bd1-400d-4c30-885c-0757616d559e] received 2024-06-19T01:18:01.290867682Z [2024-06-19 01:18:01,290: INFO/ForkPoolWorker-15] [4426a70b-73d2-47a7-bba6-add09e0a2d24] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-19T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-19T01:18:01.292133622Z [2024-06-19 01:18:01,291: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[caa61857-82f5-4c0c-97c5-e736bf042d5d] received 2024-06-19T01:18:01.296346637Z [2024-06-19 01:18:01,296: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e12e9b65-f981-48ef-b477-fc02680f6c04] received 2024-06-19T01:18:01.300947912Z [2024-06-19 01:18:01,300: INFO/ForkPoolWorker-1] [caa61857-82f5-4c0c-97c5-e736bf042d5d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T01:18:01.307230979Z [2024-06-19 01:18:01,307: INFO/ForkPoolWorker-16] [4ac09bd1-400d-4c30-885c-0757616d559e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T01:18:01.311109677Z [2024-06-19 01:18:01,310: INFO/ForkPoolWorker-2] [e12e9b65-f981-48ef-b477-fc02680f6c04] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T01:18:01.627280558Z [2024-06-19 01:18:01,623: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T01:18:01.679771887Z [2024-06-19 01:18:01,676: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T01:18:01.788229636Z [2024-06-19 01:18:01,784: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-19T01:18:01.861648342Z [2024-06-19 01:18:01,858: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T01:18:02.043707915Z [2024-06-19 01:18:02,043: INFO/ForkPoolWorker-2] Getting SDNC list 2024-06-19T01:18:02.048402425Z [2024-06-19 01:18:02,048: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:18:02.060832501Z [2024-06-19 01:18:02,060: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:18:02.125048274Z [2024-06-19 01:18:02,124: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T01:18:02.127933666Z [2024-06-19 01:18:02,127: INFO/ForkPoolWorker-2] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T01:18:02.128351351Z [2024-06-19 01:18:02,128: INFO/ForkPoolWorker-2] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T01:18:02.128641973Z [2024-06-19 01:18:02,128: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-06-19T01:18:02.129095697Z [2024-06-19 01:18:02,128: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T01:18:02.303622149Z [2024-06-19 01:18:02,300: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:18:02.699336092Z [2024-06-19 01:18:02,698: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4426a70b-73d2-47a7-bba6-add09e0a2d24] succeeded in 1.4146927960009634s: None 2024-06-19T01:18:02.939394941Z [2024-06-19 01:18:02,939: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[e12e9b65-f981-48ef-b477-fc02680f6c04] succeeded in 1.6415382110008068s: None 2024-06-19T01:18:03.160253179Z [2024-06-19 01:18:03,159: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T01:18:03.163350683Z [2024-06-19 01:18:03,162: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:18:03.192109053Z [2024-06-19 01:18:03,191: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T01:18:03.196936584Z [2024-06-19 01:18:03,196: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:18:03.197088986Z [2024-06-19 01:18:03,196: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:18:03.197375047Z [2024-06-19 01:18:03,197: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:18:03.197550127Z [2024-06-19 01:18:03,197: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T01:18:03.197937213Z [2024-06-19 01:18:03,197: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T01:18:03.198506998Z [2024-06-19 01:18:03,198: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:18:03.200875632Z [2024-06-19 01:18:03,200: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T01:18:03.204228050Z [2024-06-19 01:18:03,203: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:18:03.229501442Z [2024-06-19 01:18:03,229: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T01:18:03.230764028Z [2024-06-19 01:18:03,230: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:18:03.230788375Z [2024-06-19 01:18:03,230: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:18:03.230830927Z [2024-06-19 01:18:03,230: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:18:03.230839145Z [2024-06-19 01:18:03,230: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T01:18:03.231058690Z [2024-06-19 01:18:03,230: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-19T01:18:03.231098631Z [2024-06-19 01:18:03,231: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:18:03.287587566Z [2024-06-19 01:18:03,287: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:18:03.347131738Z [2024-06-19 01:18:03,346: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:18:05.461401651Z [2024-06-19 01:18:05,460: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[caa61857-82f5-4c0c-97c5-e736bf042d5d] succeeded in 4.167240679000315s: None 2024-06-19T01:18:05.980608739Z [2024-06-19 01:18:05,980: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4ac09bd1-400d-4c30-885c-0757616d559e] succeeded in 4.691127146999861s: None 2024-06-19T01:19:00.445319168Z [2024-06-19 01:19:00,444: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[342f1317-0d83-4491-967f-983d35aeff6b] received 2024-06-19T01:19:00.469485132Z [2024-06-19 01:19:00,469: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[59ad5167-fe79-4bf1-b75a-12c3f9f48a28] received 2024-06-19T01:19:00.470707252Z [2024-06-19 01:19:00,470: INFO/ForkPoolWorker-15] [342f1317-0d83-4491-967f-983d35aeff6b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T01:19:00.480412467Z [2024-06-19 01:19:00,480: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f5d8447e-6222-40c6-8b15-f6dc70e44c3b] received 2024-06-19T01:19:00.505744745Z [2024-06-19 01:19:00,505: INFO/ForkPoolWorker-16] [59ad5167-fe79-4bf1-b75a-12c3f9f48a28] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T01:19:00.505803886Z [2024-06-19 01:19:00,504: INFO/ForkPoolWorker-1] [f5d8447e-6222-40c6-8b15-f6dc70e44c3b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T01:19:00.904622674Z [2024-06-19 01:19:00,899: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T01:19:01.015611616Z [2024-06-19 01:19:01,012: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T01:19:01.088298869Z [2024-06-19 01:19:01,073: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T01:19:01.129991755Z [2024-06-19 01:19:01,129: INFO/ForkPoolWorker-15] Getting SDNC list 2024-06-19T01:19:01.134170851Z [2024-06-19 01:19:01,133: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:19:01.174730886Z [2024-06-19 01:19:01,174: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T01:19:01.175657947Z [2024-06-19 01:19:01,175: INFO/ForkPoolWorker-15] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T01:19:01.175760706Z [2024-06-19 01:19:01,175: INFO/ForkPoolWorker-15] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T01:19:01.180261200Z [2024-06-19 01:19:01,180: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-06-19T01:19:01.180873240Z [2024-06-19 01:19:01,180: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T01:19:01.345279204Z [2024-06-19 01:19:01,344: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:19:02.109024621Z [2024-06-19 01:19:02,108: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[342f1317-0d83-4491-967f-983d35aeff6b] succeeded in 1.657176843000343s: None 2024-06-19T01:19:02.714255036Z [2024-06-19 01:19:02,713: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T01:19:02.717807999Z [2024-06-19 01:19:02,717: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:19:02.739783138Z [2024-06-19 01:19:02,739: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T01:19:02.741042779Z [2024-06-19 01:19:02,740: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:19:02.741128079Z [2024-06-19 01:19:02,741: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:19:02.741227250Z [2024-06-19 01:19:02,741: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:19:02.741259533Z [2024-06-19 01:19:02,741: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T01:19:02.741472222Z [2024-06-19 01:19:02,741: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-06-19T01:19:02.741509112Z [2024-06-19 01:19:02,741: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:19:02.807193862Z [2024-06-19 01:19:02,806: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T01:19:02.810784180Z [2024-06-19 01:19:02,810: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:19:02.827148561Z [2024-06-19 01:19:02,826: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T01:19:02.828386129Z [2024-06-19 01:19:02,828: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:19:02.828537704Z [2024-06-19 01:19:02,828: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:19:02.829147472Z [2024-06-19 01:19:02,828: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:19:02.829255101Z [2024-06-19 01:19:02,829: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T01:19:02.829500174Z [2024-06-19 01:19:02,829: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T01:19:02.829586984Z [2024-06-19 01:19:02,829: INFO/ForkPoolWorker-16] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:19:02.869378665Z [2024-06-19 01:19:02,869: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:19:02.902351214Z [2024-06-19 01:19:02,902: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:19:05.400597772Z [2024-06-19 01:19:05,400: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[59ad5167-fe79-4bf1-b75a-12c3f9f48a28] succeeded in 4.9190582079991145s: None 2024-06-19T01:19:05.681074447Z [2024-06-19 01:19:05,680: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f5d8447e-6222-40c6-8b15-f6dc70e44c3b] succeeded in 5.197145932001149s: None 2024-06-19T01:20:00.547122155Z [2024-06-19 01:20:00,545: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[68716f67-a160-417a-9ab7-31c0466eaf99] received 2024-06-19T01:20:00.549991627Z [2024-06-19 01:20:00,549: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bbed72e8-532c-4503-97f2-d4d4c412fa7f] received 2024-06-19T01:20:00.558592170Z [2024-06-19 01:20:00,558: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bf1c9bd9-5167-49e1-9b53-5ab84b71b4b8] received 2024-06-19T01:20:00.563239100Z [2024-06-19 01:20:00,562: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9f7a2812-7e9c-45b7-8bc6-a0c29ddea78b] received 2024-06-19T01:20:00.568088531Z [2024-06-19 01:20:00,567: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[801332f3-6618-4ac7-8834-bcdb7c588f98] received 2024-06-19T01:20:00.573140489Z [2024-06-19 01:20:00,572: INFO/ForkPoolWorker-15] [68716f67-a160-417a-9ab7-31c0466eaf99] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T01:20:00.574683668Z [2024-06-19 01:20:00,574: INFO/ForkPoolWorker-1] [bf1c9bd9-5167-49e1-9b53-5ab84b71b4b8] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-19T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-19T01:20:00.575242574Z [2024-06-19 01:20:00,574: INFO/ForkPoolWorker-2] [9f7a2812-7e9c-45b7-8bc6-a0c29ddea78b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T01:20:00.582660411Z [2024-06-19 01:20:00,582: INFO/ForkPoolWorker-16] [bbed72e8-532c-4503-97f2-d4d4c412fa7f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-19T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T01:20:00.588660422Z [2024-06-19 01:20:00,588: INFO/ForkPoolWorker-3] [801332f3-6618-4ac7-8834-bcdb7c588f98] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T01:20:00.954716156Z [2024-06-19 01:20:00,951: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T01:20:00.985944493Z [2024-06-19 01:20:00,981: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-19T01:20:01.104242390Z [2024-06-19 01:20:01,100: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T01:20:01.141320132Z [2024-06-19 01:20:01,121: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T01:20:01.169300937Z [2024-06-19 01:20:01,165: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T01:20:01.486698621Z [2024-06-19 01:20:01,486: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:20:01.531203367Z [2024-06-19 01:20:01,530: INFO/ForkPoolWorker-15] Getting SDNC list 2024-06-19T01:20:01.535614847Z [2024-06-19 01:20:01,535: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:20:01.558750589Z [2024-06-19 01:20:01,558: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T01:20:01.560068848Z [2024-06-19 01:20:01,559: INFO/ForkPoolWorker-15] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T01:20:01.560721319Z [2024-06-19 01:20:01,560: INFO/ForkPoolWorker-15] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T01:20:01.560863875Z [2024-06-19 01:20:01,560: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-06-19T01:20:01.561156380Z [2024-06-19 01:20:01,561: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T01:20:01.667527087Z [2024-06-19 01:20:01,667: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:20:02.346485096Z [2024-06-19 01:20:02,345: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[bf1c9bd9-5167-49e1-9b53-5ab84b71b4b8] succeeded in 1.784193072000562s: None 2024-06-19T01:20:02.595902531Z [2024-06-19 01:20:02,595: INFO/ForkPoolWorker-3] Getting VIM list 2024-06-19T01:20:02.599193939Z [2024-06-19 01:20:02,598: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:20:02.615656670Z [2024-06-19 01:20:02,615: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[68716f67-a160-417a-9ab7-31c0466eaf99] succeeded in 2.062297540000145s: None 2024-06-19T01:20:02.621735488Z [2024-06-19 01:20:02,621: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-06-19T01:20:02.625361232Z [2024-06-19 01:20:02,625: INFO/ForkPoolWorker-3] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:20:02.625932631Z [2024-06-19 01:20:02,625: INFO/ForkPoolWorker-3] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:20:02.626137193Z [2024-06-19 01:20:02,625: INFO/ForkPoolWorker-3] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:20:02.626308902Z [2024-06-19 01:20:02,626: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-06-19T01:20:02.626881450Z [2024-06-19 01:20:02,626: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T01:20:02.627085660Z [2024-06-19 01:20:02,626: INFO/ForkPoolWorker-3] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:20:02.707827376Z [2024-06-19 01:20:02,707: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:20:02.815425857Z [2024-06-19 01:20:02,815: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-19T01:20:02.818516620Z [2024-06-19 01:20:02,818: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:20:02.835452571Z [2024-06-19 01:20:02,835: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T01:20:02.836781165Z [2024-06-19 01:20:02,836: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:20:02.836868229Z [2024-06-19 01:20:02,836: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:20:02.837064961Z [2024-06-19 01:20:02,836: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:20:02.837098396Z [2024-06-19 01:20:02,837: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-19T01:20:02.837505838Z [2024-06-19 01:20:02,837: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-06-19T01:20:02.837516368Z [2024-06-19 01:20:02,837: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:20:02.918066235Z [2024-06-19 01:20:02,917: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:20:02.971595053Z [2024-06-19 01:20:02,971: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T01:20:02.974765629Z [2024-06-19 01:20:02,974: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:20:02.995219258Z [2024-06-19 01:20:02,995: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T01:20:02.996554954Z [2024-06-19 01:20:02,996: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:20:02.996670810Z [2024-06-19 01:20:02,996: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:20:02.996860187Z [2024-06-19 01:20:02,996: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:20:02.997010643Z [2024-06-19 01:20:02,996: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T01:20:02.997342665Z [2024-06-19 01:20:02,997: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T01:20:02.997487012Z [2024-06-19 01:20:02,997: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:20:03.073467497Z [2024-06-19 01:20:03,073: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:20:03.737283804Z [2024-06-19 01:20:03,736: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[bbed72e8-532c-4503-97f2-d4d4c412fa7f] succeeded in 3.180767239000488s: None 2024-06-19T01:20:04.344878189Z [2024-06-19 01:20:04,344: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[801332f3-6618-4ac7-8834-bcdb7c588f98] succeeded in 3.7743731470000057s: None 2024-06-19T01:20:04.688314717Z [2024-06-19 01:20:04,688: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ba27d4fb-7b9a-45f1-a751-09e003ec84fd] received 2024-06-19T01:20:04.695405857Z [2024-06-19 01:20:04,695: INFO/ForkPoolWorker-15] [ba27d4fb-7b9a-45f1-a751-09e003ec84fd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'split_metrics', 'scheduled__2024-06-19T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T01:20:04.868667733Z [2024-06-19 01:20:04,868: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[9f7a2812-7e9c-45b7-8bc6-a0c29ddea78b] succeeded in 4.3032702679993236s: None 2024-06-19T01:20:04.988770836Z [2024-06-19 01:20:04,985: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T01:20:06.039736757Z [2024-06-19 01:20:06,039: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T01:20:06.042714659Z [2024-06-19 01:20:06,042: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:20:06.067800166Z [2024-06-19 01:20:06,067: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T01:20:06.069123705Z [2024-06-19 01:20:06,068: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:20:06.069149800Z [2024-06-19 01:20:06,068: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:20:06.069293434Z [2024-06-19 01:20:06,069: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:20:06.069310510Z [2024-06-19 01:20:06,069: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T01:20:06.069602735Z [2024-06-19 01:20:06,069: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T01:20:06.069619714Z [2024-06-19 01:20:06,069: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:20:06.180711253Z [2024-06-19 01:20:06,180: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:20:06.888370791Z [2024-06-19 01:20:06,887: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ba27d4fb-7b9a-45f1-a751-09e003ec84fd] succeeded in 2.198659104999024s: None 2024-06-19T01:20:07.087665499Z [2024-06-19 01:20:07,087: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ddd01584-c6f3-49d2-b535-d8654634d928] received 2024-06-19T01:20:07.097493461Z [2024-06-19 01:20:07,097: INFO/ForkPoolWorker-15] [ddd01584-c6f3-49d2-b535-d8654634d928] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'collect_metrics', 'scheduled__2024-06-19T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-19T01:20:07.378026787Z [2024-06-19 01:20:07,374: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T01:20:08.445453514Z [2024-06-19 01:20:08,445: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T01:20:08.448953772Z [2024-06-19 01:20:08,448: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:20:08.476149183Z [2024-06-19 01:20:08,475: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T01:20:08.477671148Z [2024-06-19 01:20:08,477: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:20:08.477933521Z [2024-06-19 01:20:08,477: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:20:08.478240506Z [2024-06-19 01:20:08,478: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:20:08.478466190Z [2024-06-19 01:20:08,478: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T01:20:08.478866766Z [2024-06-19 01:20:08,478: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T01:20:08.479129682Z [2024-06-19 01:20:08,478: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:20:08.552505150Z [2024-06-19 01:20:08,552: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:20:09.131383061Z [2024-06-19 01:20:09,130: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ddd01584-c6f3-49d2-b535-d8654634d928] succeeded in 2.0413970170011453s: None 2024-06-19T01:20:09.790881478Z [2024-06-19 01:20:09,790: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bab19586-42c7-42b2-84ee-fb0c9c6c1fb3] received 2024-06-19T01:20:09.799681034Z [2024-06-19 01:20:09,799: INFO/ForkPoolWorker-15] [bab19586-42c7-42b2-84ee-fb0c9c6c1fb3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'send_prometheus', 'scheduled__2024-06-19T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T01:20:10.072691045Z [2024-06-19 01:20:10,069: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T01:20:11.114451021Z [2024-06-19 01:20:11,113: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T01:20:11.117593702Z [2024-06-19 01:20:11,117: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:20:11.137781889Z [2024-06-19 01:20:11,137: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T01:20:11.139644045Z [2024-06-19 01:20:11,139: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:20:11.139958193Z [2024-06-19 01:20:11,139: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:20:11.140429950Z [2024-06-19 01:20:11,140: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:20:11.140581915Z [2024-06-19 01:20:11,140: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T01:20:11.140965065Z [2024-06-19 01:20:11,140: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T01:20:11.141469565Z [2024-06-19 01:20:11,141: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:20:11.250801868Z [2024-06-19 01:20:11,250: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:20:11.831835468Z [2024-06-19 01:20:11,831: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bab19586-42c7-42b2-84ee-fb0c9c6c1fb3] succeeded in 2.038989214999674s: None 2024-06-19T01:21:00.577527096Z [2024-06-19 01:21:00,576: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[99fe9d47-94cb-42f0-a425-aac23c6651d6] received 2024-06-19T01:21:00.580890168Z [2024-06-19 01:21:00,580: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dfd0520b-7bbe-4d77-bc1d-388734552072] received 2024-06-19T01:21:00.585203866Z [2024-06-19 01:21:00,584: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6e60d51a-05fa-4ce8-86c1-ba2d7a88e16c] received 2024-06-19T01:21:00.594376877Z [2024-06-19 01:21:00,593: INFO/ForkPoolWorker-16] [dfd0520b-7bbe-4d77-bc1d-388734552072] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T01:21:00.600756039Z [2024-06-19 01:21:00,600: INFO/ForkPoolWorker-15] [99fe9d47-94cb-42f0-a425-aac23c6651d6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T01:21:00.605324739Z [2024-06-19 01:21:00,605: INFO/ForkPoolWorker-1] [6e60d51a-05fa-4ce8-86c1-ba2d7a88e16c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T01:21:00.895036911Z [2024-06-19 01:21:00,891: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T01:21:00.900645380Z [2024-06-19 01:21:00,896: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T01:21:00.937892615Z [2024-06-19 01:21:00,934: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T01:21:01.114045234Z [2024-06-19 01:21:01,113: INFO/ForkPoolWorker-16] Getting SDNC list 2024-06-19T01:21:01.119192286Z [2024-06-19 01:21:01,118: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:21:01.152665027Z [2024-06-19 01:21:01,152: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T01:21:01.154196730Z [2024-06-19 01:21:01,153: INFO/ForkPoolWorker-16] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T01:21:01.154315890Z [2024-06-19 01:21:01,154: INFO/ForkPoolWorker-16] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T01:21:01.154464263Z [2024-06-19 01:21:01,154: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-06-19T01:21:01.154748458Z [2024-06-19 01:21:01,154: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T01:21:01.276523375Z [2024-06-19 01:21:01,276: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:21:01.845943477Z [2024-06-19 01:21:01,845: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[dfd0520b-7bbe-4d77-bc1d-388734552072] succeeded in 1.2625256250012171s: None 2024-06-19T01:21:02.133747208Z [2024-06-19 01:21:02,133: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T01:21:02.137213235Z [2024-06-19 01:21:02,136: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:21:02.158974807Z [2024-06-19 01:21:02,158: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T01:21:02.160486587Z [2024-06-19 01:21:02,160: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:21:02.160561068Z [2024-06-19 01:21:02,160: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:21:02.160757894Z [2024-06-19 01:21:02,160: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:21:02.160827029Z [2024-06-19 01:21:02,160: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T01:21:02.161662438Z [2024-06-19 01:21:02,161: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T01:21:02.161670713Z [2024-06-19 01:21:02,161: INFO/ForkPoolWorker-15] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:21:02.235756345Z [2024-06-19 01:21:02,234: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T01:21:02.239856790Z [2024-06-19 01:21:02,239: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:21:02.288574956Z [2024-06-19 01:21:02,287: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:21:02.297256265Z [2024-06-19 01:21:02,297: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T01:21:02.298550598Z [2024-06-19 01:21:02,298: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:21:02.298571697Z [2024-06-19 01:21:02,298: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:21:02.298584995Z [2024-06-19 01:21:02,298: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:21:02.298622497Z [2024-06-19 01:21:02,298: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T01:21:02.298823702Z [2024-06-19 01:21:02,298: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-06-19T01:21:02.298860576Z [2024-06-19 01:21:02,298: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:21:02.407980631Z [2024-06-19 01:21:02,407: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:21:03.766709661Z [2024-06-19 01:21:03,766: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[99fe9d47-94cb-42f0-a425-aac23c6651d6] succeeded in 3.1830089449995285s: None 2024-06-19T01:21:05.897238160Z [2024-06-19 01:21:05,896: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6e60d51a-05fa-4ce8-86c1-ba2d7a88e16c] succeeded in 5.307154187001288s: None 2024-06-19T01:22:00.443110405Z [2024-06-19 01:22:00,442: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[77b6f43c-b465-49ef-aa74-8b3df3acf3a1] received 2024-06-19T01:22:00.450608706Z [2024-06-19 01:22:00,450: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4fd3056e-b59d-4d78-992e-a8a75df97f03] received 2024-06-19T01:22:00.461894311Z [2024-06-19 01:22:00,461: INFO/ForkPoolWorker-16] [4fd3056e-b59d-4d78-992e-a8a75df97f03] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T01:22:00.462512522Z [2024-06-19 01:22:00,462: INFO/ForkPoolWorker-15] [77b6f43c-b465-49ef-aa74-8b3df3acf3a1] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-19T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-19T01:22:00.466348088Z [2024-06-19 01:22:00,466: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ffdecdac-8b17-4943-b0b8-33a4855f631c] received 2024-06-19T01:22:00.473540086Z [2024-06-19 01:22:00,473: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[faab0586-efcc-4a7f-8b27-36a6d90bb973] received 2024-06-19T01:22:00.481161635Z [2024-06-19 01:22:00,480: INFO/ForkPoolWorker-1] [ffdecdac-8b17-4943-b0b8-33a4855f631c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T01:22:00.492467355Z [2024-06-19 01:22:00,492: INFO/ForkPoolWorker-2] [faab0586-efcc-4a7f-8b27-36a6d90bb973] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T01:22:00.806830895Z [2024-06-19 01:22:00,801: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T01:22:00.838277242Z [2024-06-19 01:22:00,835: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-19T01:22:00.868060048Z [2024-06-19 01:22:00,862: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T01:22:00.890533673Z [2024-06-19 01:22:00,887: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T01:22:01.071622782Z [2024-06-19 01:22:01,071: INFO/ForkPoolWorker-2] Getting SDNC list 2024-06-19T01:22:01.075364370Z [2024-06-19 01:22:01,074: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:22:01.109090762Z [2024-06-19 01:22:01,108: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T01:22:01.112694201Z [2024-06-19 01:22:01,112: INFO/ForkPoolWorker-2] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T01:22:01.112762607Z [2024-06-19 01:22:01,112: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:22:01.112772722Z [2024-06-19 01:22:01,112: INFO/ForkPoolWorker-2] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T01:22:01.112850308Z [2024-06-19 01:22:01,112: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-06-19T01:22:01.113049309Z [2024-06-19 01:22:01,112: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T01:22:01.233954775Z [2024-06-19 01:22:01,233: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:22:01.905042843Z [2024-06-19 01:22:01,904: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[77b6f43c-b465-49ef-aa74-8b3df3acf3a1] succeeded in 1.457446725000409s: None 2024-06-19T01:22:01.947636338Z [2024-06-19 01:22:01,947: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[faab0586-efcc-4a7f-8b27-36a6d90bb973] succeeded in 1.4689141609997023s: None 2024-06-19T01:22:02.104358167Z [2024-06-19 01:22:02,103: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T01:22:02.107845041Z [2024-06-19 01:22:02,107: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:22:02.129499515Z [2024-06-19 01:22:02,129: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T01:22:02.130829368Z [2024-06-19 01:22:02,130: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:22:02.130849206Z [2024-06-19 01:22:02,130: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:22:02.131095993Z [2024-06-19 01:22:02,130: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:22:02.131177423Z [2024-06-19 01:22:02,131: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T01:22:02.131438469Z [2024-06-19 01:22:02,131: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-19T01:22:02.131464635Z [2024-06-19 01:22:02,131: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:22:02.159393004Z [2024-06-19 01:22:02,158: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T01:22:02.162795873Z [2024-06-19 01:22:02,162: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:22:02.189054903Z [2024-06-19 01:22:02,188: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T01:22:02.192689373Z [2024-06-19 01:22:02,192: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:22:02.192750409Z [2024-06-19 01:22:02,192: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:22:02.192946638Z [2024-06-19 01:22:02,192: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:22:02.198066220Z [2024-06-19 01:22:02,193: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T01:22:02.198088460Z [2024-06-19 01:22:02,197: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T01:22:02.199805319Z [2024-06-19 01:22:02,197: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:22:02.240784087Z [2024-06-19 01:22:02,240: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:22:02.376210442Z [2024-06-19 01:22:02,375: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:22:03.928462624Z [2024-06-19 01:22:03,928: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ffdecdac-8b17-4943-b0b8-33a4855f631c] succeeded in 3.4604083899994293s: None 2024-06-19T01:22:04.082623361Z [2024-06-19 01:22:04,082: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4fd3056e-b59d-4d78-992e-a8a75df97f03] succeeded in 3.6299403539997s: None 2024-06-19T01:23:00.473483235Z [2024-06-19 01:23:00,473: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[121112e3-fb55-447c-bc37-104783fd8a51] received 2024-06-19T01:23:00.475579288Z [2024-06-19 01:23:00,475: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f77ceeda-7096-42ca-bbc9-c5fa6704daf7] received 2024-06-19T01:23:00.477148902Z [2024-06-19 01:23:00,476: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1a4c52b0-3cf2-4012-9271-162c3bf54d25] received 2024-06-19T01:23:00.488864145Z [2024-06-19 01:23:00,488: INFO/ForkPoolWorker-16] [f77ceeda-7096-42ca-bbc9-c5fa6704daf7] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T01:23:00.489634733Z [2024-06-19 01:23:00,489: INFO/ForkPoolWorker-15] [121112e3-fb55-447c-bc37-104783fd8a51] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T01:23:00.493223916Z [2024-06-19 01:23:00,492: INFO/ForkPoolWorker-1] [1a4c52b0-3cf2-4012-9271-162c3bf54d25] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T01:23:00.780994524Z [2024-06-19 01:23:00,777: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T01:23:00.796092695Z [2024-06-19 01:23:00,793: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T01:23:00.865449875Z [2024-06-19 01:23:00,861: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T01:23:00.939144411Z [2024-06-19 01:23:00,938: INFO/ForkPoolWorker-16] Getting SDNC list 2024-06-19T01:23:00.944487392Z [2024-06-19 01:23:00,944: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:23:00.970661468Z [2024-06-19 01:23:00,970: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T01:23:00.974682943Z [2024-06-19 01:23:00,974: INFO/ForkPoolWorker-16] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T01:23:00.975307151Z [2024-06-19 01:23:00,974: INFO/ForkPoolWorker-16] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T01:23:00.976124271Z [2024-06-19 01:23:00,975: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-06-19T01:23:00.977279900Z [2024-06-19 01:23:00,976: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T01:23:01.069981646Z [2024-06-19 01:23:01,069: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:23:01.624245409Z [2024-06-19 01:23:01,623: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f77ceeda-7096-42ca-bbc9-c5fa6704daf7] succeeded in 1.1459936079991166s: None 2024-06-19T01:23:01.920170224Z [2024-06-19 01:23:01,919: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T01:23:01.923085361Z [2024-06-19 01:23:01,922: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:23:01.954112285Z [2024-06-19 01:23:01,953: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T01:23:01.955499116Z [2024-06-19 01:23:01,955: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:23:01.955582842Z [2024-06-19 01:23:01,955: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:23:01.955783075Z [2024-06-19 01:23:01,955: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:23:01.955895404Z [2024-06-19 01:23:01,955: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T01:23:01.956148321Z [2024-06-19 01:23:01,956: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T01:23:01.956222211Z [2024-06-19 01:23:01,956: INFO/ForkPoolWorker-15] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:23:01.991355945Z [2024-06-19 01:23:01,990: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T01:23:01.994409890Z [2024-06-19 01:23:01,993: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:23:02.021973764Z [2024-06-19 01:23:02,021: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T01:23:02.023451825Z [2024-06-19 01:23:02,023: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:23:02.023473869Z [2024-06-19 01:23:02,023: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:23:02.023651731Z [2024-06-19 01:23:02,023: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:23:02.023663370Z [2024-06-19 01:23:02,023: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T01:23:02.024002248Z [2024-06-19 01:23:02,023: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-06-19T01:23:02.024027018Z [2024-06-19 01:23:02,023: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:23:02.040478677Z [2024-06-19 01:23:02,040: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:23:02.122183392Z [2024-06-19 01:23:02,121: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:23:03.601556402Z [2024-06-19 01:23:03,600: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[121112e3-fb55-447c-bc37-104783fd8a51] succeeded in 3.1261150339996675s: None 2024-06-19T01:23:04.107813789Z [2024-06-19 01:23:04,105: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1a4c52b0-3cf2-4012-9271-162c3bf54d25] succeeded in 3.6273449460004485s: None 2024-06-19T01:24:00.938667360Z [2024-06-19 01:24:00,937: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[862e951d-77e8-4343-a1be-069d0ffb3e74] received 2024-06-19T01:24:00.942801941Z [2024-06-19 01:24:00,942: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[be3ed6e2-120b-4c9e-b438-c6e1dcddcff3] received 2024-06-19T01:24:00.954036338Z [2024-06-19 01:24:00,953: INFO/ForkPoolWorker-16] [be3ed6e2-120b-4c9e-b438-c6e1dcddcff3] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-19T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-19T01:24:00.956653484Z [2024-06-19 01:24:00,956: INFO/ForkPoolWorker-15] [862e951d-77e8-4343-a1be-069d0ffb3e74] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T01:24:00.964043433Z [2024-06-19 01:24:00,963: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c31f6561-a1a5-413d-8575-3de2d35ce9f3] received 2024-06-19T01:24:00.971450378Z [2024-06-19 01:24:00,971: INFO/ForkPoolWorker-1] [c31f6561-a1a5-413d-8575-3de2d35ce9f3] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T01:24:00.976545900Z [2024-06-19 01:24:00,976: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[984f4423-90f0-4c8c-8eae-b2bdd717f348] received 2024-06-19T01:24:00.987231508Z [2024-06-19 01:24:00,986: INFO/ForkPoolWorker-2] [984f4423-90f0-4c8c-8eae-b2bdd717f348] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T01:24:01.284176358Z [2024-06-19 01:24:01,280: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-19T01:24:01.355593805Z [2024-06-19 01:24:01,352: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T01:24:01.523037589Z [2024-06-19 01:24:01,522: INFO/ForkPoolWorker-1] Getting SDNC list 2024-06-19T01:24:01.527017714Z [2024-06-19 01:24:01,526: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:24:01.552627415Z [2024-06-19 01:24:01,552: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T01:24:01.553765649Z [2024-06-19 01:24:01,553: INFO/ForkPoolWorker-1] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T01:24:01.553835057Z [2024-06-19 01:24:01,553: INFO/ForkPoolWorker-1] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T01:24:01.553910384Z [2024-06-19 01:24:01,553: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-06-19T01:24:01.554116112Z [2024-06-19 01:24:01,554: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T01:24:01.585172975Z [2024-06-19 01:24:01,581: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T01:24:01.666218643Z [2024-06-19 01:24:01,665: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:24:01.799188424Z [2024-06-19 01:24:01,798: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:24:01.854357804Z [2024-06-19 01:24:01,848: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T01:24:02.937264667Z [2024-06-19 01:24:02,936: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[be3ed6e2-120b-4c9e-b438-c6e1dcddcff3] succeeded in 1.99195223300012s: None 2024-06-19T01:24:02.980248734Z [2024-06-19 01:24:02,975: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c31f6561-a1a5-413d-8575-3de2d35ce9f3] succeeded in 2.0095941649997258s: None 2024-06-19T01:24:03.031100705Z [2024-06-19 01:24:03,030: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-19T01:24:03.034966772Z [2024-06-19 01:24:03,034: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:24:03.072673721Z [2024-06-19 01:24:03,072: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T01:24:03.080635948Z [2024-06-19 01:24:03,080: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:24:03.080766189Z [2024-06-19 01:24:03,080: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:24:03.082626159Z [2024-06-19 01:24:03,080: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:24:03.082800969Z [2024-06-19 01:24:03,082: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-19T01:24:03.085591343Z [2024-06-19 01:24:03,085: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-06-19T01:24:03.085930377Z [2024-06-19 01:24:03,085: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:24:03.169018815Z [2024-06-19 01:24:03,168: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:24:03.714638120Z [2024-06-19 01:24:03,711: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T01:24:03.721705518Z [2024-06-19 01:24:03,721: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:24:03.790486079Z [2024-06-19 01:24:03,790: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T01:24:03.791801675Z [2024-06-19 01:24:03,791: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:24:03.791939154Z [2024-06-19 01:24:03,791: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:24:03.792109065Z [2024-06-19 01:24:03,791: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:24:03.792219220Z [2024-06-19 01:24:03,792: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T01:24:03.792505096Z [2024-06-19 01:24:03,792: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T01:24:03.792633430Z [2024-06-19 01:24:03,792: INFO/ForkPoolWorker-15] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:24:03.891156804Z [2024-06-19 01:24:03,890: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:24:06.208001266Z [2024-06-19 01:24:06,207: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[862e951d-77e8-4343-a1be-069d0ffb3e74] succeeded in 5.263652998999532s: None 2024-06-19T01:24:06.814942105Z [2024-06-19 01:24:06,814: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[984f4423-90f0-4c8c-8eae-b2bdd717f348] succeeded in 5.836622160000843s: None 2024-06-19T01:25:01.045968364Z [2024-06-19 01:25:01,045: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6df3b264-7e62-4f35-b88b-c5d26985605e] received 2024-06-19T01:25:01.047944778Z [2024-06-19 01:25:01,047: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0571e641-4654-4ffa-8518-15026afbcf6e] received 2024-06-19T01:25:01.058889044Z [2024-06-19 01:25:01,058: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[905493d1-c470-43e3-a703-602696d02d94] received 2024-06-19T01:25:01.061019591Z [2024-06-19 01:25:01,060: INFO/ForkPoolWorker-15] [6df3b264-7e62-4f35-b88b-c5d26985605e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-19T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T01:25:01.062485371Z [2024-06-19 01:25:01,062: INFO/ForkPoolWorker-16] [0571e641-4654-4ffa-8518-15026afbcf6e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T01:25:01.064809665Z [2024-06-19 01:25:01,064: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c69f87a2-79db-44ae-b8ce-e7ec97cd19f4] received 2024-06-19T01:25:01.077145845Z [2024-06-19 01:25:01,076: INFO/ForkPoolWorker-1] [905493d1-c470-43e3-a703-602696d02d94] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T01:25:01.078982864Z [2024-06-19 01:25:01,078: INFO/ForkPoolWorker-2] [c69f87a2-79db-44ae-b8ce-e7ec97cd19f4] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T01:25:01.388222997Z [2024-06-19 01:25:01,384: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T01:25:01.409572726Z [2024-06-19 01:25:01,405: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T01:25:01.520679223Z [2024-06-19 01:25:01,517: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T01:25:01.536913105Z [2024-06-19 01:25:01,533: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T01:25:01.556554699Z [2024-06-19 01:25:01,556: INFO/ForkPoolWorker-2] Getting SDNC list 2024-06-19T01:25:01.560665009Z [2024-06-19 01:25:01,560: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:25:01.614728437Z [2024-06-19 01:25:01,614: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T01:25:01.616624716Z [2024-06-19 01:25:01,616: INFO/ForkPoolWorker-2] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T01:25:01.617420315Z [2024-06-19 01:25:01,616: INFO/ForkPoolWorker-2] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T01:25:01.618482872Z [2024-06-19 01:25:01,617: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-06-19T01:25:01.619369308Z [2024-06-19 01:25:01,619: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T01:25:01.768238319Z [2024-06-19 01:25:01,767: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:25:02.802701071Z [2024-06-19 01:25:02,802: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[c69f87a2-79db-44ae-b8ce-e7ec97cd19f4] succeeded in 1.7353063809987361s: None 2024-06-19T01:25:02.936829259Z [2024-06-19 01:25:02,936: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T01:25:02.941756337Z [2024-06-19 01:25:02,940: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:25:02.980368023Z [2024-06-19 01:25:02,980: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T01:25:02.986417514Z [2024-06-19 01:25:02,984: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:25:02.986440603Z [2024-06-19 01:25:02,984: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:25:02.986445809Z [2024-06-19 01:25:02,984: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:25:02.986450574Z [2024-06-19 01:25:02,984: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T01:25:02.986454762Z [2024-06-19 01:25:02,985: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-19T01:25:02.986458785Z [2024-06-19 01:25:02,985: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:25:03.118598622Z [2024-06-19 01:25:03,118: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T01:25:03.125166798Z [2024-06-19 01:25:03,124: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:25:03.143245694Z [2024-06-19 01:25:03,142: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:25:03.177579559Z [2024-06-19 01:25:03,177: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T01:25:03.189068887Z [2024-06-19 01:25:03,188: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:25:03.191548851Z [2024-06-19 01:25:03,191: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:25:03.191791151Z [2024-06-19 01:25:03,191: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:25:03.191908683Z [2024-06-19 01:25:03,191: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T01:25:03.192202642Z [2024-06-19 01:25:03,192: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T01:25:03.192654401Z [2024-06-19 01:25:03,192: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:25:03.315387739Z [2024-06-19 01:25:03,315: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:25:03.599754195Z [2024-06-19 01:25:03,599: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T01:25:03.604623365Z [2024-06-19 01:25:03,603: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:25:03.644138754Z [2024-06-19 01:25:03,643: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T01:25:03.652289084Z [2024-06-19 01:25:03,651: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:25:03.652530301Z [2024-06-19 01:25:03,652: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:25:03.653337522Z [2024-06-19 01:25:03,652: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:25:03.653748098Z [2024-06-19 01:25:03,653: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T01:25:03.654610634Z [2024-06-19 01:25:03,654: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T01:25:03.654871365Z [2024-06-19 01:25:03,654: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:25:03.759147728Z [2024-06-19 01:25:03,758: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:25:04.012516677Z [2024-06-19 01:25:04,012: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6df3b264-7e62-4f35-b88b-c5d26985605e] succeeded in 2.964472952999131s: None 2024-06-19T01:25:04.747062007Z [2024-06-19 01:25:04,746: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c9eeb65c-21f7-45c5-bbde-a96a2598b2d6] received 2024-06-19T01:25:04.760118950Z [2024-06-19 01:25:04,759: INFO/ForkPoolWorker-15] [c9eeb65c-21f7-45c5-bbde-a96a2598b2d6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'split_metrics', 'scheduled__2024-06-19T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T01:25:05.062583481Z [2024-06-19 01:25:05,059: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T01:25:05.107665588Z [2024-06-19 01:25:05,107: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0571e641-4654-4ffa-8518-15026afbcf6e] succeeded in 4.057113684999422s: None 2024-06-19T01:25:05.359995989Z [2024-06-19 01:25:05,359: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[905493d1-c470-43e3-a703-602696d02d94] succeeded in 4.297955161999198s: None 2024-06-19T01:25:06.132633608Z [2024-06-19 01:25:06,132: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T01:25:06.136345004Z [2024-06-19 01:25:06,135: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:25:06.154641037Z [2024-06-19 01:25:06,154: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T01:25:06.156075063Z [2024-06-19 01:25:06,155: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:25:06.156217580Z [2024-06-19 01:25:06,156: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:25:06.156405449Z [2024-06-19 01:25:06,156: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:25:06.156530978Z [2024-06-19 01:25:06,156: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T01:25:06.156890351Z [2024-06-19 01:25:06,156: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T01:25:06.156927845Z [2024-06-19 01:25:06,156: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:25:06.233324315Z [2024-06-19 01:25:06,233: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:25:06.928464840Z [2024-06-19 01:25:06,927: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c9eeb65c-21f7-45c5-bbde-a96a2598b2d6] succeeded in 2.177509116998408s: None 2024-06-19T01:25:07.184530311Z [2024-06-19 01:25:07,184: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[35f73296-add7-4083-a1fd-edac2c4f016b] received 2024-06-19T01:25:07.191038520Z [2024-06-19 01:25:07,190: INFO/ForkPoolWorker-15] [35f73296-add7-4083-a1fd-edac2c4f016b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'collect_metrics', 'scheduled__2024-06-19T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-19T01:25:07.488516084Z [2024-06-19 01:25:07,484: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T01:25:08.577853391Z [2024-06-19 01:25:08,577: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T01:25:08.580944793Z [2024-06-19 01:25:08,580: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:25:08.605552838Z [2024-06-19 01:25:08,605: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T01:25:08.607128300Z [2024-06-19 01:25:08,606: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:25:08.607387170Z [2024-06-19 01:25:08,607: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:25:08.607752409Z [2024-06-19 01:25:08,607: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:25:08.607989705Z [2024-06-19 01:25:08,607: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T01:25:08.608404274Z [2024-06-19 01:25:08,608: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T01:25:08.608725989Z [2024-06-19 01:25:08,608: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:25:08.715598169Z [2024-06-19 01:25:08,715: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:25:09.410804220Z [2024-06-19 01:25:09,410: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[35f73296-add7-4083-a1fd-edac2c4f016b] succeeded in 2.2241345420006837s: None 2024-06-19T01:25:10.064420706Z [2024-06-19 01:25:10,064: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c4e70661-634b-497b-b302-6d6d54d94e80] received 2024-06-19T01:25:10.074486991Z [2024-06-19 01:25:10,073: INFO/ForkPoolWorker-15] [c4e70661-634b-497b-b302-6d6d54d94e80] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'send_prometheus', 'scheduled__2024-06-19T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T01:25:10.361240033Z [2024-06-19 01:25:10,357: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T01:25:11.391843406Z [2024-06-19 01:25:11,391: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T01:25:11.394918281Z [2024-06-19 01:25:11,394: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:25:11.420092152Z [2024-06-19 01:25:11,419: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T01:25:11.422930386Z [2024-06-19 01:25:11,422: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:25:11.422991718Z [2024-06-19 01:25:11,422: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:25:11.423393018Z [2024-06-19 01:25:11,422: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:25:11.423434076Z [2024-06-19 01:25:11,423: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T01:25:11.423849442Z [2024-06-19 01:25:11,423: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T01:25:11.423965780Z [2024-06-19 01:25:11,423: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:25:11.523336205Z [2024-06-19 01:25:11,522: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:25:12.182555843Z [2024-06-19 01:25:12,182: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c4e70661-634b-497b-b302-6d6d54d94e80] succeeded in 2.1146938480014796s: None 2024-06-19T01:26:01.023374570Z [2024-06-19 01:26:01,022: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[41a0b7bc-1a0c-4a19-ad14-ed5dc73608ac] received 2024-06-19T01:26:01.037157199Z [2024-06-19 01:26:01,036: INFO/ForkPoolWorker-15] [41a0b7bc-1a0c-4a19-ad14-ed5dc73608ac] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T01:26:01.037219972Z [2024-06-19 01:26:01,037: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0b64113a-247a-4031-882e-08dc72b84646] received 2024-06-19T01:26:01.047751408Z [2024-06-19 01:26:01,047: INFO/ForkPoolWorker-16] [0b64113a-247a-4031-882e-08dc72b84646] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T01:26:01.053583165Z [2024-06-19 01:26:01,053: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[07e50be3-22e0-4028-84bf-6ad321749107] received 2024-06-19T01:26:01.058416398Z [2024-06-19 01:26:01,058: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a08f3af0-2bf8-43f6-b7ca-6beb67300939] received 2024-06-19T01:26:01.072418145Z [2024-06-19 01:26:01,072: INFO/ForkPoolWorker-1] [07e50be3-22e0-4028-84bf-6ad321749107] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-19T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-19T01:26:01.085621529Z [2024-06-19 01:26:01,085: INFO/ForkPoolWorker-2] [a08f3af0-2bf8-43f6-b7ca-6beb67300939] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T01:26:01.525851571Z [2024-06-19 01:26:01,522: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-19T01:26:01.549021995Z [2024-06-19 01:26:01,544: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T01:26:01.553613287Z [2024-06-19 01:26:01,541: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T01:26:01.658624311Z [2024-06-19 01:26:01,652: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T01:26:01.828602979Z [2024-06-19 01:26:01,828: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:26:01.881606678Z [2024-06-19 01:26:01,881: INFO/ForkPoolWorker-16] Getting SDNC list 2024-06-19T01:26:01.897750931Z [2024-06-19 01:26:01,897: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:26:01.950606467Z [2024-06-19 01:26:01,950: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T01:26:01.952757776Z [2024-06-19 01:26:01,952: INFO/ForkPoolWorker-16] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T01:26:01.953174687Z [2024-06-19 01:26:01,952: INFO/ForkPoolWorker-16] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T01:26:01.953448418Z [2024-06-19 01:26:01,953: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-06-19T01:26:01.953748203Z [2024-06-19 01:26:01,953: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T01:26:02.092376217Z [2024-06-19 01:26:02,092: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:26:02.743304331Z [2024-06-19 01:26:02,742: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[07e50be3-22e0-4028-84bf-6ad321749107] succeeded in 1.6862092579995078s: None 2024-06-19T01:26:03.160773547Z [2024-06-19 01:26:03,160: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0b64113a-247a-4031-882e-08dc72b84646] succeeded in 2.1204841870003293s: None 2024-06-19T01:26:03.292758601Z [2024-06-19 01:26:03,292: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T01:26:03.296067441Z [2024-06-19 01:26:03,295: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:26:03.318298690Z [2024-06-19 01:26:03,318: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T01:26:03.319856857Z [2024-06-19 01:26:03,319: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:26:03.319884160Z [2024-06-19 01:26:03,319: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:26:03.320030001Z [2024-06-19 01:26:03,319: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:26:03.320056170Z [2024-06-19 01:26:03,319: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T01:26:03.320294789Z [2024-06-19 01:26:03,320: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T01:26:03.320307377Z [2024-06-19 01:26:03,320: INFO/ForkPoolWorker-15] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:26:03.413231011Z [2024-06-19 01:26:03,412: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:26:03.622327832Z [2024-06-19 01:26:03,621: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-19T01:26:03.625859112Z [2024-06-19 01:26:03,625: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:26:03.652660953Z [2024-06-19 01:26:03,652: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T01:26:03.653992443Z [2024-06-19 01:26:03,653: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:26:03.654117930Z [2024-06-19 01:26:03,653: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:26:03.654306414Z [2024-06-19 01:26:03,654: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:26:03.654421820Z [2024-06-19 01:26:03,654: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-19T01:26:03.654770828Z [2024-06-19 01:26:03,654: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-06-19T01:26:03.654895111Z [2024-06-19 01:26:03,654: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:26:03.739769358Z [2024-06-19 01:26:03,739: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:26:05.304489284Z [2024-06-19 01:26:05,303: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[41a0b7bc-1a0c-4a19-ad14-ed5dc73608ac] succeeded in 4.277880175000973s: None 2024-06-19T01:26:05.857488255Z [2024-06-19 01:26:05,856: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a08f3af0-2bf8-43f6-b7ca-6beb67300939] succeeded in 4.796433024999715s: None 2024-06-19T01:27:01.052868903Z [2024-06-19 01:27:01,052: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[26046d2b-1124-41d5-83a5-da87338ab58e] received 2024-06-19T01:27:01.054779339Z [2024-06-19 01:27:01,054: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a32f09b6-9b73-4000-8159-f9b35e1d117f] received 2024-06-19T01:27:01.056201703Z [2024-06-19 01:27:01,056: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1f1386b1-d426-48ef-927b-ac9863810d2e] received 2024-06-19T01:27:01.064048597Z [2024-06-19 01:27:01,063: INFO/ForkPoolWorker-16] [a32f09b6-9b73-4000-8159-f9b35e1d117f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T01:27:01.065872518Z [2024-06-19 01:27:01,065: INFO/ForkPoolWorker-1] [1f1386b1-d426-48ef-927b-ac9863810d2e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T01:27:01.069006266Z [2024-06-19 01:27:01,068: INFO/ForkPoolWorker-15] [26046d2b-1124-41d5-83a5-da87338ab58e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T01:27:01.379657291Z [2024-06-19 01:27:01,376: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T01:27:01.399275865Z [2024-06-19 01:27:01,396: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T01:27:01.417961023Z [2024-06-19 01:27:01,414: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T01:27:01.575002808Z [2024-06-19 01:27:01,574: INFO/ForkPoolWorker-15] Getting SDNC list 2024-06-19T01:27:01.579104364Z [2024-06-19 01:27:01,578: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:27:01.602205377Z [2024-06-19 01:27:01,601: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T01:27:01.603264001Z [2024-06-19 01:27:01,603: INFO/ForkPoolWorker-15] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T01:27:01.603499485Z [2024-06-19 01:27:01,603: INFO/ForkPoolWorker-15] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T01:27:01.603725024Z [2024-06-19 01:27:01,603: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-06-19T01:27:01.603984821Z [2024-06-19 01:27:01,603: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T01:27:01.706145674Z [2024-06-19 01:27:01,705: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:27:02.397238855Z [2024-06-19 01:27:02,396: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[26046d2b-1124-41d5-83a5-da87338ab58e] succeeded in 1.3395481099996687s: None 2024-06-19T01:27:02.579748218Z [2024-06-19 01:27:02,579: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T01:27:02.583764455Z [2024-06-19 01:27:02,583: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:27:02.609982781Z [2024-06-19 01:27:02,609: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T01:27:02.611452064Z [2024-06-19 01:27:02,611: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:27:02.611607603Z [2024-06-19 01:27:02,611: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:27:02.611896457Z [2024-06-19 01:27:02,611: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:27:02.612035861Z [2024-06-19 01:27:02,611: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T01:27:02.612375048Z [2024-06-19 01:27:02,612: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T01:27:02.612546282Z [2024-06-19 01:27:02,612: INFO/ForkPoolWorker-16] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:27:02.656885235Z [2024-06-19 01:27:02,656: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T01:27:02.660179657Z [2024-06-19 01:27:02,659: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:27:02.677958514Z [2024-06-19 01:27:02,677: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T01:27:02.680221831Z [2024-06-19 01:27:02,680: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:27:02.680421125Z [2024-06-19 01:27:02,680: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:27:02.680845101Z [2024-06-19 01:27:02,680: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:27:02.680917805Z [2024-06-19 01:27:02,680: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T01:27:02.681194231Z [2024-06-19 01:27:02,681: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-06-19T01:27:02.681274538Z [2024-06-19 01:27:02,681: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:27:02.720509453Z [2024-06-19 01:27:02,715: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:27:02.762448683Z [2024-06-19 01:27:02,762: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:27:04.617541516Z [2024-06-19 01:27:04,616: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a32f09b6-9b73-4000-8159-f9b35e1d117f] succeeded in 3.5603960630014626s: None 2024-06-19T01:27:04.901538282Z [2024-06-19 01:27:04,901: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1f1386b1-d426-48ef-927b-ac9863810d2e] succeeded in 3.841890558000159s: None 2024-06-19T01:28:00.400528233Z [2024-06-19 01:28:00,400: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a43aaa01-91a7-4970-94e4-c4c9ea2e3e3e] received 2024-06-19T01:28:00.408073794Z [2024-06-19 01:28:00,407: INFO/ForkPoolWorker-15] [a43aaa01-91a7-4970-94e4-c4c9ea2e3e3e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-19T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-19T01:28:00.408483609Z [2024-06-19 01:28:00,407: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ccc1aeed-a3da-41c0-b6a9-2d9590b6bde9] received 2024-06-19T01:28:00.415603135Z [2024-06-19 01:28:00,415: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b2083295-3c7a-4598-bca1-181aaedbf394] received 2024-06-19T01:28:00.424715822Z [2024-06-19 01:28:00,424: INFO/ForkPoolWorker-16] [ccc1aeed-a3da-41c0-b6a9-2d9590b6bde9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T01:28:00.425672544Z [2024-06-19 01:28:00,425: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[859300f1-a0d6-490c-81c9-2600e2d1b16c] received 2024-06-19T01:28:00.435540647Z [2024-06-19 01:28:00,435: INFO/ForkPoolWorker-1] [b2083295-3c7a-4598-bca1-181aaedbf394] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T01:28:00.439874825Z [2024-06-19 01:28:00,439: INFO/ForkPoolWorker-2] [859300f1-a0d6-490c-81c9-2600e2d1b16c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T01:28:00.779546627Z [2024-06-19 01:28:00,776: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T01:28:00.823058605Z [2024-06-19 01:28:00,820: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-19T01:28:00.831269041Z [2024-06-19 01:28:00,828: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T01:28:00.904022011Z [2024-06-19 01:28:00,900: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T01:28:00.935593501Z [2024-06-19 01:28:00,935: INFO/ForkPoolWorker-2] Getting SDNC list 2024-06-19T01:28:00.939552314Z [2024-06-19 01:28:00,939: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:28:00.974871282Z [2024-06-19 01:28:00,974: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T01:28:00.976254326Z [2024-06-19 01:28:00,976: INFO/ForkPoolWorker-2] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T01:28:00.976537964Z [2024-06-19 01:28:00,976: INFO/ForkPoolWorker-2] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T01:28:00.976677529Z [2024-06-19 01:28:00,976: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-06-19T01:28:00.977364282Z [2024-06-19 01:28:00,977: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T01:28:01.073628544Z [2024-06-19 01:28:01,073: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:28:01.095591490Z [2024-06-19 01:28:01,095: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:28:01.688701193Z [2024-06-19 01:28:01,688: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a43aaa01-91a7-4970-94e4-c4c9ea2e3e3e] succeeded in 1.2866882839989557s: None 2024-06-19T01:28:01.708899861Z [2024-06-19 01:28:01,708: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[859300f1-a0d6-490c-81c9-2600e2d1b16c] succeeded in 1.2811780219999491s: None 2024-06-19T01:28:02.124969592Z [2024-06-19 01:28:02,124: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T01:28:02.128003773Z [2024-06-19 01:28:02,127: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:28:02.153510022Z [2024-06-19 01:28:02,153: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T01:28:02.154854646Z [2024-06-19 01:28:02,154: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:28:02.155003473Z [2024-06-19 01:28:02,154: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:28:02.155177687Z [2024-06-19 01:28:02,154: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:28:02.155238436Z [2024-06-19 01:28:02,155: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T01:28:02.155516976Z [2024-06-19 01:28:02,155: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T01:28:02.155673677Z [2024-06-19 01:28:02,155: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:28:02.246402828Z [2024-06-19 01:28:02,246: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T01:28:02.249678565Z [2024-06-19 01:28:02,249: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:28:02.284537482Z [2024-06-19 01:28:02,284: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T01:28:02.286067179Z [2024-06-19 01:28:02,285: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:28:02.286295142Z [2024-06-19 01:28:02,286: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:28:02.286663568Z [2024-06-19 01:28:02,286: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:28:02.286935221Z [2024-06-19 01:28:02,286: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T01:28:02.287467641Z [2024-06-19 01:28:02,287: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-19T01:28:02.287823572Z [2024-06-19 01:28:02,287: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:28:02.304832518Z [2024-06-19 01:28:02,304: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:28:02.425637691Z [2024-06-19 01:28:02,425: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:28:03.817055676Z [2024-06-19 01:28:03,816: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b2083295-3c7a-4598-bca1-181aaedbf394] succeeded in 3.3935383159987396s: None 2024-06-19T01:28:04.233296193Z [2024-06-19 01:28:04,232: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ccc1aeed-a3da-41c0-b6a9-2d9590b6bde9] succeeded in 3.8206160370009457s: None 2024-06-19T01:29:01.111002509Z [2024-06-19 01:29:01,110: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4741a094-2ebe-4439-b0a3-d3699e2d5fec] received 2024-06-19T01:29:01.113913020Z [2024-06-19 01:29:01,113: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[59b1f706-c973-4d4f-ad41-63360bb9f4a5] received 2024-06-19T01:29:01.121576190Z [2024-06-19 01:29:01,121: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ad742066-6c92-4971-877a-17debc73ba89] received 2024-06-19T01:29:01.127956289Z [2024-06-19 01:29:01,127: INFO/ForkPoolWorker-15] [4741a094-2ebe-4439-b0a3-d3699e2d5fec] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T01:29:01.129034013Z [2024-06-19 01:29:01,128: INFO/ForkPoolWorker-16] [59b1f706-c973-4d4f-ad41-63360bb9f4a5] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T01:29:01.129302786Z [2024-06-19 01:29:01,129: INFO/ForkPoolWorker-1] [ad742066-6c92-4971-877a-17debc73ba89] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T01:29:01.409503111Z [2024-06-19 01:29:01,405: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T01:29:01.409572971Z [2024-06-19 01:29:01,406: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T01:29:01.453577423Z [2024-06-19 01:29:01,450: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T01:29:01.561384001Z [2024-06-19 01:29:01,560: INFO/ForkPoolWorker-16] Getting SDNC list 2024-06-19T01:29:01.565170652Z [2024-06-19 01:29:01,564: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:29:01.595362038Z [2024-06-19 01:29:01,595: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T01:29:01.597661308Z [2024-06-19 01:29:01,597: INFO/ForkPoolWorker-16] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T01:29:01.597791110Z [2024-06-19 01:29:01,597: INFO/ForkPoolWorker-16] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T01:29:01.597864436Z [2024-06-19 01:29:01,597: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-06-19T01:29:01.598102658Z [2024-06-19 01:29:01,597: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T01:29:01.678915842Z [2024-06-19 01:29:01,678: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:29:02.421755810Z [2024-06-19 01:29:02,421: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[59b1f706-c973-4d4f-ad41-63360bb9f4a5] succeeded in 1.304090196999823s: None 2024-06-19T01:29:02.857648432Z [2024-06-19 01:29:02,857: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T01:29:02.863845277Z [2024-06-19 01:29:02,863: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:29:02.894221471Z [2024-06-19 01:29:02,893: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T01:29:02.897311700Z [2024-06-19 01:29:02,897: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T01:29:02.898833750Z [2024-06-19 01:29:02,898: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:29:02.900920608Z [2024-06-19 01:29:02,900: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:29:02.901206953Z [2024-06-19 01:29:02,901: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:29:02.901308726Z [2024-06-19 01:29:02,901: INFO/ForkPoolWorker-15] Read VIM bd4bac36-ae3e-42a7-9dde-3c4b01084c0a (k8s07_dummy) 2024-06-19T01:29:02.901521417Z [2024-06-19 01:29:02,901: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'bd4bac36-ae3e-42a7-9dde-3c4b01084c0a', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-06-19T01:29:02.901602810Z [2024-06-19 01:29:02,901: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T01:29:02.901904792Z [2024-06-19 01:29:02,901: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T01:29:02.901996346Z [2024-06-19 01:29:02,901: INFO/ForkPoolWorker-15] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:29:02.906762812Z [2024-06-19 01:29:02,906: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T01:29:02.939665093Z [2024-06-19 01:29:02,939: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T01:29:02.943282520Z [2024-06-19 01:29:02,942: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:29:02.943972541Z [2024-06-19 01:29:02,943: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:29:02.944266538Z [2024-06-19 01:29:02,943: INFO/ForkPoolWorker-1] Read VIM bd4bac36-ae3e-42a7-9dde-3c4b01084c0a (k8s07_dummy) 2024-06-19T01:29:02.944810871Z [2024-06-19 01:29:02,944: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'bd4bac36-ae3e-42a7-9dde-3c4b01084c0a', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-06-19T01:29:02.945451607Z [2024-06-19 01:29:02,944: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T01:29:02.946115786Z [2024-06-19 01:29:02,945: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-06-19T01:29:02.946421911Z [2024-06-19 01:29:02,946: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:29:02.954821427Z [2024-06-19 01:29:02,953: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-06-19T01:29:02.991796227Z [2024-06-19 01:29:02,991: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:29:03.068972385Z [2024-06-19 01:29:03,068: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:29:04.572421460Z [2024-06-19 01:29:04,571: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4741a094-2ebe-4439-b0a3-d3699e2d5fec] succeeded in 3.458370925000054s: None 2024-06-19T01:29:05.452375130Z [2024-06-19 01:29:05,451: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ad742066-6c92-4971-877a-17debc73ba89] succeeded in 4.329095387000052s: None 2024-06-19T01:30:01.299978966Z [2024-06-19 01:30:01,299: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f760ad6b-5c29-4df2-ad05-3cd2bd22699a] received 2024-06-19T01:30:01.304588339Z [2024-06-19 01:30:01,304: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[88affbda-6ea7-44c8-a00b-17033a976766] received 2024-06-19T01:30:01.306036169Z [2024-06-19 01:30:01,305: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ba6e021d-d0a8-4a65-b85a-7e6bd460c177] received 2024-06-19T01:30:01.311116618Z [2024-06-19 01:30:01,310: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5fb5dafc-fdfa-4a57-b59c-20b1b668d892] received 2024-06-19T01:30:01.316203466Z [2024-06-19 01:30:01,315: INFO/ForkPoolWorker-16] [88affbda-6ea7-44c8-a00b-17033a976766] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-19T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T01:30:01.317942330Z [2024-06-19 01:30:01,317: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f745dc29-f477-4fcd-9168-76db84135479] received 2024-06-19T01:30:01.324798327Z [2024-06-19 01:30:01,324: INFO/ForkPoolWorker-2] [5fb5dafc-fdfa-4a57-b59c-20b1b668d892] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T01:30:01.337579586Z [2024-06-19 01:30:01,333: INFO/ForkPoolWorker-1] [ba6e021d-d0a8-4a65-b85a-7e6bd460c177] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-19T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-19T01:30:01.338522642Z [2024-06-19 01:30:01,338: INFO/ForkPoolWorker-15] [f760ad6b-5c29-4df2-ad05-3cd2bd22699a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T01:30:01.343820210Z [2024-06-19 01:30:01,343: INFO/ForkPoolWorker-3] [f745dc29-f477-4fcd-9168-76db84135479] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T01:30:01.729581207Z [2024-06-19 01:30:01,725: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T01:30:01.730661160Z [2024-06-19 01:30:01,727: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T01:30:01.746440746Z [2024-06-19 01:30:01,734: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T01:30:01.783216304Z [2024-06-19 01:30:01,772: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T01:30:02.042132498Z [2024-06-19 01:30:02,030: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-19T01:30:02.100610439Z [2024-06-19 01:30:02,100: INFO/ForkPoolWorker-3] Getting SDNC list 2024-06-19T01:30:02.108132811Z [2024-06-19 01:30:02,107: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:30:02.172880756Z [2024-06-19 01:30:02,172: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-06-19T01:30:02.174356008Z [2024-06-19 01:30:02,174: INFO/ForkPoolWorker-3] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T01:30:02.174464063Z [2024-06-19 01:30:02,174: INFO/ForkPoolWorker-3] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T01:30:02.174581772Z [2024-06-19 01:30:02,174: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-06-19T01:30:02.174811904Z [2024-06-19 01:30:02,174: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T01:30:02.329378335Z [2024-06-19 01:30:02,329: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:30:02.520112272Z [2024-06-19 01:30:02,519: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:30:03.060490420Z [2024-06-19 01:30:03,060: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[f745dc29-f477-4fcd-9168-76db84135479] succeeded in 1.7349809999996069s: None 2024-06-19T01:30:03.132627495Z [2024-06-19 01:30:03,132: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ba6e021d-d0a8-4a65-b85a-7e6bd460c177] succeeded in 1.8249151130003156s: None 2024-06-19T01:30:03.426101548Z [2024-06-19 01:30:03,425: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T01:30:03.429829418Z [2024-06-19 01:30:03,429: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:30:03.446417880Z [2024-06-19 01:30:03,446: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T01:30:03.447529720Z [2024-06-19 01:30:03,447: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:30:03.447656970Z [2024-06-19 01:30:03,447: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:30:03.447788657Z [2024-06-19 01:30:03,447: INFO/ForkPoolWorker-16] Read VIM bd4bac36-ae3e-42a7-9dde-3c4b01084c0a (k8s07_dummy) 2024-06-19T01:30:03.447931991Z [2024-06-19 01:30:03,447: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'bd4bac36-ae3e-42a7-9dde-3c4b01084c0a', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-06-19T01:30:03.448006854Z [2024-06-19 01:30:03,447: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T01:30:03.448244999Z [2024-06-19 01:30:03,448: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T01:30:03.448334300Z [2024-06-19 01:30:03,448: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:30:03.454538545Z [2024-06-19 01:30:03,454: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T01:30:03.465635034Z [2024-06-19 01:30:03,465: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-19T01:30:03.469523641Z [2024-06-19 01:30:03,469: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:30:03.502986136Z [2024-06-19 01:30:03,502: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T01:30:03.503259988Z [2024-06-19 01:30:03,502: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T01:30:03.504707857Z [2024-06-19 01:30:03,504: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:30:03.504724118Z [2024-06-19 01:30:03,504: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:30:03.504788051Z [2024-06-19 01:30:03,504: INFO/ForkPoolWorker-2] Read VIM bd4bac36-ae3e-42a7-9dde-3c4b01084c0a (k8s07_dummy) 2024-06-19T01:30:03.504934804Z [2024-06-19 01:30:03,504: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'bd4bac36-ae3e-42a7-9dde-3c4b01084c0a', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-06-19T01:30:03.504995053Z [2024-06-19 01:30:03,504: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-19T01:30:03.505215277Z [2024-06-19 01:30:03,505: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T01:30:03.505239416Z [2024-06-19 01:30:03,505: INFO/ForkPoolWorker-2] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:30:03.508291502Z [2024-06-19 01:30:03,507: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:30:03.512148527Z [2024-06-19 01:30:03,511: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T01:30:03.533817143Z [2024-06-19 01:30:03,533: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T01:30:03.536092764Z [2024-06-19 01:30:03,535: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:30:03.536122893Z [2024-06-19 01:30:03,536: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:30:03.536224692Z [2024-06-19 01:30:03,536: INFO/ForkPoolWorker-15] Read VIM bd4bac36-ae3e-42a7-9dde-3c4b01084c0a (k8s07_dummy) 2024-06-19T01:30:03.536408800Z [2024-06-19 01:30:03,536: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'bd4bac36-ae3e-42a7-9dde-3c4b01084c0a', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-06-19T01:30:03.536502728Z [2024-06-19 01:30:03,536: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T01:30:03.537370156Z [2024-06-19 01:30:03,537: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-06-19T01:30:03.537475130Z [2024-06-19 01:30:03,537: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:30:03.539064509Z [2024-06-19 01:30:03,538: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:30:03.542013436Z [2024-06-19 01:30:03,541: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-06-19T01:30:03.614340632Z [2024-06-19 01:30:03,614: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:30:03.626250423Z [2024-06-19 01:30:03,625: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:30:04.198891830Z [2024-06-19 01:30:04,198: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[88affbda-6ea7-44c8-a00b-17033a976766] succeeded in 2.891221339999902s: None 2024-06-19T01:30:04.261879227Z [2024-06-19 01:30:04,261: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d7ebe35a-f8e8-4b88-8a41-1f4964455c1c] received 2024-06-19T01:30:04.269286254Z [2024-06-19 01:30:04,268: INFO/ForkPoolWorker-16] [d7ebe35a-f8e8-4b88-8a41-1f4964455c1c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'split_metrics', 'scheduled__2024-06-19T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T01:30:04.568482517Z [2024-06-19 01:30:04,565: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T01:30:05.323754672Z [2024-06-19 01:30:05,323: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[5fb5dafc-fdfa-4a57-b59c-20b1b668d892] succeeded in 4.010653519999323s: None 2024-06-19T01:30:05.685377151Z [2024-06-19 01:30:05,684: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f760ad6b-5c29-4df2-ad05-3cd2bd22699a] succeeded in 4.382606757999383s: None 2024-06-19T01:30:05.692630010Z [2024-06-19 01:30:05,692: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T01:30:05.695898045Z [2024-06-19 01:30:05,695: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:30:05.719865512Z [2024-06-19 01:30:05,719: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T01:30:05.722600805Z [2024-06-19 01:30:05,722: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:30:05.722902115Z [2024-06-19 01:30:05,722: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:30:05.723244168Z [2024-06-19 01:30:05,722: INFO/ForkPoolWorker-16] Read VIM bd4bac36-ae3e-42a7-9dde-3c4b01084c0a (k8s07_dummy) 2024-06-19T01:30:05.723842112Z [2024-06-19 01:30:05,723: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'bd4bac36-ae3e-42a7-9dde-3c4b01084c0a', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-06-19T01:30:05.724168442Z [2024-06-19 01:30:05,723: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T01:30:05.724979641Z [2024-06-19 01:30:05,724: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T01:30:05.725013835Z [2024-06-19 01:30:05,724: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:30:05.736629313Z [2024-06-19 01:30:05,736: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T01:30:05.840345808Z [2024-06-19 01:30:05,839: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:30:06.575513390Z [2024-06-19 01:30:06,575: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d7ebe35a-f8e8-4b88-8a41-1f4964455c1c] succeeded in 2.3117548400005035s: None 2024-06-19T01:30:07.043219655Z [2024-06-19 01:30:07,043: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a2205a59-87ec-4a51-8f24-c48119c273bd] received 2024-06-19T01:30:07.048765978Z [2024-06-19 01:30:07,048: INFO/ForkPoolWorker-15] [a2205a59-87ec-4a51-8f24-c48119c273bd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'collect_metrics', 'scheduled__2024-06-19T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-19T01:30:07.385092863Z [2024-06-19 01:30:07,382: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T01:30:08.416913705Z [2024-06-19 01:30:08,416: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T01:30:08.420174363Z [2024-06-19 01:30:08,419: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:30:08.444690990Z [2024-06-19 01:30:08,444: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T01:30:08.446151401Z [2024-06-19 01:30:08,445: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:30:08.446182249Z [2024-06-19 01:30:08,445: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:30:08.446242395Z [2024-06-19 01:30:08,446: INFO/ForkPoolWorker-15] Read VIM bd4bac36-ae3e-42a7-9dde-3c4b01084c0a (k8s07_dummy) 2024-06-19T01:30:08.446373612Z [2024-06-19 01:30:08,446: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'bd4bac36-ae3e-42a7-9dde-3c4b01084c0a', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-06-19T01:30:08.446447771Z [2024-06-19 01:30:08,446: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T01:30:08.446795469Z [2024-06-19 01:30:08,446: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T01:30:08.446853641Z [2024-06-19 01:30:08,446: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:30:08.455857824Z [2024-06-19 01:30:08,455: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T01:30:08.545695370Z [2024-06-19 01:30:08,545: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:30:09.194712493Z [2024-06-19 01:30:09,194: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a2205a59-87ec-4a51-8f24-c48119c273bd] succeeded in 2.149508769000022s: None 2024-06-19T01:30:09.262649628Z [2024-06-19 01:30:09,262: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[062809e9-3048-4f63-8c75-e5a98998a4d0] received 2024-06-19T01:30:09.271220455Z [2024-06-19 01:30:09,270: INFO/ForkPoolWorker-15] [062809e9-3048-4f63-8c75-e5a98998a4d0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'send_prometheus', 'scheduled__2024-06-19T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T01:30:09.527518132Z [2024-06-19 01:30:09,524: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T01:30:10.552410469Z [2024-06-19 01:30:10,551: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T01:30:10.555395292Z [2024-06-19 01:30:10,554: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:30:10.585928785Z [2024-06-19 01:30:10,585: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T01:30:10.588005928Z [2024-06-19 01:30:10,587: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:30:10.588232017Z [2024-06-19 01:30:10,588: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:30:10.588420314Z [2024-06-19 01:30:10,588: INFO/ForkPoolWorker-15] Read VIM bd4bac36-ae3e-42a7-9dde-3c4b01084c0a (k8s07_dummy) 2024-06-19T01:30:10.588748540Z [2024-06-19 01:30:10,588: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'bd4bac36-ae3e-42a7-9dde-3c4b01084c0a', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-06-19T01:30:10.588918209Z [2024-06-19 01:30:10,588: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T01:30:10.589296973Z [2024-06-19 01:30:10,589: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T01:30:10.589472169Z [2024-06-19 01:30:10,589: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:30:10.599297565Z [2024-06-19 01:30:10,598: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T01:30:10.692012475Z [2024-06-19 01:30:10,691: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:30:11.272787747Z [2024-06-19 01:30:11,272: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[062809e9-3048-4f63-8c75-e5a98998a4d0] succeeded in 2.0079999400004453s: None 2024-06-19T01:31:01.239498737Z [2024-06-19 01:31:01,239: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e92aa6f2-c6e7-485e-99d8-99a3b9ee2575] received 2024-06-19T01:31:01.242741858Z [2024-06-19 01:31:01,242: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[53307877-c063-4cb4-9b09-ff14945b0c5c] received 2024-06-19T01:31:01.249503264Z [2024-06-19 01:31:01,249: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d055b171-9b7e-488a-81fb-f6a568ec2746] received 2024-06-19T01:31:01.250406135Z [2024-06-19 01:31:01,250: INFO/ForkPoolWorker-15] [e92aa6f2-c6e7-485e-99d8-99a3b9ee2575] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T01:31:01.253042321Z [2024-06-19 01:31:01,252: INFO/ForkPoolWorker-16] [53307877-c063-4cb4-9b09-ff14945b0c5c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T01:31:01.261411143Z [2024-06-19 01:31:01,261: INFO/ForkPoolWorker-1] [d055b171-9b7e-488a-81fb-f6a568ec2746] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T01:31:01.546848705Z [2024-06-19 01:31:01,543: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T01:31:01.547505699Z [2024-06-19 01:31:01,544: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T01:31:01.630636010Z [2024-06-19 01:31:01,626: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T01:31:01.827742070Z [2024-06-19 01:31:01,827: INFO/ForkPoolWorker-1] Getting SDNC list 2024-06-19T01:31:01.833874054Z [2024-06-19 01:31:01,833: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:31:01.872542170Z [2024-06-19 01:31:01,872: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T01:31:01.876436334Z [2024-06-19 01:31:01,876: INFO/ForkPoolWorker-1] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T01:31:01.876592970Z [2024-06-19 01:31:01,876: INFO/ForkPoolWorker-1] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T01:31:01.876712962Z [2024-06-19 01:31:01,876: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-06-19T01:31:01.877034188Z [2024-06-19 01:31:01,876: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T01:31:02.026345629Z [2024-06-19 01:31:02,025: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:31:02.762522059Z [2024-06-19 01:31:02,762: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d055b171-9b7e-488a-81fb-f6a568ec2746] succeeded in 1.5112241909992008s: None 2024-06-19T01:31:02.809902025Z [2024-06-19 01:31:02,809: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T01:31:02.813052825Z [2024-06-19 01:31:02,812: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:31:02.842376265Z [2024-06-19 01:31:02,842: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T01:31:02.844978835Z [2024-06-19 01:31:02,844: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:31:02.845355896Z [2024-06-19 01:31:02,845: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:31:02.845762074Z [2024-06-19 01:31:02,845: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:31:02.845960695Z [2024-06-19 01:31:02,845: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T01:31:02.846693522Z [2024-06-19 01:31:02,846: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T01:31:02.846882766Z [2024-06-19 01:31:02,846: INFO/ForkPoolWorker-16] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:31:02.859626303Z [2024-06-19 01:31:02,859: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T01:31:02.862779255Z [2024-06-19 01:31:02,862: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:31:02.883794703Z [2024-06-19 01:31:02,883: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T01:31:02.885344905Z [2024-06-19 01:31:02,885: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:31:02.885367085Z [2024-06-19 01:31:02,885: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:31:02.885470003Z [2024-06-19 01:31:02,885: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:31:02.885509523Z [2024-06-19 01:31:02,885: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T01:31:02.885867061Z [2024-06-19 01:31:02,885: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-06-19T01:31:02.885899234Z [2024-06-19 01:31:02,885: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:31:02.946078867Z [2024-06-19 01:31:02,945: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:31:03.002885400Z [2024-06-19 01:31:03,002: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:31:04.559202742Z [2024-06-19 01:31:04,558: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[53307877-c063-4cb4-9b09-ff14945b0c5c] succeeded in 3.3129783220010722s: None 2024-06-19T01:31:04.976785614Z [2024-06-19 01:31:04,976: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e92aa6f2-c6e7-485e-99d8-99a3b9ee2575] succeeded in 3.7340648190001957s: None 2024-06-19T01:32:01.284193329Z [2024-06-19 01:32:01,283: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b8b2e830-beaf-4db6-a716-187e9640b3b8] received 2024-06-19T01:32:01.288499903Z [2024-06-19 01:32:01,288: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ffc1f1a3-050c-4f68-bfff-58dbf487b1cc] received 2024-06-19T01:32:01.296367929Z [2024-06-19 01:32:01,296: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8ac8d319-bfa8-412e-bfca-485d5e676f36] received 2024-06-19T01:32:01.297414016Z [2024-06-19 01:32:01,297: INFO/ForkPoolWorker-15] [b8b2e830-beaf-4db6-a716-187e9640b3b8] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-19T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-19T01:32:01.299479917Z [2024-06-19 01:32:01,299: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ffb276fc-71bd-4c8c-8863-9cf8d233a29c] received 2024-06-19T01:32:01.310621325Z [2024-06-19 01:32:01,310: INFO/ForkPoolWorker-16] [ffc1f1a3-050c-4f68-bfff-58dbf487b1cc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T01:32:01.317715312Z [2024-06-19 01:32:01,317: INFO/ForkPoolWorker-2] [ffb276fc-71bd-4c8c-8863-9cf8d233a29c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T01:32:01.320050217Z [2024-06-19 01:32:01,319: INFO/ForkPoolWorker-1] [8ac8d319-bfa8-412e-bfca-485d5e676f36] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T01:32:01.604297098Z [2024-06-19 01:32:01,601: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T01:32:01.688939542Z [2024-06-19 01:32:01,685: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T01:32:01.701684169Z [2024-06-19 01:32:01,698: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T01:32:01.715373484Z [2024-06-19 01:32:01,712: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-19T01:32:01.864616166Z [2024-06-19 01:32:01,864: INFO/ForkPoolWorker-2] Getting SDNC list 2024-06-19T01:32:01.868427993Z [2024-06-19 01:32:01,868: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:32:01.906083370Z [2024-06-19 01:32:01,905: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T01:32:01.908536042Z [2024-06-19 01:32:01,908: INFO/ForkPoolWorker-2] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T01:32:01.908772804Z [2024-06-19 01:32:01,908: INFO/ForkPoolWorker-2] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T01:32:01.908907610Z [2024-06-19 01:32:01,908: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-06-19T01:32:01.909252075Z [2024-06-19 01:32:01,909: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T01:32:01.972735373Z [2024-06-19 01:32:01,972: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:32:02.032077233Z [2024-06-19 01:32:02,031: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:32:02.621099037Z [2024-06-19 01:32:02,620: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b8b2e830-beaf-4db6-a716-187e9640b3b8] succeeded in 1.3344281789995875s: None 2024-06-19T01:32:02.689281503Z [2024-06-19 01:32:02,688: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[ffb276fc-71bd-4c8c-8863-9cf8d233a29c] succeeded in 1.386840162000226s: None 2024-06-19T01:32:03.104484345Z [2024-06-19 01:32:03,104: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T01:32:03.107776175Z [2024-06-19 01:32:03,107: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:32:03.126623768Z [2024-06-19 01:32:03,126: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T01:32:03.127892822Z [2024-06-19 01:32:03,127: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:32:03.127907025Z [2024-06-19 01:32:03,127: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:32:03.128102806Z [2024-06-19 01:32:03,127: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:32:03.128114460Z [2024-06-19 01:32:03,128: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T01:32:03.128415117Z [2024-06-19 01:32:03,128: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T01:32:03.128427124Z [2024-06-19 01:32:03,128: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:32:03.160539928Z [2024-06-19 01:32:03,160: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T01:32:03.164097195Z [2024-06-19 01:32:03,163: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:32:03.181816389Z [2024-06-19 01:32:03,181: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T01:32:03.183512589Z [2024-06-19 01:32:03,183: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:32:03.183532624Z [2024-06-19 01:32:03,183: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:32:03.183803688Z [2024-06-19 01:32:03,183: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:32:03.183897102Z [2024-06-19 01:32:03,183: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T01:32:03.184127659Z [2024-06-19 01:32:03,183: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-19T01:32:03.184159717Z [2024-06-19 01:32:03,184: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:32:03.223804850Z [2024-06-19 01:32:03,223: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:32:03.280974054Z [2024-06-19 01:32:03,280: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:32:04.762425520Z [2024-06-19 01:32:04,761: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8ac8d319-bfa8-412e-bfca-485d5e676f36] succeeded in 3.463720691999697s: None 2024-06-19T01:32:05.491528143Z [2024-06-19 01:32:05,490: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ffc1f1a3-050c-4f68-bfff-58dbf487b1cc] succeeded in 4.196446516998549s: None 2024-06-19T01:33:00.791208152Z [2024-06-19 01:33:00,790: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[60bcffdd-69bb-4900-bc97-d1c5330365ec] received 2024-06-19T01:33:00.795215514Z [2024-06-19 01:33:00,794: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[413c4117-92c1-4e9a-9fef-199a557d91dd] received 2024-06-19T01:33:00.797655321Z [2024-06-19 01:33:00,797: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[94583795-bb01-42f6-83f5-29e5a5f1b2bc] received 2024-06-19T01:33:00.808889805Z [2024-06-19 01:33:00,808: INFO/ForkPoolWorker-16] [413c4117-92c1-4e9a-9fef-199a557d91dd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T01:33:00.812506700Z [2024-06-19 01:33:00,812: INFO/ForkPoolWorker-15] [60bcffdd-69bb-4900-bc97-d1c5330365ec] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T01:33:00.813591378Z [2024-06-19 01:33:00,813: INFO/ForkPoolWorker-1] [94583795-bb01-42f6-83f5-29e5a5f1b2bc] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T01:33:01.140535224Z [2024-06-19 01:33:01,136: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T01:33:01.151199041Z [2024-06-19 01:33:01,146: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T01:33:01.151540077Z [2024-06-19 01:33:01,147: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T01:33:01.358766455Z [2024-06-19 01:33:01,358: INFO/ForkPoolWorker-1] Getting SDNC list 2024-06-19T01:33:01.369902005Z [2024-06-19 01:33:01,369: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:33:01.419495868Z [2024-06-19 01:33:01,419: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T01:33:01.421934453Z [2024-06-19 01:33:01,421: INFO/ForkPoolWorker-1] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T01:33:01.422429173Z [2024-06-19 01:33:01,421: INFO/ForkPoolWorker-1] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T01:33:01.422562256Z [2024-06-19 01:33:01,422: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-06-19T01:33:01.422807459Z [2024-06-19 01:33:01,422: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T01:33:01.537267361Z [2024-06-19 01:33:01,537: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:33:02.086728875Z [2024-06-19 01:33:02,086: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[94583795-bb01-42f6-83f5-29e5a5f1b2bc] succeeded in 1.2836516199986363s: None 2024-06-19T01:33:02.399859357Z [2024-06-19 01:33:02,399: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T01:33:02.403007115Z [2024-06-19 01:33:02,402: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:33:02.423155972Z [2024-06-19 01:33:02,422: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T01:33:02.424408071Z [2024-06-19 01:33:02,424: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:33:02.424524714Z [2024-06-19 01:33:02,424: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:33:02.424662958Z [2024-06-19 01:33:02,424: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:33:02.424738436Z [2024-06-19 01:33:02,424: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T01:33:02.424965900Z [2024-06-19 01:33:02,424: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-06-19T01:33:02.425067021Z [2024-06-19 01:33:02,424: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:33:02.463620759Z [2024-06-19 01:33:02,463: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T01:33:02.470686113Z [2024-06-19 01:33:02,470: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:33:02.491528829Z [2024-06-19 01:33:02,491: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T01:33:02.492957935Z [2024-06-19 01:33:02,492: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:33:02.493019133Z [2024-06-19 01:33:02,492: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:33:02.493218568Z [2024-06-19 01:33:02,492: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:33:02.493314856Z [2024-06-19 01:33:02,493: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T01:33:02.493723900Z [2024-06-19 01:33:02,493: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T01:33:02.493798981Z [2024-06-19 01:33:02,493: INFO/ForkPoolWorker-16] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:33:02.517290913Z [2024-06-19 01:33:02,517: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:33:02.592241512Z [2024-06-19 01:33:02,591: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:33:04.305429909Z [2024-06-19 01:33:04,305: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[413c4117-92c1-4e9a-9fef-199a557d91dd] succeeded in 3.5061413500006893s: None 2024-06-19T01:33:04.732552471Z [2024-06-19 01:33:04,731: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[60bcffdd-69bb-4900-bc97-d1c5330365ec] succeeded in 3.9361305610000272s: None 2024-06-19T01:34:00.996473656Z [2024-06-19 01:34:00,996: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2a5adec4-7d09-4446-8a44-8e5ff4216e72] received 2024-06-19T01:34:01.003587262Z [2024-06-19 01:34:01,003: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7aa4fa3b-1efa-402b-980d-914b93278021] received 2024-06-19T01:34:01.005467481Z [2024-06-19 01:34:01,005: INFO/ForkPoolWorker-15] [2a5adec4-7d09-4446-8a44-8e5ff4216e72] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T01:34:01.010684464Z [2024-06-19 01:34:01,010: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[64a13118-7c4a-48b4-9d72-9dd858c82a4c] received 2024-06-19T01:34:01.016514297Z [2024-06-19 01:34:01,016: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bd4fa0a8-f0c5-439e-a048-c51fb4cef3ab] received 2024-06-19T01:34:01.033554317Z [2024-06-19 01:34:01,032: INFO/ForkPoolWorker-1] [64a13118-7c4a-48b4-9d72-9dd858c82a4c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T01:34:01.036105949Z [2024-06-19 01:34:01,035: INFO/ForkPoolWorker-2] [bd4fa0a8-f0c5-439e-a048-c51fb4cef3ab] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T01:34:01.036988037Z [2024-06-19 01:34:01,036: INFO/ForkPoolWorker-16] [7aa4fa3b-1efa-402b-980d-914b93278021] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-19T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-19T01:34:01.381876704Z [2024-06-19 01:34:01,378: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T01:34:01.445324208Z [2024-06-19 01:34:01,439: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-19T01:34:01.454890016Z [2024-06-19 01:34:01,451: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T01:34:01.456266753Z [2024-06-19 01:34:01,450: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T01:34:01.620145428Z [2024-06-19 01:34:01,619: INFO/ForkPoolWorker-1] Getting SDNC list 2024-06-19T01:34:01.624280949Z [2024-06-19 01:34:01,623: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:34:01.660505506Z [2024-06-19 01:34:01,660: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T01:34:01.664381321Z [2024-06-19 01:34:01,664: INFO/ForkPoolWorker-1] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T01:34:01.664464301Z [2024-06-19 01:34:01,664: INFO/ForkPoolWorker-1] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T01:34:01.664526182Z [2024-06-19 01:34:01,664: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-06-19T01:34:01.664727747Z [2024-06-19 01:34:01,664: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T01:34:01.763966088Z [2024-06-19 01:34:01,763: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:34:01.806028346Z [2024-06-19 01:34:01,805: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:34:02.498290275Z [2024-06-19 01:34:02,497: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[64a13118-7c4a-48b4-9d72-9dd858c82a4c] succeeded in 1.477446750001036s: None 2024-06-19T01:34:02.522596049Z [2024-06-19 01:34:02,522: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7aa4fa3b-1efa-402b-980d-914b93278021] succeeded in 1.514151187000607s: None 2024-06-19T01:34:02.634648644Z [2024-06-19 01:34:02,634: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-19T01:34:02.638784197Z [2024-06-19 01:34:02,638: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:34:02.663951969Z [2024-06-19 01:34:02,663: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T01:34:02.666082640Z [2024-06-19 01:34:02,665: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:34:02.666179535Z [2024-06-19 01:34:02,666: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:34:02.666397871Z [2024-06-19 01:34:02,666: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:34:02.666525952Z [2024-06-19 01:34:02,666: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-19T01:34:02.666997438Z [2024-06-19 01:34:02,666: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-06-19T01:34:02.667123871Z [2024-06-19 01:34:02,666: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:34:02.753497904Z [2024-06-19 01:34:02,753: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:34:02.856990809Z [2024-06-19 01:34:02,856: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T01:34:02.860623533Z [2024-06-19 01:34:02,859: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:34:02.886579377Z [2024-06-19 01:34:02,886: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T01:34:02.888441547Z [2024-06-19 01:34:02,887: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:34:02.888461752Z [2024-06-19 01:34:02,887: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:34:02.889603295Z [2024-06-19 01:34:02,887: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:34:02.889622226Z [2024-06-19 01:34:02,889: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T01:34:02.889862121Z [2024-06-19 01:34:02,889: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T01:34:02.889904426Z [2024-06-19 01:34:02,889: INFO/ForkPoolWorker-15] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:34:02.971473154Z [2024-06-19 01:34:02,971: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:34:05.005901566Z [2024-06-19 01:34:05,003: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[bd4fa0a8-f0c5-439e-a048-c51fb4cef3ab] succeeded in 3.985054366999975s: None 2024-06-19T01:34:05.030356605Z [2024-06-19 01:34:05,029: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2a5adec4-7d09-4446-8a44-8e5ff4216e72] succeeded in 4.032237814999462s: None 2024-06-19T01:35:00.550493795Z [2024-06-19 01:35:00,550: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[00d61f0c-5f85-41c1-a6e8-b148f440413b] received 2024-06-19T01:35:00.554107031Z [2024-06-19 01:35:00,553: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[54150994-5c24-4333-843f-8a067d34ca4f] received 2024-06-19T01:35:00.555546749Z [2024-06-19 01:35:00,555: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[58cc5af8-3687-4e69-9780-a2cd9d3cfaa4] received 2024-06-19T01:35:00.557648014Z [2024-06-19 01:35:00,557: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[004a3fa7-acf2-4392-ae3c-c05de237dd90] received 2024-06-19T01:35:00.567411714Z [2024-06-19 01:35:00,567: INFO/ForkPoolWorker-2] [004a3fa7-acf2-4392-ae3c-c05de237dd90] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T01:35:00.569676669Z [2024-06-19 01:35:00,569: INFO/ForkPoolWorker-16] [54150994-5c24-4333-843f-8a067d34ca4f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T01:35:00.576396249Z [2024-06-19 01:35:00,576: INFO/ForkPoolWorker-15] [00d61f0c-5f85-41c1-a6e8-b148f440413b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T01:35:00.580555300Z [2024-06-19 01:35:00,580: INFO/ForkPoolWorker-1] [58cc5af8-3687-4e69-9780-a2cd9d3cfaa4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-19T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T01:35:00.989253789Z [2024-06-19 01:35:00,985: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T01:35:01.138173663Z [2024-06-19 01:35:01,134: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T01:35:01.143610041Z [2024-06-19 01:35:01,143: INFO/ForkPoolWorker-16] Getting SDNC list 2024-06-19T01:35:01.147870815Z [2024-06-19 01:35:01,147: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:35:01.179357678Z [2024-06-19 01:35:01,179: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T01:35:01.185594213Z [2024-06-19 01:35:01,185: INFO/ForkPoolWorker-16] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T01:35:01.185806706Z [2024-06-19 01:35:01,185: INFO/ForkPoolWorker-16] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T01:35:01.185923489Z [2024-06-19 01:35:01,185: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-06-19T01:35:01.186270679Z [2024-06-19 01:35:01,186: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T01:35:01.214090422Z [2024-06-19 01:35:01,207: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T01:35:01.238155317Z [2024-06-19 01:35:01,234: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T01:35:01.281222606Z [2024-06-19 01:35:01,280: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:35:02.125437628Z [2024-06-19 01:35:02,125: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[54150994-5c24-4333-843f-8a067d34ca4f] succeeded in 1.5687871899990569s: None 2024-06-19T01:35:02.847618337Z [2024-06-19 01:35:02,847: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T01:35:02.850927707Z [2024-06-19 01:35:02,850: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:35:02.875561684Z [2024-06-19 01:35:02,875: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T01:35:02.880875604Z [2024-06-19 01:35:02,880: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:35:02.881062152Z [2024-06-19 01:35:02,880: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:35:02.881335202Z [2024-06-19 01:35:02,881: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:35:02.881503279Z [2024-06-19 01:35:02,881: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T01:35:02.881873796Z [2024-06-19 01:35:02,881: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T01:35:02.882125699Z [2024-06-19 01:35:02,881: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:35:02.945127816Z [2024-06-19 01:35:02,944: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-19T01:35:02.948426829Z [2024-06-19 01:35:02,947: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:35:02.957609655Z [2024-06-19 01:35:02,957: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:35:02.993586074Z [2024-06-19 01:35:02,993: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T01:35:02.995045242Z [2024-06-19 01:35:02,994: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:35:02.995164515Z [2024-06-19 01:35:02,994: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:35:02.995339868Z [2024-06-19 01:35:02,995: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:35:02.995438414Z [2024-06-19 01:35:02,995: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-19T01:35:02.996017733Z [2024-06-19 01:35:02,995: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-06-19T01:35:02.996440660Z [2024-06-19 01:35:02,996: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:35:03.077546110Z [2024-06-19 01:35:03,077: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T01:35:03.080729144Z [2024-06-19 01:35:03,080: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:35:03.089261286Z [2024-06-19 01:35:03,089: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:35:03.098924628Z [2024-06-19 01:35:03,098: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T01:35:03.100282318Z [2024-06-19 01:35:03,100: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:35:03.100532244Z [2024-06-19 01:35:03,100: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:35:03.100708307Z [2024-06-19 01:35:03,100: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:35:03.100780556Z [2024-06-19 01:35:03,100: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T01:35:03.101967104Z [2024-06-19 01:35:03,101: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T01:35:03.101982681Z [2024-06-19 01:35:03,101: INFO/ForkPoolWorker-15] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:35:03.196525444Z [2024-06-19 01:35:03,196: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:35:03.751568930Z [2024-06-19 01:35:03,751: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[58cc5af8-3687-4e69-9780-a2cd9d3cfaa4] succeeded in 3.1906993800002965s: None 2024-06-19T01:35:04.576608972Z [2024-06-19 01:35:04,576: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[584eb08a-95fc-4a37-8430-943e94d39acd] received 2024-06-19T01:35:04.586633526Z [2024-06-19 01:35:04,586: INFO/ForkPoolWorker-16] [584eb08a-95fc-4a37-8430-943e94d39acd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'split_metrics', 'scheduled__2024-06-19T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T01:35:04.898249313Z [2024-06-19 01:35:04,897: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[00d61f0c-5f85-41c1-a6e8-b148f440413b] succeeded in 4.344497193000279s: None 2024-06-19T01:35:04.918860034Z [2024-06-19 01:35:04,915: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T01:35:05.154222452Z [2024-06-19 01:35:05,153: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[004a3fa7-acf2-4392-ae3c-c05de237dd90] succeeded in 4.594797747000484s: None 2024-06-19T01:35:06.056314263Z [2024-06-19 01:35:06,055: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T01:35:06.059603058Z [2024-06-19 01:35:06,059: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:35:06.093706832Z [2024-06-19 01:35:06,093: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T01:35:06.095430773Z [2024-06-19 01:35:06,095: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:35:06.095756410Z [2024-06-19 01:35:06,095: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:35:06.096147533Z [2024-06-19 01:35:06,095: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:35:06.096435662Z [2024-06-19 01:35:06,096: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T01:35:06.097109734Z [2024-06-19 01:35:06,096: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T01:35:06.097387166Z [2024-06-19 01:35:06,097: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:35:06.196687864Z [2024-06-19 01:35:06,196: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:35:06.881064913Z [2024-06-19 01:35:06,880: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[584eb08a-95fc-4a37-8430-943e94d39acd] succeeded in 2.3004771239993715s: None 2024-06-19T01:35:07.024123724Z [2024-06-19 01:35:07,023: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[61613beb-85dc-427b-9fe6-74673a48a67c] received 2024-06-19T01:35:07.041307271Z [2024-06-19 01:35:07,040: INFO/ForkPoolWorker-15] [61613beb-85dc-427b-9fe6-74673a48a67c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'collect_metrics', 'scheduled__2024-06-19T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-19T01:35:07.349943371Z [2024-06-19 01:35:07,346: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T01:35:08.382922771Z [2024-06-19 01:35:08,382: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T01:35:08.385989086Z [2024-06-19 01:35:08,385: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:35:08.414755547Z [2024-06-19 01:35:08,414: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T01:35:08.417332446Z [2024-06-19 01:35:08,416: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:35:08.417402337Z [2024-06-19 01:35:08,417: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:35:08.417608247Z [2024-06-19 01:35:08,417: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:35:08.417755335Z [2024-06-19 01:35:08,417: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T01:35:08.418275123Z [2024-06-19 01:35:08,417: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T01:35:08.418506035Z [2024-06-19 01:35:08,418: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:35:08.552882154Z [2024-06-19 01:35:08,552: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:35:09.166752418Z [2024-06-19 01:35:09,166: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[61613beb-85dc-427b-9fe6-74673a48a67c] succeeded in 2.1404589249996206s: None 2024-06-19T01:35:09.726683679Z [2024-06-19 01:35:09,726: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[97ac4ec7-63d4-409f-9df1-c87d14a2108c] received 2024-06-19T01:35:09.740408543Z [2024-06-19 01:35:09,739: INFO/ForkPoolWorker-15] [97ac4ec7-63d4-409f-9df1-c87d14a2108c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'send_prometheus', 'scheduled__2024-06-19T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T01:35:10.047575672Z [2024-06-19 01:35:10,044: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T01:35:11.109651021Z [2024-06-19 01:35:11,109: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T01:35:11.112753512Z [2024-06-19 01:35:11,112: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:35:11.135362661Z [2024-06-19 01:35:11,135: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T01:35:11.136798625Z [2024-06-19 01:35:11,136: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:35:11.136814527Z [2024-06-19 01:35:11,136: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:35:11.137188598Z [2024-06-19 01:35:11,136: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:35:11.137219577Z [2024-06-19 01:35:11,137: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T01:35:11.137426788Z [2024-06-19 01:35:11,137: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T01:35:11.137595673Z [2024-06-19 01:35:11,137: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:35:11.238834370Z [2024-06-19 01:35:11,238: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:35:11.849203256Z [2024-06-19 01:35:11,848: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[97ac4ec7-63d4-409f-9df1-c87d14a2108c] succeeded in 2.1188696949993755s: None 2024-06-19T01:36:00.776950033Z [2024-06-19 01:36:00,776: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d9fbac3f-2c68-42e6-aeb2-f2a9d048542f] received 2024-06-19T01:36:00.786549797Z [2024-06-19 01:36:00,786: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[53772dac-d975-48db-b2c4-a5f4debaa28b] received 2024-06-19T01:36:00.790148907Z [2024-06-19 01:36:00,789: INFO/ForkPoolWorker-15] [d9fbac3f-2c68-42e6-aeb2-f2a9d048542f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T01:36:00.793504136Z [2024-06-19 01:36:00,793: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b06d1b88-b055-4929-8bef-372b37f17841] received 2024-06-19T01:36:00.800075111Z [2024-06-19 01:36:00,799: INFO/ForkPoolWorker-1] [b06d1b88-b055-4929-8bef-372b37f17841] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T01:36:00.802427194Z [2024-06-19 01:36:00,802: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3daa8bf2-8b30-478a-bc2d-bb129b7917cf] received 2024-06-19T01:36:00.804510307Z [2024-06-19 01:36:00,804: INFO/ForkPoolWorker-16] [53772dac-d975-48db-b2c4-a5f4debaa28b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-19T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-19T01:36:00.810870266Z [2024-06-19 01:36:00,810: INFO/ForkPoolWorker-2] [3daa8bf2-8b30-478a-bc2d-bb129b7917cf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T01:36:01.184231335Z [2024-06-19 01:36:01,179: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T01:36:01.322116210Z [2024-06-19 01:36:01,317: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T01:36:01.391617872Z [2024-06-19 01:36:01,371: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-19T01:36:01.426427504Z [2024-06-19 01:36:01,422: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T01:36:01.580922833Z [2024-06-19 01:36:01,580: INFO/ForkPoolWorker-1] Getting SDNC list 2024-06-19T01:36:01.584833303Z [2024-06-19 01:36:01,584: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:36:01.606511631Z [2024-06-19 01:36:01,606: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T01:36:01.613200148Z [2024-06-19 01:36:01,612: INFO/ForkPoolWorker-1] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T01:36:01.613436123Z [2024-06-19 01:36:01,613: INFO/ForkPoolWorker-1] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T01:36:01.613510363Z [2024-06-19 01:36:01,613: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-06-19T01:36:01.613735313Z [2024-06-19 01:36:01,613: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T01:36:01.710249126Z [2024-06-19 01:36:01,709: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:36:01.720195764Z [2024-06-19 01:36:01,719: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:36:02.305911094Z [2024-06-19 01:36:02,304: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[53772dac-d975-48db-b2c4-a5f4debaa28b] succeeded in 1.5111797979989205s: None 2024-06-19T01:36:02.325056416Z [2024-06-19 01:36:02,324: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b06d1b88-b055-4929-8bef-372b37f17841] succeeded in 1.5296562690000428s: None 2024-06-19T01:36:02.748953259Z [2024-06-19 01:36:02,748: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-19T01:36:02.752131095Z [2024-06-19 01:36:02,751: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:36:02.761359222Z [2024-06-19 01:36:02,760: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T01:36:02.764953980Z [2024-06-19 01:36:02,764: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:36:02.775209988Z [2024-06-19 01:36:02,774: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T01:36:02.777166000Z [2024-06-19 01:36:02,776: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:36:02.777179508Z [2024-06-19 01:36:02,777: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:36:02.777364836Z [2024-06-19 01:36:02,777: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:36:02.777476714Z [2024-06-19 01:36:02,777: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-19T01:36:02.777763843Z [2024-06-19 01:36:02,777: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-06-19T01:36:02.777950138Z [2024-06-19 01:36:02,777: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:36:02.784089790Z [2024-06-19 01:36:02,783: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T01:36:02.785410195Z [2024-06-19 01:36:02,785: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:36:02.785432643Z [2024-06-19 01:36:02,785: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:36:02.785592119Z [2024-06-19 01:36:02,785: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:36:02.785621817Z [2024-06-19 01:36:02,785: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T01:36:02.786002971Z [2024-06-19 01:36:02,785: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T01:36:02.786069928Z [2024-06-19 01:36:02,785: INFO/ForkPoolWorker-15] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:36:02.852517532Z [2024-06-19 01:36:02,852: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:36:02.865413239Z [2024-06-19 01:36:02,865: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:36:04.649778917Z [2024-06-19 01:36:04,649: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d9fbac3f-2c68-42e6-aeb2-f2a9d048542f] succeeded in 3.8676039069996477s: None 2024-06-19T01:36:05.147041134Z [2024-06-19 01:36:05,146: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[3daa8bf2-8b30-478a-bc2d-bb129b7917cf] succeeded in 4.342870398000741s: None 2024-06-19T01:37:00.552464453Z [2024-06-19 01:37:00,552: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6d20a492-c606-41c9-8b6b-03ef66d294f8] received 2024-06-19T01:37:00.554321101Z [2024-06-19 01:37:00,554: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5d49526b-7bb2-42fb-9848-d26594ac2fbc] received 2024-06-19T01:37:00.564170270Z [2024-06-19 01:37:00,563: INFO/ForkPoolWorker-16] [5d49526b-7bb2-42fb-9848-d26594ac2fbc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T01:37:00.564857396Z [2024-06-19 01:37:00,564: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e66c1a63-fb9f-4178-b557-4bcadbb3fb90] received 2024-06-19T01:37:00.569009760Z [2024-06-19 01:37:00,568: INFO/ForkPoolWorker-15] [6d20a492-c606-41c9-8b6b-03ef66d294f8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T01:37:00.577157542Z [2024-06-19 01:37:00,576: INFO/ForkPoolWorker-1] [e66c1a63-fb9f-4178-b557-4bcadbb3fb90] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T01:37:00.938683144Z [2024-06-19 01:37:00,935: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T01:37:00.964958601Z [2024-06-19 01:37:00,961: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T01:37:00.967778152Z [2024-06-19 01:37:00,964: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T01:37:01.121135288Z [2024-06-19 01:37:01,120: INFO/ForkPoolWorker-1] Getting SDNC list 2024-06-19T01:37:01.125060795Z [2024-06-19 01:37:01,124: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:37:01.153180027Z [2024-06-19 01:37:01,152: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T01:37:01.154908267Z [2024-06-19 01:37:01,154: INFO/ForkPoolWorker-1] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T01:37:01.155342981Z [2024-06-19 01:37:01,155: INFO/ForkPoolWorker-1] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T01:37:01.156240655Z [2024-06-19 01:37:01,155: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-06-19T01:37:01.156838471Z [2024-06-19 01:37:01,156: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T01:37:01.260357724Z [2024-06-19 01:37:01,260: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:37:01.865233261Z [2024-06-19 01:37:01,864: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e66c1a63-fb9f-4178-b557-4bcadbb3fb90] succeeded in 1.298786106000989s: None 2024-06-19T01:37:02.138254628Z [2024-06-19 01:37:02,137: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T01:37:02.141915849Z [2024-06-19 01:37:02,141: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:37:02.166656671Z [2024-06-19 01:37:02,166: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T01:37:02.168491193Z [2024-06-19 01:37:02,168: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:37:02.168532256Z [2024-06-19 01:37:02,168: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:37:02.168729956Z [2024-06-19 01:37:02,168: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:37:02.168859984Z [2024-06-19 01:37:02,168: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T01:37:02.169594677Z [2024-06-19 01:37:02,169: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-06-19T01:37:02.169662466Z [2024-06-19 01:37:02,169: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:37:02.293169685Z [2024-06-19 01:37:02,292: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T01:37:02.296870481Z [2024-06-19 01:37:02,296: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:37:02.325589438Z [2024-06-19 01:37:02,325: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T01:37:02.332895334Z [2024-06-19 01:37:02,332: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:37:02.332931290Z [2024-06-19 01:37:02,332: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:37:02.333366304Z [2024-06-19 01:37:02,332: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:37:02.333435870Z [2024-06-19 01:37:02,333: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T01:37:02.333749956Z [2024-06-19 01:37:02,333: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T01:37:02.333793939Z [2024-06-19 01:37:02,333: INFO/ForkPoolWorker-16] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:37:02.339424194Z [2024-06-19 01:37:02,339: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:37:02.427570760Z [2024-06-19 01:37:02,427: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:37:04.079741019Z [2024-06-19 01:37:04,078: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5d49526b-7bb2-42fb-9848-d26594ac2fbc] succeeded in 3.5224822299987864s: None 2024-06-19T01:37:04.309731506Z [2024-06-19 01:37:04,309: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6d20a492-c606-41c9-8b6b-03ef66d294f8] succeeded in 3.7542513419994066s: None 2024-06-19T01:38:00.580779027Z [2024-06-19 01:38:00,579: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e4a50274-0ca3-4aaa-a381-5d66ea165636] received 2024-06-19T01:38:00.583921687Z [2024-06-19 01:38:00,583: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d1a6d841-cbcf-41f1-a49c-3232cd94b33f] received 2024-06-19T01:38:00.594506455Z [2024-06-19 01:38:00,594: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[92dd3db5-0eb2-4d0e-94fb-0a51ffb952d0] received 2024-06-19T01:38:00.597209450Z [2024-06-19 01:38:00,597: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4acf57eb-7747-4dc7-ad4d-d364ee5d8cf5] received 2024-06-19T01:38:00.604766499Z [2024-06-19 01:38:00,604: INFO/ForkPoolWorker-16] [d1a6d841-cbcf-41f1-a49c-3232cd94b33f] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-19T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-19T01:38:00.605611976Z [2024-06-19 01:38:00,605: INFO/ForkPoolWorker-15] [e4a50274-0ca3-4aaa-a381-5d66ea165636] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T01:38:00.606202870Z [2024-06-19 01:38:00,605: INFO/ForkPoolWorker-1] [92dd3db5-0eb2-4d0e-94fb-0a51ffb952d0] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T01:38:00.610402892Z [2024-06-19 01:38:00,610: INFO/ForkPoolWorker-2] [4acf57eb-7747-4dc7-ad4d-d364ee5d8cf5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T01:38:00.904392243Z [2024-06-19 01:38:00,899: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-19T01:38:00.922375505Z [2024-06-19 01:38:00,917: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T01:38:00.981582377Z [2024-06-19 01:38:00,974: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T01:38:00.990333163Z [2024-06-19 01:38:00,986: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T01:38:01.087417531Z [2024-06-19 01:38:01,087: INFO/ForkPoolWorker-1] Getting SDNC list 2024-06-19T01:38:01.091894070Z [2024-06-19 01:38:01,091: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:38:01.119136491Z [2024-06-19 01:38:01,118: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T01:38:01.120424027Z [2024-06-19 01:38:01,120: INFO/ForkPoolWorker-1] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T01:38:01.120855756Z [2024-06-19 01:38:01,120: INFO/ForkPoolWorker-1] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T01:38:01.121018272Z [2024-06-19 01:38:01,120: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-06-19T01:38:01.124096976Z [2024-06-19 01:38:01,123: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T01:38:01.188443307Z [2024-06-19 01:38:01,188: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:38:01.220213846Z [2024-06-19 01:38:01,219: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:38:01.749983627Z [2024-06-19 01:38:01,749: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[92dd3db5-0eb2-4d0e-94fb-0a51ffb952d0] succeeded in 1.1532959939995635s: None 2024-06-19T01:38:01.751860266Z [2024-06-19 01:38:01,751: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d1a6d841-cbcf-41f1-a49c-3232cd94b33f] succeeded in 1.1645831340010773s: None 2024-06-19T01:38:02.322664334Z [2024-06-19 01:38:02,322: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-19T01:38:02.369027646Z [2024-06-19 01:38:02,368: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:38:02.387728407Z [2024-06-19 01:38:02,387: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T01:38:02.390086887Z [2024-06-19 01:38:02,389: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:38:02.390518309Z [2024-06-19 01:38:02,390: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:38:02.392045120Z [2024-06-19 01:38:02,391: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:38:02.392220551Z [2024-06-19 01:38:02,392: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-19T01:38:02.392746414Z [2024-06-19 01:38:02,392: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-06-19T01:38:02.395325015Z [2024-06-19 01:38:02,392: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:38:02.410160749Z [2024-06-19 01:38:02,409: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T01:38:02.418998463Z [2024-06-19 01:38:02,418: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:38:02.450221300Z [2024-06-19 01:38:02,449: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T01:38:02.451355566Z [2024-06-19 01:38:02,451: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:38:02.451372697Z [2024-06-19 01:38:02,451: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:38:02.451477899Z [2024-06-19 01:38:02,451: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:38:02.451509416Z [2024-06-19 01:38:02,451: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T01:38:02.451741037Z [2024-06-19 01:38:02,451: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T01:38:02.451808496Z [2024-06-19 01:38:02,451: INFO/ForkPoolWorker-15] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:38:02.510242745Z [2024-06-19 01:38:02,509: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:38:02.568009725Z [2024-06-19 01:38:02,567: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:38:04.103404582Z [2024-06-19 01:38:04,102: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e4a50274-0ca3-4aaa-a381-5d66ea165636] succeeded in 3.515194239000266s: None 2024-06-19T01:38:04.395601703Z [2024-06-19 01:38:04,395: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[4acf57eb-7747-4dc7-ad4d-d364ee5d8cf5] succeeded in 3.79525408399968s: None 2024-06-19T01:39:00.972398630Z [2024-06-19 01:39:00,972: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cf8bb8d1-2200-4109-9ca6-d5ae54c6f93c] received 2024-06-19T01:39:00.978503430Z [2024-06-19 01:39:00,978: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c04ceac5-c557-41b6-b1b1-6abddcd5c524] received 2024-06-19T01:39:00.982541650Z [2024-06-19 01:39:00,982: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8eea1ce0-2de3-4a4b-8b42-21bd841a9e00] received 2024-06-19T01:39:00.985498648Z [2024-06-19 01:39:00,985: INFO/ForkPoolWorker-15] [cf8bb8d1-2200-4109-9ca6-d5ae54c6f93c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T01:39:00.990928431Z [2024-06-19 01:39:00,990: INFO/ForkPoolWorker-16] [c04ceac5-c557-41b6-b1b1-6abddcd5c524] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T01:39:01.008807684Z [2024-06-19 01:39:01,008: INFO/ForkPoolWorker-1] [8eea1ce0-2de3-4a4b-8b42-21bd841a9e00] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T01:39:01.361826957Z [2024-06-19 01:39:01,358: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T01:39:01.379692678Z [2024-06-19 01:39:01,376: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T01:39:01.457655210Z [2024-06-19 01:39:01,452: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T01:39:01.535809209Z [2024-06-19 01:39:01,535: INFO/ForkPoolWorker-16] Getting SDNC list 2024-06-19T01:39:01.539971498Z [2024-06-19 01:39:01,539: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:39:01.612733991Z [2024-06-19 01:39:01,612: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T01:39:01.617456470Z [2024-06-19 01:39:01,617: INFO/ForkPoolWorker-16] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T01:39:01.617903391Z [2024-06-19 01:39:01,617: INFO/ForkPoolWorker-16] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T01:39:01.618053145Z [2024-06-19 01:39:01,617: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-06-19T01:39:01.618317595Z [2024-06-19 01:39:01,618: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T01:39:01.787236489Z [2024-06-19 01:39:01,786: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:39:02.801147134Z [2024-06-19 01:39:02,800: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c04ceac5-c557-41b6-b1b1-6abddcd5c524] succeeded in 1.8209934339993197s: None 2024-06-19T01:39:03.081958645Z [2024-06-19 01:39:03,081: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T01:39:03.085769672Z [2024-06-19 01:39:03,085: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:39:03.140205541Z [2024-06-19 01:39:03,139: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T01:39:03.144233495Z [2024-06-19 01:39:03,144: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:39:03.144536187Z [2024-06-19 01:39:03,144: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:39:03.145259091Z [2024-06-19 01:39:03,144: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:39:03.145783824Z [2024-06-19 01:39:03,145: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T01:39:03.146141836Z [2024-06-19 01:39:03,146: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-06-19T01:39:03.146559687Z [2024-06-19 01:39:03,146: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:39:03.303968689Z [2024-06-19 01:39:03,303: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:39:03.486298053Z [2024-06-19 01:39:03,485: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T01:39:03.490651563Z [2024-06-19 01:39:03,490: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:39:03.532157553Z [2024-06-19 01:39:03,531: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T01:39:03.534435014Z [2024-06-19 01:39:03,534: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:39:03.534661729Z [2024-06-19 01:39:03,534: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:39:03.534973795Z [2024-06-19 01:39:03,534: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:39:03.535197125Z [2024-06-19 01:39:03,535: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T01:39:03.536658331Z [2024-06-19 01:39:03,535: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T01:39:03.537073568Z [2024-06-19 01:39:03,536: INFO/ForkPoolWorker-15] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:39:03.660553660Z [2024-06-19 01:39:03,660: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:39:05.388489596Z [2024-06-19 01:39:05,388: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8eea1ce0-2de3-4a4b-8b42-21bd841a9e00] succeeded in 4.402012043001378s: None 2024-06-19T01:39:05.400498982Z [2024-06-19 01:39:05,400: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cf8bb8d1-2200-4109-9ca6-d5ae54c6f93c] succeeded in 4.424490539000544s: None 2024-06-19T01:40:00.404595791Z [2024-06-19 01:40:00,403: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8f4bc511-c537-45ba-b6d5-4eb03068ff7d] received 2024-06-19T01:40:00.415952855Z [2024-06-19 01:40:00,414: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f02a4059-3a91-47ab-bbc0-c1a3b1aa4b60] received 2024-06-19T01:40:00.419310902Z [2024-06-19 01:40:00,419: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dc29df9f-6cc9-4f66-a2ba-09f8bbdfe3e9] received 2024-06-19T01:40:00.433548172Z [2024-06-19 01:40:00,433: INFO/ForkPoolWorker-1] [dc29df9f-6cc9-4f66-a2ba-09f8bbdfe3e9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T01:40:00.434425170Z [2024-06-19 01:40:00,434: INFO/ForkPoolWorker-16] [f02a4059-3a91-47ab-bbc0-c1a3b1aa4b60] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-19T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-19T01:40:00.435468075Z [2024-06-19 01:40:00,435: INFO/ForkPoolWorker-15] [8f4bc511-c537-45ba-b6d5-4eb03068ff7d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-19T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T01:40:00.439405125Z [2024-06-19 01:40:00,438: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6ec5b24b-3f27-4655-a713-7b1c7433eb77] received 2024-06-19T01:40:00.442591031Z [2024-06-19 01:40:00,442: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c6ee23d8-ec77-4682-9789-a539e6a28741] received 2024-06-19T01:40:00.456672761Z [2024-06-19 01:40:00,456: INFO/ForkPoolWorker-3] [c6ee23d8-ec77-4682-9789-a539e6a28741] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T01:40:00.459422815Z [2024-06-19 01:40:00,459: INFO/ForkPoolWorker-2] [6ec5b24b-3f27-4655-a713-7b1c7433eb77] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T01:40:00.908393569Z [2024-06-19 01:40:00,904: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T01:40:00.915302011Z [2024-06-19 01:40:00,905: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T01:40:01.036833086Z [2024-06-19 01:40:01,030: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T01:40:01.127158087Z [2024-06-19 01:40:01,119: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T01:40:01.164007849Z [2024-06-19 01:40:01,160: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-19T01:40:01.228749440Z [2024-06-19 01:40:01,228: INFO/ForkPoolWorker-1] Getting SDNC list 2024-06-19T01:40:01.234082795Z [2024-06-19 01:40:01,233: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:40:01.283436568Z [2024-06-19 01:40:01,283: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T01:40:01.285956223Z [2024-06-19 01:40:01,285: INFO/ForkPoolWorker-1] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T01:40:01.287194741Z [2024-06-19 01:40:01,286: INFO/ForkPoolWorker-1] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T01:40:01.288468951Z [2024-06-19 01:40:01,288: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-06-19T01:40:01.290476148Z [2024-06-19 01:40:01,290: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T01:40:01.397800004Z [2024-06-19 01:40:01,397: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:40:01.472065875Z [2024-06-19 01:40:01,471: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:40:02.090459117Z [2024-06-19 01:40:02,090: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[dc29df9f-6cc9-4f66-a2ba-09f8bbdfe3e9] succeeded in 1.6677701039989188s: None 2024-06-19T01:40:02.303244986Z [2024-06-19 01:40:02,302: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f02a4059-3a91-47ab-bbc0-c1a3b1aa4b60] succeeded in 1.884008389999508s: None 2024-06-19T01:40:02.531474621Z [2024-06-19 01:40:02,531: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T01:40:02.535162671Z [2024-06-19 01:40:02,534: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:40:02.557542628Z [2024-06-19 01:40:02,557: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T01:40:02.559026021Z [2024-06-19 01:40:02,558: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:40:02.559230514Z [2024-06-19 01:40:02,559: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:40:02.559535703Z [2024-06-19 01:40:02,559: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:40:02.559931711Z [2024-06-19 01:40:02,559: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T01:40:02.560306585Z [2024-06-19 01:40:02,560: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T01:40:02.560546469Z [2024-06-19 01:40:02,560: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:40:02.671163326Z [2024-06-19 01:40:02,670: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:40:02.843348537Z [2024-06-19 01:40:02,842: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-19T01:40:02.847097039Z [2024-06-19 01:40:02,846: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:40:02.872656785Z [2024-06-19 01:40:02,872: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T01:40:02.874292104Z [2024-06-19 01:40:02,874: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:40:02.874511518Z [2024-06-19 01:40:02,874: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:40:02.874773379Z [2024-06-19 01:40:02,874: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:40:02.874945106Z [2024-06-19 01:40:02,874: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-19T01:40:02.875310370Z [2024-06-19 01:40:02,875: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-06-19T01:40:02.875497058Z [2024-06-19 01:40:02,875: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:40:02.938381717Z [2024-06-19 01:40:02,937: INFO/ForkPoolWorker-3] Getting VIM list 2024-06-19T01:40:02.947932551Z [2024-06-19 01:40:02,947: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:40:02.962606192Z [2024-06-19 01:40:02,962: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:40:02.977014128Z [2024-06-19 01:40:02,976: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-06-19T01:40:02.978556891Z [2024-06-19 01:40:02,978: INFO/ForkPoolWorker-3] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:40:02.978704815Z [2024-06-19 01:40:02,978: INFO/ForkPoolWorker-3] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:40:02.978917499Z [2024-06-19 01:40:02,978: INFO/ForkPoolWorker-3] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:40:02.978983787Z [2024-06-19 01:40:02,978: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-06-19T01:40:02.979218553Z [2024-06-19 01:40:02,979: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T01:40:02.979275611Z [2024-06-19 01:40:02,979: INFO/ForkPoolWorker-3] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:40:03.071197399Z [2024-06-19 01:40:03,070: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:40:03.314237333Z [2024-06-19 01:40:03,313: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8f4bc511-c537-45ba-b6d5-4eb03068ff7d] succeeded in 2.9036981709996326s: None 2024-06-19T01:40:03.346322855Z [2024-06-19 01:40:03,346: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6f53f0ac-b24e-4ac7-90e7-b66925210183] received 2024-06-19T01:40:03.356113832Z [2024-06-19 01:40:03,355: INFO/ForkPoolWorker-15] [6f53f0ac-b24e-4ac7-90e7-b66925210183] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'split_metrics', 'scheduled__2024-06-19T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T01:40:03.707335313Z [2024-06-19 01:40:03,704: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T01:40:04.901639542Z [2024-06-19 01:40:04,901: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[6ec5b24b-3f27-4655-a713-7b1c7433eb77] succeeded in 4.459187269001632s: None 2024-06-19T01:40:04.911972529Z [2024-06-19 01:40:04,911: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[c6ee23d8-ec77-4682-9789-a539e6a28741] succeeded in 4.466340802999184s: None 2024-06-19T01:40:04.966275130Z [2024-06-19 01:40:04,965: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T01:40:04.969478183Z [2024-06-19 01:40:04,969: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:40:04.995201245Z [2024-06-19 01:40:04,994: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T01:40:04.997797390Z [2024-06-19 01:40:04,997: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:40:04.998013636Z [2024-06-19 01:40:04,997: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:40:04.998298152Z [2024-06-19 01:40:04,997: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:40:04.998459215Z [2024-06-19 01:40:04,998: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T01:40:04.999042569Z [2024-06-19 01:40:04,998: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T01:40:04.999271038Z [2024-06-19 01:40:04,999: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:40:05.082684292Z [2024-06-19 01:40:05,082: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:40:05.752877043Z [2024-06-19 01:40:05,752: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6f53f0ac-b24e-4ac7-90e7-b66925210183] succeeded in 2.404599325000163s: None 2024-06-19T01:40:06.537501671Z [2024-06-19 01:40:06,537: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[34d1d6f2-9740-4205-ac68-9370c2593422] received 2024-06-19T01:40:06.545889600Z [2024-06-19 01:40:06,545: INFO/ForkPoolWorker-15] [34d1d6f2-9740-4205-ac68-9370c2593422] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'collect_metrics', 'scheduled__2024-06-19T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-19T01:40:06.812120623Z [2024-06-19 01:40:06,809: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T01:40:07.955786152Z [2024-06-19 01:40:07,954: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T01:40:07.959771020Z [2024-06-19 01:40:07,957: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:40:07.972553647Z [2024-06-19 01:40:07,972: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T01:40:07.975784804Z [2024-06-19 01:40:07,973: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:40:07.975796766Z [2024-06-19 01:40:07,973: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:40:07.975800933Z [2024-06-19 01:40:07,973: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:40:07.975804897Z [2024-06-19 01:40:07,973: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T01:40:07.975808108Z [2024-06-19 01:40:07,973: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T01:40:07.975811363Z [2024-06-19 01:40:07,973: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:40:08.072229847Z [2024-06-19 01:40:08,071: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:40:08.678894459Z [2024-06-19 01:40:08,678: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[34d1d6f2-9740-4205-ac68-9370c2593422] succeeded in 2.139239168998756s: None 2024-06-19T01:40:08.916155913Z [2024-06-19 01:40:08,915: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5d075ce3-eb0f-417a-8001-1f914afca04b] received 2024-06-19T01:40:08.926104555Z [2024-06-19 01:40:08,925: INFO/ForkPoolWorker-15] [5d075ce3-eb0f-417a-8001-1f914afca04b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'send_prometheus', 'scheduled__2024-06-19T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T01:40:09.267259168Z [2024-06-19 01:40:09,263: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T01:40:10.327146480Z [2024-06-19 01:40:10,326: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T01:40:10.330334244Z [2024-06-19 01:40:10,329: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:40:10.356612604Z [2024-06-19 01:40:10,356: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T01:40:10.358930362Z [2024-06-19 01:40:10,358: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:40:10.359043830Z [2024-06-19 01:40:10,358: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:40:10.359348834Z [2024-06-19 01:40:10,358: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:40:10.359497261Z [2024-06-19 01:40:10,359: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T01:40:10.360034537Z [2024-06-19 01:40:10,359: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T01:40:10.360153173Z [2024-06-19 01:40:10,359: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:40:10.479851218Z [2024-06-19 01:40:10,479: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:40:11.092334669Z [2024-06-19 01:40:11,091: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5d075ce3-eb0f-417a-8001-1f914afca04b] succeeded in 2.1741194130008807s: None 2024-06-19T01:41:00.475480241Z [2024-06-19 01:41:00,475: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[583ee8cc-c4ea-4ccc-9b63-8fcc9bc2e35a] received 2024-06-19T01:41:00.481016298Z [2024-06-19 01:41:00,480: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6a668b7d-eab7-4e05-8ddc-1938bf8f92a9] received 2024-06-19T01:41:00.484274231Z [2024-06-19 01:41:00,484: INFO/ForkPoolWorker-15] [583ee8cc-c4ea-4ccc-9b63-8fcc9bc2e35a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T01:41:00.485958189Z [2024-06-19 01:41:00,485: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2c2ed074-ee40-4c62-a557-d918df237bc4] received 2024-06-19T01:41:00.496518059Z [2024-06-19 01:41:00,494: INFO/ForkPoolWorker-16] [6a668b7d-eab7-4e05-8ddc-1938bf8f92a9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T01:41:00.506379910Z [2024-06-19 01:41:00,506: INFO/ForkPoolWorker-1] [2c2ed074-ee40-4c62-a557-d918df237bc4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T01:41:00.819019818Z [2024-06-19 01:41:00,815: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T01:41:00.820032498Z [2024-06-19 01:41:00,817: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T01:41:00.861421049Z [2024-06-19 01:41:00,854: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T01:41:01.034461008Z [2024-06-19 01:41:01,034: INFO/ForkPoolWorker-16] Getting SDNC list 2024-06-19T01:41:01.038351536Z [2024-06-19 01:41:01,037: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:41:01.062989226Z [2024-06-19 01:41:01,062: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T01:41:01.065004111Z [2024-06-19 01:41:01,064: INFO/ForkPoolWorker-16] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T01:41:01.065248632Z [2024-06-19 01:41:01,064: INFO/ForkPoolWorker-16] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T01:41:01.065453844Z [2024-06-19 01:41:01,065: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-06-19T01:41:01.065981844Z [2024-06-19 01:41:01,065: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T01:41:01.152559749Z [2024-06-19 01:41:01,152: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:41:01.730208991Z [2024-06-19 01:41:01,729: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6a668b7d-eab7-4e05-8ddc-1938bf8f92a9] succeeded in 1.2448161379998055s: None 2024-06-19T01:41:01.910079824Z [2024-06-19 01:41:01,909: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T01:41:01.913066192Z [2024-06-19 01:41:01,912: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:41:01.938857566Z [2024-06-19 01:41:01,938: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T01:41:01.940431228Z [2024-06-19 01:41:01,940: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:41:01.940450232Z [2024-06-19 01:41:01,940: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:41:01.940597042Z [2024-06-19 01:41:01,940: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:41:01.940671952Z [2024-06-19 01:41:01,940: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T01:41:01.941208197Z [2024-06-19 01:41:01,941: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T01:41:01.941283402Z [2024-06-19 01:41:01,941: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:41:01.988300650Z [2024-06-19 01:41:01,987: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T01:41:01.991496237Z [2024-06-19 01:41:01,991: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:41:02.009761675Z [2024-06-19 01:41:02,009: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T01:41:02.011383102Z [2024-06-19 01:41:02,011: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:41:02.011441008Z [2024-06-19 01:41:02,011: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:41:02.011588125Z [2024-06-19 01:41:02,011: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:41:02.011677164Z [2024-06-19 01:41:02,011: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T01:41:02.012016617Z [2024-06-19 01:41:02,011: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-06-19T01:41:02.012102975Z [2024-06-19 01:41:02,012: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:41:02.022297535Z [2024-06-19 01:41:02,022: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:41:02.123228322Z [2024-06-19 01:41:02,122: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:41:03.715252706Z [2024-06-19 01:41:03,714: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2c2ed074-ee40-4c62-a557-d918df237bc4] succeeded in 3.225272497998958s: None 2024-06-19T01:41:04.303297550Z [2024-06-19 01:41:04,302: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[583ee8cc-c4ea-4ccc-9b63-8fcc9bc2e35a] succeeded in 3.8245418280002923s: None 2024-06-19T01:42:01.302731204Z [2024-06-19 01:42:01,302: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7d3457cd-cac3-472d-b0fd-b084c69ff990] received 2024-06-19T01:42:01.305939753Z [2024-06-19 01:42:01,305: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f6d5f0b6-6003-4f91-94c4-11e32f82658f] received 2024-06-19T01:42:01.318367367Z [2024-06-19 01:42:01,318: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ba6ce21d-3466-44ad-a4ce-7f25dff686c9] received 2024-06-19T01:42:01.318414900Z [2024-06-19 01:42:01,317: INFO/ForkPoolWorker-16] [f6d5f0b6-6003-4f91-94c4-11e32f82658f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T01:42:01.318965082Z [2024-06-19 01:42:01,318: INFO/ForkPoolWorker-15] [7d3457cd-cac3-472d-b0fd-b084c69ff990] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-19T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-19T01:42:01.320494222Z [2024-06-19 01:42:01,320: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0be4b874-4b6e-4dab-89cd-b9ddf396a8b9] received 2024-06-19T01:42:01.341276606Z [2024-06-19 01:42:01,340: INFO/ForkPoolWorker-1] [ba6ce21d-3466-44ad-a4ce-7f25dff686c9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T01:42:01.342490001Z [2024-06-19 01:42:01,341: INFO/ForkPoolWorker-2] [0be4b874-4b6e-4dab-89cd-b9ddf396a8b9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T01:42:01.673836510Z [2024-06-19 01:42:01,669: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-19T01:42:01.674783993Z [2024-06-19 01:42:01,670: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T01:42:01.688464988Z [2024-06-19 01:42:01,683: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T01:42:01.734193592Z [2024-06-19 01:42:01,727: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T01:42:01.864795229Z [2024-06-19 01:42:01,864: INFO/ForkPoolWorker-2] Getting SDNC list 2024-06-19T01:42:01.869171664Z [2024-06-19 01:42:01,868: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:42:01.926524103Z [2024-06-19 01:42:01,926: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T01:42:01.928022551Z [2024-06-19 01:42:01,927: INFO/ForkPoolWorker-2] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T01:42:01.928238010Z [2024-06-19 01:42:01,927: INFO/ForkPoolWorker-2] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T01:42:01.928375856Z [2024-06-19 01:42:01,928: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-06-19T01:42:01.928722597Z [2024-06-19 01:42:01,928: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T01:42:01.987401954Z [2024-06-19 01:42:01,987: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:42:02.079703666Z [2024-06-19 01:42:02,079: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:42:02.729897668Z [2024-06-19 01:42:02,729: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7d3457cd-cac3-472d-b0fd-b084c69ff990] succeeded in 1.422790291999263s: None 2024-06-19T01:42:02.812353350Z [2024-06-19 01:42:02,811: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[0be4b874-4b6e-4dab-89cd-b9ddf396a8b9] succeeded in 1.4890250120006385s: None 2024-06-19T01:42:03.145996853Z [2024-06-19 01:42:03,145: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T01:42:03.149405978Z [2024-06-19 01:42:03,149: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:42:03.169219876Z [2024-06-19 01:42:03,168: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T01:42:03.170528314Z [2024-06-19 01:42:03,170: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:42:03.170549382Z [2024-06-19 01:42:03,170: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:42:03.170795749Z [2024-06-19 01:42:03,170: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:42:03.170910245Z [2024-06-19 01:42:03,170: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T01:42:03.171248126Z [2024-06-19 01:42:03,171: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T01:42:03.171747021Z [2024-06-19 01:42:03,171: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:42:03.271044876Z [2024-06-19 01:42:03,270: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:42:03.338264054Z [2024-06-19 01:42:03,337: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T01:42:03.341530250Z [2024-06-19 01:42:03,341: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:42:03.363605876Z [2024-06-19 01:42:03,363: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T01:42:03.365039374Z [2024-06-19 01:42:03,364: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:42:03.365056768Z [2024-06-19 01:42:03,364: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:42:03.365187634Z [2024-06-19 01:42:03,365: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:42:03.365240359Z [2024-06-19 01:42:03,365: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T01:42:03.365492101Z [2024-06-19 01:42:03,365: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-19T01:42:03.365557384Z [2024-06-19 01:42:03,365: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:42:03.461492149Z [2024-06-19 01:42:03,461: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:42:04.954854451Z [2024-06-19 01:42:04,954: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ba6ce21d-3466-44ad-a4ce-7f25dff686c9] succeeded in 3.6330978570003936s: None 2024-06-19T01:42:05.739263598Z [2024-06-19 01:42:05,738: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f6d5f0b6-6003-4f91-94c4-11e32f82658f] succeeded in 4.430041150000761s: None 2024-06-19T01:43:00.438823741Z [2024-06-19 01:43:00,438: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bc738bbd-b4f0-4d44-a5ee-27c77ed5c5bc] received 2024-06-19T01:43:00.445733250Z [2024-06-19 01:43:00,444: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[de461219-c8a9-4f92-ad9f-eb2fbeb770b0] received 2024-06-19T01:43:00.448297131Z [2024-06-19 01:43:00,448: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c232829c-2305-45b8-893d-8026fe8cb392] received 2024-06-19T01:43:00.449152191Z [2024-06-19 01:43:00,448: INFO/ForkPoolWorker-15] [bc738bbd-b4f0-4d44-a5ee-27c77ed5c5bc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T01:43:00.470072117Z [2024-06-19 01:43:00,469: INFO/ForkPoolWorker-16] [de461219-c8a9-4f92-ad9f-eb2fbeb770b0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T01:43:00.470565866Z [2024-06-19 01:43:00,470: INFO/ForkPoolWorker-1] [c232829c-2305-45b8-893d-8026fe8cb392] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T01:43:00.787678491Z [2024-06-19 01:43:00,783: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T01:43:00.809003697Z [2024-06-19 01:43:00,802: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T01:43:00.925578168Z [2024-06-19 01:43:00,922: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T01:43:01.127821707Z [2024-06-19 01:43:01,127: INFO/ForkPoolWorker-1] Getting SDNC list 2024-06-19T01:43:01.131787945Z [2024-06-19 01:43:01,131: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:43:01.169788536Z [2024-06-19 01:43:01,169: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T01:43:01.171214508Z [2024-06-19 01:43:01,170: INFO/ForkPoolWorker-1] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T01:43:01.171456239Z [2024-06-19 01:43:01,171: INFO/ForkPoolWorker-1] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T01:43:01.171622259Z [2024-06-19 01:43:01,171: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-06-19T01:43:01.172013459Z [2024-06-19 01:43:01,171: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T01:43:01.279090717Z [2024-06-19 01:43:01,278: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:43:01.893274537Z [2024-06-19 01:43:01,892: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c232829c-2305-45b8-893d-8026fe8cb392] succeeded in 1.4399447710002278s: None 2024-06-19T01:43:01.953791981Z [2024-06-19 01:43:01,953: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T01:43:01.956994955Z [2024-06-19 01:43:01,956: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:43:01.997327658Z [2024-06-19 01:43:01,997: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T01:43:02.006686426Z [2024-06-19 01:43:02,006: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:43:02.008081071Z [2024-06-19 01:43:02,007: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:43:02.008330599Z [2024-06-19 01:43:02,008: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:43:02.008437609Z [2024-06-19 01:43:02,008: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T01:43:02.008776105Z [2024-06-19 01:43:02,008: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-06-19T01:43:02.009244721Z [2024-06-19 01:43:02,008: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:43:02.112982846Z [2024-06-19 01:43:02,112: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:43:02.115415993Z [2024-06-19 01:43:02,115: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T01:43:02.118795717Z [2024-06-19 01:43:02,118: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:43:02.153328913Z [2024-06-19 01:43:02,153: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T01:43:02.158145890Z [2024-06-19 01:43:02,157: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:43:02.158165061Z [2024-06-19 01:43:02,158: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:43:02.158399285Z [2024-06-19 01:43:02,158: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:43:02.158608609Z [2024-06-19 01:43:02,158: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T01:43:02.158886609Z [2024-06-19 01:43:02,158: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T01:43:02.158895933Z [2024-06-19 01:43:02,158: INFO/ForkPoolWorker-16] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:43:02.313018562Z [2024-06-19 01:43:02,312: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:43:03.859739472Z [2024-06-19 01:43:03,859: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[de461219-c8a9-4f92-ad9f-eb2fbeb770b0] succeeded in 3.4082623419999436s: None 2024-06-19T01:43:04.067910888Z [2024-06-19 01:43:04,067: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bc738bbd-b4f0-4d44-a5ee-27c77ed5c5bc] succeeded in 3.6265012299991213s: None 2024-06-19T01:44:01.172575358Z [2024-06-19 01:44:01,172: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6ddc9946-5fbe-46ff-aafa-d04d1995250e] received 2024-06-19T01:44:01.177421892Z [2024-06-19 01:44:01,177: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b2b916e0-a158-448e-8a35-6baa3188a4ec] received 2024-06-19T01:44:01.181453790Z [2024-06-19 01:44:01,181: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[580f2389-f8ba-4853-86da-40b78742f031] received 2024-06-19T01:44:01.182706367Z [2024-06-19 01:44:01,182: INFO/ForkPoolWorker-15] [6ddc9946-5fbe-46ff-aafa-d04d1995250e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-19T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-19T01:44:01.185013179Z [2024-06-19 01:44:01,184: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3c884605-1415-43e5-bdb7-dff5a48fde7c] received 2024-06-19T01:44:01.201296255Z [2024-06-19 01:44:01,200: INFO/ForkPoolWorker-1] [580f2389-f8ba-4853-86da-40b78742f031] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T01:44:01.204212680Z [2024-06-19 01:44:01,203: INFO/ForkPoolWorker-16] [b2b916e0-a158-448e-8a35-6baa3188a4ec] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T01:44:01.209914717Z [2024-06-19 01:44:01,209: INFO/ForkPoolWorker-2] [3c884605-1415-43e5-bdb7-dff5a48fde7c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T01:44:01.578344914Z [2024-06-19 01:44:01,575: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-19T01:44:01.594921205Z [2024-06-19 01:44:01,590: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T01:44:01.622836998Z [2024-06-19 01:44:01,619: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T01:44:01.776278504Z [2024-06-19 01:44:01,775: INFO/ForkPoolWorker-2] Getting SDNC list 2024-06-19T01:44:01.780848297Z [2024-06-19 01:44:01,780: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:44:01.790559062Z [2024-06-19 01:44:01,785: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T01:44:01.800957052Z [2024-06-19 01:44:01,800: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T01:44:01.805227819Z [2024-06-19 01:44:01,804: INFO/ForkPoolWorker-2] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T01:44:01.805561211Z [2024-06-19 01:44:01,805: INFO/ForkPoolWorker-2] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T01:44:01.805713573Z [2024-06-19 01:44:01,805: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-06-19T01:44:01.805967133Z [2024-06-19 01:44:01,805: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T01:44:02.000686085Z [2024-06-19 01:44:02,000: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:44:02.035064110Z [2024-06-19 01:44:02,034: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:44:03.052437891Z [2024-06-19 01:44:03,052: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6ddc9946-5fbe-46ff-aafa-d04d1995250e] succeeded in 1.8772607129994867s: None 2024-06-19T01:44:03.073641466Z [2024-06-19 01:44:03,072: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[3c884605-1415-43e5-bdb7-dff5a48fde7c] succeeded in 1.8761543299988261s: None 2024-06-19T01:44:03.377976257Z [2024-06-19 01:44:03,377: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T01:44:03.381575163Z [2024-06-19 01:44:03,381: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:44:03.405160556Z [2024-06-19 01:44:03,404: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T01:44:03.406260849Z [2024-06-19 01:44:03,406: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:44:03.406330507Z [2024-06-19 01:44:03,406: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:44:03.406501126Z [2024-06-19 01:44:03,406: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:44:03.406557054Z [2024-06-19 01:44:03,406: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T01:44:03.406787171Z [2024-06-19 01:44:03,406: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T01:44:03.406871963Z [2024-06-19 01:44:03,406: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:44:03.445583888Z [2024-06-19 01:44:03,445: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T01:44:03.448713010Z [2024-06-19 01:44:03,448: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:44:03.480485687Z [2024-06-19 01:44:03,480: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T01:44:03.481983544Z [2024-06-19 01:44:03,481: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:44:03.482025128Z [2024-06-19 01:44:03,481: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:44:03.482132265Z [2024-06-19 01:44:03,481: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:44:03.482163868Z [2024-06-19 01:44:03,482: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T01:44:03.482350611Z [2024-06-19 01:44:03,482: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-19T01:44:03.482391116Z [2024-06-19 01:44:03,482: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:44:03.489070363Z [2024-06-19 01:44:03,488: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:44:03.582567117Z [2024-06-19 01:44:03,582: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:44:05.316348020Z [2024-06-19 01:44:05,315: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[580f2389-f8ba-4853-86da-40b78742f031] succeeded in 4.12839435099886s: None 2024-06-19T01:44:05.555462522Z [2024-06-19 01:44:05,554: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b2b916e0-a158-448e-8a35-6baa3188a4ec] succeeded in 4.372710207000637s: None 2024-06-19T01:45:01.033974699Z [2024-06-19 01:45:01,033: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cc771636-553e-40c9-ad2c-dbe3f3be99ae] received 2024-06-19T01:45:01.048522608Z [2024-06-19 01:45:01,048: INFO/ForkPoolWorker-15] [cc771636-553e-40c9-ad2c-dbe3f3be99ae] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-19T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T01:45:01.050861893Z [2024-06-19 01:45:01,050: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7fe2284d-f59d-4d48-b44c-dc981819c904] received 2024-06-19T01:45:01.057853309Z [2024-06-19 01:45:01,057: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[26b9495f-a295-4fe8-8b43-eceb021a5f85] received 2024-06-19T01:45:01.063435627Z [2024-06-19 01:45:01,063: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fcc0188b-7f28-4c4d-ba80-6fc097dc3bcb] received 2024-06-19T01:45:01.069953880Z [2024-06-19 01:45:01,069: INFO/ForkPoolWorker-1] [26b9495f-a295-4fe8-8b43-eceb021a5f85] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T01:45:01.070683804Z [2024-06-19 01:45:01,069: INFO/ForkPoolWorker-16] [7fe2284d-f59d-4d48-b44c-dc981819c904] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T01:45:01.117139195Z [2024-06-19 01:45:01,116: INFO/ForkPoolWorker-2] [fcc0188b-7f28-4c4d-ba80-6fc097dc3bcb] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T01:45:01.445654041Z [2024-06-19 01:45:01,440: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T01:45:01.460895153Z [2024-06-19 01:45:01,456: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T01:45:01.645526127Z [2024-06-19 01:45:01,640: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T01:45:01.714678789Z [2024-06-19 01:45:01,709: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T01:45:01.895387963Z [2024-06-19 01:45:01,895: INFO/ForkPoolWorker-2] Getting SDNC list 2024-06-19T01:45:01.908219537Z [2024-06-19 01:45:01,903: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:45:01.969419378Z [2024-06-19 01:45:01,969: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T01:45:01.982177126Z [2024-06-19 01:45:01,981: INFO/ForkPoolWorker-2] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T01:45:01.982358421Z [2024-06-19 01:45:01,982: INFO/ForkPoolWorker-2] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T01:45:01.982411400Z [2024-06-19 01:45:01,982: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-06-19T01:45:01.982608232Z [2024-06-19 01:45:01,982: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T01:45:02.183842209Z [2024-06-19 01:45:02,183: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:45:03.118349356Z [2024-06-19 01:45:03,117: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[fcc0188b-7f28-4c4d-ba80-6fc097dc3bcb] succeeded in 2.0507236149987875s: None 2024-06-19T01:45:03.355712386Z [2024-06-19 01:45:03,355: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T01:45:03.359312528Z [2024-06-19 01:45:03,358: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:45:03.426566060Z [2024-06-19 01:45:03,426: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T01:45:03.429825073Z [2024-06-19 01:45:03,429: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:45:03.452548107Z [2024-06-19 01:45:03,452: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T01:45:03.453333176Z [2024-06-19 01:45:03,453: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T01:45:03.454244236Z [2024-06-19 01:45:03,454: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:45:03.454264435Z [2024-06-19 01:45:03,454: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:45:03.454424088Z [2024-06-19 01:45:03,454: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:45:03.454469236Z [2024-06-19 01:45:03,454: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T01:45:03.454712874Z [2024-06-19 01:45:03,454: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T01:45:03.454754574Z [2024-06-19 01:45:03,454: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:45:03.461025662Z [2024-06-19 01:45:03,460: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:45:03.461042871Z [2024-06-19 01:45:03,460: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:45:03.461211928Z [2024-06-19 01:45:03,461: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:45:03.461253429Z [2024-06-19 01:45:03,461: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T01:45:03.461512760Z [2024-06-19 01:45:03,461: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T01:45:03.461562725Z [2024-06-19 01:45:03,461: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:45:03.546078153Z [2024-06-19 01:45:03,545: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:45:03.563469198Z [2024-06-19 01:45:03,563: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:45:03.939785461Z [2024-06-19 01:45:03,938: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T01:45:03.942253203Z [2024-06-19 01:45:03,941: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:45:03.998651986Z [2024-06-19 01:45:03,996: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T01:45:03.998674204Z [2024-06-19 01:45:03,997: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:45:03.998679552Z [2024-06-19 01:45:03,997: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:45:03.998684638Z [2024-06-19 01:45:03,998: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:45:03.998689918Z [2024-06-19 01:45:03,998: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T01:45:03.998694774Z [2024-06-19 01:45:03,998: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-19T01:45:03.998699493Z [2024-06-19 01:45:03,998: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:45:04.159011442Z [2024-06-19 01:45:04,158: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:45:04.335926177Z [2024-06-19 01:45:04,335: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cc771636-553e-40c9-ad2c-dbe3f3be99ae] succeeded in 3.297650878999775s: None 2024-06-19T01:45:04.640222914Z [2024-06-19 01:45:04,639: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aaac2ffe-5db8-4fa4-9532-e36d379afaac] received 2024-06-19T01:45:04.651036792Z [2024-06-19 01:45:04,650: INFO/ForkPoolWorker-15] [aaac2ffe-5db8-4fa4-9532-e36d379afaac] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'split_metrics', 'scheduled__2024-06-19T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T01:45:04.948436222Z [2024-06-19 01:45:04,945: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T01:45:05.471339943Z [2024-06-19 01:45:05,470: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[26b9495f-a295-4fe8-8b43-eceb021a5f85] succeeded in 4.411446721000175s: None 2024-06-19T01:45:06.038334119Z [2024-06-19 01:45:06,037: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7fe2284d-f59d-4d48-b44c-dc981819c904] succeeded in 4.98237739400065s: None 2024-06-19T01:45:06.299407830Z [2024-06-19 01:45:06,299: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T01:45:06.302635659Z [2024-06-19 01:45:06,302: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:45:06.346339639Z [2024-06-19 01:45:06,346: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T01:45:06.347509895Z [2024-06-19 01:45:06,347: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:45:06.347583252Z [2024-06-19 01:45:06,347: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:45:06.347796924Z [2024-06-19 01:45:06,347: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:45:06.347850816Z [2024-06-19 01:45:06,347: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T01:45:06.348134274Z [2024-06-19 01:45:06,347: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T01:45:06.348183253Z [2024-06-19 01:45:06,348: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:45:06.417903097Z [2024-06-19 01:45:06,417: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:45:07.102581581Z [2024-06-19 01:45:07,102: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7ac8cd80-f5a4-4a15-bb4d-5ff2ab955be8] received 2024-06-19T01:45:07.113583424Z [2024-06-19 01:45:07,113: INFO/ForkPoolWorker-16] [7ac8cd80-f5a4-4a15-bb4d-5ff2ab955be8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'collect_metrics', 'scheduled__2024-06-19T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-19T01:45:07.134058835Z [2024-06-19 01:45:07,132: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[aaac2ffe-5db8-4fa4-9532-e36d379afaac] succeeded in 2.4885438669989526s: None 2024-06-19T01:45:07.411738665Z [2024-06-19 01:45:07,407: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T01:45:08.636289123Z [2024-06-19 01:45:08,635: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T01:45:08.639611192Z [2024-06-19 01:45:08,639: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:45:08.682005216Z [2024-06-19 01:45:08,681: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T01:45:08.683463850Z [2024-06-19 01:45:08,683: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:45:08.683803413Z [2024-06-19 01:45:08,683: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:45:08.684218456Z [2024-06-19 01:45:08,683: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:45:08.684411748Z [2024-06-19 01:45:08,684: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T01:45:08.684817032Z [2024-06-19 01:45:08,684: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T01:45:08.684999794Z [2024-06-19 01:45:08,684: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:45:08.767661434Z [2024-06-19 01:45:08,767: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:45:09.359650732Z [2024-06-19 01:45:09,359: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7ac8cd80-f5a4-4a15-bb4d-5ff2ab955be8] succeeded in 2.254207090001728s: None 2024-06-19T01:45:09.467787274Z [2024-06-19 01:45:09,467: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5f311fd7-4f15-44f3-ac30-06bd776565ba] received 2024-06-19T01:45:09.474385411Z [2024-06-19 01:45:09,474: INFO/ForkPoolWorker-15] [5f311fd7-4f15-44f3-ac30-06bd776565ba] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'send_prometheus', 'scheduled__2024-06-19T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T01:45:09.763922494Z [2024-06-19 01:45:09,760: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T01:45:10.867794902Z [2024-06-19 01:45:10,867: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T01:45:10.871055691Z [2024-06-19 01:45:10,870: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:45:10.889181001Z [2024-06-19 01:45:10,888: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T01:45:10.890194893Z [2024-06-19 01:45:10,890: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:45:10.890210450Z [2024-06-19 01:45:10,890: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:45:10.890330616Z [2024-06-19 01:45:10,890: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:45:10.890409793Z [2024-06-19 01:45:10,890: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T01:45:10.890775140Z [2024-06-19 01:45:10,890: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T01:45:10.890899693Z [2024-06-19 01:45:10,890: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:45:10.961305381Z [2024-06-19 01:45:10,959: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:45:11.515057223Z [2024-06-19 01:45:11,514: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5f311fd7-4f15-44f3-ac30-06bd776565ba] succeeded in 2.045257045001563s: None 2024-06-19T01:46:00.866654642Z [2024-06-19 01:46:00,866: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9abc9071-5108-47a7-bfb4-7635c4bfdabe] received 2024-06-19T01:46:00.870408041Z [2024-06-19 01:46:00,870: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[820ba327-7522-4b16-8e6d-ba137f2e1fbc] received 2024-06-19T01:46:00.878008446Z [2024-06-19 01:46:00,877: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0237c7ca-9e6f-4a5b-b9f5-582f34b9a856] received 2024-06-19T01:46:00.884191745Z [2024-06-19 01:46:00,883: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fe3dc306-b61d-42f1-b2f5-a59bc499ca6f] received 2024-06-19T01:46:00.891413584Z [2024-06-19 01:46:00,891: INFO/ForkPoolWorker-1] [0237c7ca-9e6f-4a5b-b9f5-582f34b9a856] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T01:46:00.893504409Z [2024-06-19 01:46:00,893: INFO/ForkPoolWorker-15] [9abc9071-5108-47a7-bfb4-7635c4bfdabe] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-19T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-19T01:46:00.894313348Z [2024-06-19 01:46:00,894: INFO/ForkPoolWorker-16] [820ba327-7522-4b16-8e6d-ba137f2e1fbc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T01:46:00.898139310Z [2024-06-19 01:46:00,897: INFO/ForkPoolWorker-2] [fe3dc306-b61d-42f1-b2f5-a59bc499ca6f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T01:46:01.226220419Z [2024-06-19 01:46:01,222: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T01:46:01.242288946Z [2024-06-19 01:46:01,239: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T01:46:01.339381942Z [2024-06-19 01:46:01,335: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-19T01:46:01.350424225Z [2024-06-19 01:46:01,347: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T01:46:01.515372762Z [2024-06-19 01:46:01,514: INFO/ForkPoolWorker-2] Getting SDNC list 2024-06-19T01:46:01.519482405Z [2024-06-19 01:46:01,518: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:46:01.545996418Z [2024-06-19 01:46:01,545: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T01:46:01.547881610Z [2024-06-19 01:46:01,547: INFO/ForkPoolWorker-2] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T01:46:01.547978840Z [2024-06-19 01:46:01,547: INFO/ForkPoolWorker-2] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T01:46:01.548063472Z [2024-06-19 01:46:01,547: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-06-19T01:46:01.548240342Z [2024-06-19 01:46:01,548: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T01:46:01.680094364Z [2024-06-19 01:46:01,679: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:46:01.689354968Z [2024-06-19 01:46:01,689: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:46:02.408971517Z [2024-06-19 01:46:02,407: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[fe3dc306-b61d-42f1-b2f5-a59bc499ca6f] succeeded in 1.5181550850011263s: None 2024-06-19T01:46:02.413378180Z [2024-06-19 01:46:02,412: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9abc9071-5108-47a7-bfb4-7635c4bfdabe] succeeded in 1.5394416580002144s: None 2024-06-19T01:46:02.637882814Z [2024-06-19 01:46:02,637: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T01:46:02.641216762Z [2024-06-19 01:46:02,640: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:46:02.667102874Z [2024-06-19 01:46:02,666: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T01:46:02.668548580Z [2024-06-19 01:46:02,668: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:46:02.668700820Z [2024-06-19 01:46:02,668: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:46:02.668830574Z [2024-06-19 01:46:02,668: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:46:02.668888990Z [2024-06-19 01:46:02,668: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T01:46:02.669180826Z [2024-06-19 01:46:02,669: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-19T01:46:02.669197938Z [2024-06-19 01:46:02,669: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:46:02.782166929Z [2024-06-19 01:46:02,781: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:46:02.813821702Z [2024-06-19 01:46:02,813: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T01:46:02.817948983Z [2024-06-19 01:46:02,817: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:46:02.845778073Z [2024-06-19 01:46:02,845: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T01:46:02.847485067Z [2024-06-19 01:46:02,847: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:46:02.847613318Z [2024-06-19 01:46:02,847: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:46:02.847883047Z [2024-06-19 01:46:02,847: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:46:02.848057132Z [2024-06-19 01:46:02,847: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T01:46:02.848357856Z [2024-06-19 01:46:02,848: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T01:46:02.848462523Z [2024-06-19 01:46:02,848: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:46:02.953879278Z [2024-06-19 01:46:02,953: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:46:04.808650914Z [2024-06-19 01:46:04,807: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0237c7ca-9e6f-4a5b-b9f5-582f34b9a856] succeeded in 3.926255738000691s: None 2024-06-19T01:46:05.277642731Z [2024-06-19 01:46:05,275: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[820ba327-7522-4b16-8e6d-ba137f2e1fbc] succeeded in 4.402153434999491s: None 2024-06-19T01:47:00.417919737Z [2024-06-19 01:47:00,417: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ca915aa4-31f9-4b4e-abe8-1fb00b5ac924] received 2024-06-19T01:47:00.426249856Z [2024-06-19 01:47:00,425: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[97c7d69d-d251-404f-9714-a48c395a8e79] received 2024-06-19T01:47:00.432248899Z [2024-06-19 01:47:00,431: INFO/ForkPoolWorker-15] [ca915aa4-31f9-4b4e-abe8-1fb00b5ac924] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T01:47:00.438390879Z [2024-06-19 01:47:00,438: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4e52d7dc-5feb-4393-bf96-402fc7c1737c] received 2024-06-19T01:47:00.443402725Z [2024-06-19 01:47:00,443: INFO/ForkPoolWorker-16] [97c7d69d-d251-404f-9714-a48c395a8e79] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T01:47:00.462436136Z [2024-06-19 01:47:00,462: INFO/ForkPoolWorker-1] [4e52d7dc-5feb-4393-bf96-402fc7c1737c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T01:47:00.726466440Z [2024-06-19 01:47:00,723: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T01:47:00.728310989Z [2024-06-19 01:47:00,722: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T01:47:00.817134287Z [2024-06-19 01:47:00,812: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T01:47:00.997546089Z [2024-06-19 01:47:00,997: INFO/ForkPoolWorker-1] Getting SDNC list 2024-06-19T01:47:01.001848247Z [2024-06-19 01:47:01,001: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:47:01.035553923Z [2024-06-19 01:47:01,035: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T01:47:01.037707098Z [2024-06-19 01:47:01,037: INFO/ForkPoolWorker-1] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T01:47:01.037943722Z [2024-06-19 01:47:01,037: INFO/ForkPoolWorker-1] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T01:47:01.038084661Z [2024-06-19 01:47:01,037: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-06-19T01:47:01.038407308Z [2024-06-19 01:47:01,038: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T01:47:01.129199914Z [2024-06-19 01:47:01,128: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:47:01.738487816Z [2024-06-19 01:47:01,738: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4e52d7dc-5feb-4393-bf96-402fc7c1737c] succeeded in 1.2965117460007605s: None 2024-06-19T01:47:01.886150400Z [2024-06-19 01:47:01,885: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T01:47:01.893165428Z [2024-06-19 01:47:01,892: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:47:01.901617780Z [2024-06-19 01:47:01,900: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T01:47:01.904569927Z [2024-06-19 01:47:01,903: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:47:01.916511954Z [2024-06-19 01:47:01,916: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T01:47:01.918007329Z [2024-06-19 01:47:01,917: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:47:01.918075867Z [2024-06-19 01:47:01,917: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:47:01.918314960Z [2024-06-19 01:47:01,918: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:47:01.918321947Z [2024-06-19 01:47:01,918: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T01:47:01.918649847Z [2024-06-19 01:47:01,918: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-19T01:47:01.918719849Z [2024-06-19 01:47:01,918: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:47:01.933272607Z [2024-06-19 01:47:01,932: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T01:47:01.934785541Z [2024-06-19 01:47:01,934: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:47:01.934811619Z [2024-06-19 01:47:01,934: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:47:01.935049729Z [2024-06-19 01:47:01,934: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:47:01.935068726Z [2024-06-19 01:47:01,934: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T01:47:01.935384282Z [2024-06-19 01:47:01,935: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T01:47:01.935400136Z [2024-06-19 01:47:01,935: INFO/ForkPoolWorker-15] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:47:02.001589151Z [2024-06-19 01:47:02,001: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:47:02.017878056Z [2024-06-19 01:47:02,017: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:47:03.512942432Z [2024-06-19 01:47:03,512: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ca915aa4-31f9-4b4e-abe8-1fb00b5ac924] succeeded in 3.0933084320004127s: None 2024-06-19T01:47:03.899562275Z [2024-06-19 01:47:03,899: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[97c7d69d-d251-404f-9714-a48c395a8e79] succeeded in 3.4680011150012433s: None 2024-06-19T01:48:00.443296963Z [2024-06-19 01:48:00,442: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[005edf0e-08c1-471b-b25f-805c88bdca30] received 2024-06-19T01:48:00.450338172Z [2024-06-19 01:48:00,450: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6478fbb7-2b64-4fc5-a6ab-8180076fe0bf] received 2024-06-19T01:48:00.463438719Z [2024-06-19 01:48:00,463: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aefb1e48-fa87-429c-960a-0fc77de7aab0] received 2024-06-19T01:48:00.464935384Z [2024-06-19 01:48:00,464: INFO/ForkPoolWorker-16] [6478fbb7-2b64-4fc5-a6ab-8180076fe0bf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T01:48:00.466257780Z [2024-06-19 01:48:00,465: INFO/ForkPoolWorker-15] [005edf0e-08c1-471b-b25f-805c88bdca30] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-19T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-19T01:48:00.466666959Z [2024-06-19 01:48:00,466: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[72e0785b-520d-4c7f-a3f0-c222f276a2a3] received 2024-06-19T01:48:00.484388050Z [2024-06-19 01:48:00,484: INFO/ForkPoolWorker-1] [aefb1e48-fa87-429c-960a-0fc77de7aab0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T01:48:00.493393684Z [2024-06-19 01:48:00,493: INFO/ForkPoolWorker-2] [72e0785b-520d-4c7f-a3f0-c222f276a2a3] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T01:48:00.842404912Z [2024-06-19 01:48:00,837: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-19T01:48:00.857266301Z [2024-06-19 01:48:00,852: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T01:48:00.857334449Z [2024-06-19 01:48:00,853: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T01:48:00.936579061Z [2024-06-19 01:48:00,931: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T01:48:01.025416263Z [2024-06-19 01:48:01,024: INFO/ForkPoolWorker-2] Getting SDNC list 2024-06-19T01:48:01.029480244Z [2024-06-19 01:48:01,029: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:48:01.063544414Z [2024-06-19 01:48:01,063: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T01:48:01.065688005Z [2024-06-19 01:48:01,065: INFO/ForkPoolWorker-2] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T01:48:01.066152293Z [2024-06-19 01:48:01,065: INFO/ForkPoolWorker-2] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T01:48:01.066390063Z [2024-06-19 01:48:01,066: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-06-19T01:48:01.066873929Z [2024-06-19 01:48:01,066: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T01:48:01.131435116Z [2024-06-19 01:48:01,131: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:48:01.156097390Z [2024-06-19 01:48:01,155: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:48:01.707900121Z [2024-06-19 01:48:01,707: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[72e0785b-520d-4c7f-a3f0-c222f276a2a3] succeeded in 1.2375588969989622s: None 2024-06-19T01:48:01.829180688Z [2024-06-19 01:48:01,828: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[005edf0e-08c1-471b-b25f-805c88bdca30] succeeded in 1.3754597150000336s: None 2024-06-19T01:48:02.171429695Z [2024-06-19 01:48:02,171: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T01:48:02.178766168Z [2024-06-19 01:48:02,178: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:48:02.231883008Z [2024-06-19 01:48:02,220: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T01:48:02.231917872Z [2024-06-19 01:48:02,221: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:48:02.231931307Z [2024-06-19 01:48:02,221: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:48:02.231935983Z [2024-06-19 01:48:02,221: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:48:02.231940725Z [2024-06-19 01:48:02,221: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T01:48:02.231943831Z [2024-06-19 01:48:02,222: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-19T01:48:02.231947085Z [2024-06-19 01:48:02,222: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:48:02.320987160Z [2024-06-19 01:48:02,320: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:48:02.420700461Z [2024-06-19 01:48:02,420: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T01:48:02.424440420Z [2024-06-19 01:48:02,423: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:48:02.448217744Z [2024-06-19 01:48:02,447: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T01:48:02.449686510Z [2024-06-19 01:48:02,449: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:48:02.449827396Z [2024-06-19 01:48:02,449: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:48:02.450116179Z [2024-06-19 01:48:02,449: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:48:02.450291302Z [2024-06-19 01:48:02,450: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T01:48:02.450587645Z [2024-06-19 01:48:02,450: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T01:48:02.450749518Z [2024-06-19 01:48:02,450: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:48:02.541028626Z [2024-06-19 01:48:02,540: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:48:04.359249569Z [2024-06-19 01:48:04,358: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6478fbb7-2b64-4fc5-a6ab-8180076fe0bf] succeeded in 3.906095739999728s: None 2024-06-19T01:48:04.359585276Z [2024-06-19 01:48:04,359: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[aefb1e48-fa87-429c-960a-0fc77de7aab0] succeeded in 3.890606965000188s: None 2024-06-19T01:49:00.470845516Z [2024-06-19 01:49:00,470: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2c24c40c-cfdf-4088-9f2c-160c71f23243] received 2024-06-19T01:49:00.474734691Z [2024-06-19 01:49:00,474: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0c38d75d-ab2c-4c83-8d9b-9adf5535d309] received 2024-06-19T01:49:00.483906133Z [2024-06-19 01:49:00,483: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5f23a778-9d47-497d-9305-3e4080153411] received 2024-06-19T01:49:00.488790940Z [2024-06-19 01:49:00,488: INFO/ForkPoolWorker-15] [2c24c40c-cfdf-4088-9f2c-160c71f23243] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T01:49:00.490770149Z [2024-06-19 01:49:00,490: INFO/ForkPoolWorker-16] [0c38d75d-ab2c-4c83-8d9b-9adf5535d309] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T01:49:00.500417884Z [2024-06-19 01:49:00,499: INFO/ForkPoolWorker-1] [5f23a778-9d47-497d-9305-3e4080153411] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T01:49:00.801773654Z [2024-06-19 01:49:00,798: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T01:49:00.859132927Z [2024-06-19 01:49:00,855: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T01:49:00.921972252Z [2024-06-19 01:49:00,917: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T01:49:01.006169059Z [2024-06-19 01:49:01,005: INFO/ForkPoolWorker-1] Getting SDNC list 2024-06-19T01:49:01.010619331Z [2024-06-19 01:49:01,010: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:49:01.038615248Z [2024-06-19 01:49:01,038: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T01:49:01.039965936Z [2024-06-19 01:49:01,039: INFO/ForkPoolWorker-1] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T01:49:01.040222843Z [2024-06-19 01:49:01,040: INFO/ForkPoolWorker-1] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T01:49:01.040356285Z [2024-06-19 01:49:01,040: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-06-19T01:49:01.040585013Z [2024-06-19 01:49:01,040: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T01:49:01.144815578Z [2024-06-19 01:49:01,144: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:49:01.729091202Z [2024-06-19 01:49:01,728: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5f23a778-9d47-497d-9305-3e4080153411] succeeded in 1.2372195560001273s: None 2024-06-19T01:49:01.903383113Z [2024-06-19 01:49:01,903: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T01:49:01.907783861Z [2024-06-19 01:49:01,906: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:49:01.929994449Z [2024-06-19 01:49:01,929: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T01:49:01.933307353Z [2024-06-19 01:49:01,933: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:49:01.933325448Z [2024-06-19 01:49:01,933: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:49:01.933492187Z [2024-06-19 01:49:01,933: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:49:01.933519052Z [2024-06-19 01:49:01,933: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T01:49:01.934205044Z [2024-06-19 01:49:01,934: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T01:49:01.934224469Z [2024-06-19 01:49:01,934: INFO/ForkPoolWorker-16] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:49:02.016390755Z [2024-06-19 01:49:02,016: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:49:02.106888784Z [2024-06-19 01:49:02,106: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T01:49:02.110161767Z [2024-06-19 01:49:02,109: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:49:02.143103038Z [2024-06-19 01:49:02,142: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T01:49:02.144693061Z [2024-06-19 01:49:02,144: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:49:02.144710886Z [2024-06-19 01:49:02,144: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:49:02.144885801Z [2024-06-19 01:49:02,144: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:49:02.144910609Z [2024-06-19 01:49:02,144: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T01:49:02.145180332Z [2024-06-19 01:49:02,145: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-06-19T01:49:02.145250386Z [2024-06-19 01:49:02,145: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:49:02.294838044Z [2024-06-19 01:49:02,293: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:49:03.569004371Z [2024-06-19 01:49:03,568: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0c38d75d-ab2c-4c83-8d9b-9adf5535d309] succeeded in 3.091852416999245s: None 2024-06-19T01:49:04.189057503Z [2024-06-19 01:49:04,188: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2c24c40c-cfdf-4088-9f2c-160c71f23243] succeeded in 3.715781816001254s: None 2024-06-19T01:50:00.440788567Z [2024-06-19 01:50:00,439: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[efdf70fe-77a3-4f00-baf6-68e89c838628] received 2024-06-19T01:50:00.444979819Z [2024-06-19 01:50:00,444: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6ecf23c7-650b-47e1-95da-bef8603cc98e] received 2024-06-19T01:50:00.450919925Z [2024-06-19 01:50:00,450: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7a919396-3626-4e63-a5d2-d81db6456197] received 2024-06-19T01:50:00.453524842Z [2024-06-19 01:50:00,453: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f1399e8f-f9ae-470c-bc98-2d6d9167a30c] received 2024-06-19T01:50:00.458953331Z [2024-06-19 01:50:00,458: INFO/ForkPoolWorker-16] [6ecf23c7-650b-47e1-95da-bef8603cc98e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-19T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-19T01:50:00.464487264Z [2024-06-19 01:50:00,464: INFO/ForkPoolWorker-2] [f1399e8f-f9ae-470c-bc98-2d6d9167a30c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T01:50:00.465239707Z [2024-06-19 01:50:00,464: INFO/ForkPoolWorker-15] [efdf70fe-77a3-4f00-baf6-68e89c838628] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-19T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T01:50:00.465836877Z [2024-06-19 01:50:00,465: INFO/ForkPoolWorker-1] [7a919396-3626-4e63-a5d2-d81db6456197] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T01:50:00.473447864Z [2024-06-19 01:50:00,473: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2e0c2b98-a223-4f77-98be-20f7ae367965] received 2024-06-19T01:50:00.483407877Z [2024-06-19 01:50:00,483: INFO/ForkPoolWorker-3] [2e0c2b98-a223-4f77-98be-20f7ae367965] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T01:50:00.816217170Z [2024-06-19 01:50:00,810: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T01:50:00.845001640Z [2024-06-19 01:50:00,841: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T01:50:00.885278234Z [2024-06-19 01:50:00,880: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-19T01:50:00.986974912Z [2024-06-19 01:50:00,978: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T01:50:01.043154065Z [2024-06-19 01:50:01,039: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T01:50:01.156821345Z [2024-06-19 01:50:01,156: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:50:01.223423393Z [2024-06-19 01:50:01,222: INFO/ForkPoolWorker-3] Getting SDNC list 2024-06-19T01:50:01.228476425Z [2024-06-19 01:50:01,227: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:50:01.281206938Z [2024-06-19 01:50:01,280: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-06-19T01:50:01.284938403Z [2024-06-19 01:50:01,284: INFO/ForkPoolWorker-3] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T01:50:01.285269508Z [2024-06-19 01:50:01,285: INFO/ForkPoolWorker-3] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T01:50:01.285495919Z [2024-06-19 01:50:01,285: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-06-19T01:50:01.285877270Z [2024-06-19 01:50:01,285: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T01:50:01.428943637Z [2024-06-19 01:50:01,428: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:50:01.842871356Z [2024-06-19 01:50:01,842: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6ecf23c7-650b-47e1-95da-bef8603cc98e] succeeded in 1.392401218001396s: None 2024-06-19T01:50:02.129006575Z [2024-06-19 01:50:02,128: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[2e0c2b98-a223-4f77-98be-20f7ae367965] succeeded in 1.6532460830003401s: None 2024-06-19T01:50:02.388154068Z [2024-06-19 01:50:02,387: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-19T01:50:02.391775514Z [2024-06-19 01:50:02,391: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:50:02.437534406Z [2024-06-19 01:50:02,436: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T01:50:02.438955528Z [2024-06-19 01:50:02,438: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:50:02.438967874Z [2024-06-19 01:50:02,438: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:50:02.439205369Z [2024-06-19 01:50:02,439: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:50:02.439250406Z [2024-06-19 01:50:02,439: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-19T01:50:02.439595995Z [2024-06-19 01:50:02,439: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T01:50:02.440021892Z [2024-06-19 01:50:02,439: INFO/ForkPoolWorker-2] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:50:02.574061480Z [2024-06-19 01:50:02,573: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:50:02.727238943Z [2024-06-19 01:50:02,726: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T01:50:02.730924908Z [2024-06-19 01:50:02,730: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:50:02.758194228Z [2024-06-19 01:50:02,757: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T01:50:02.760711093Z [2024-06-19 01:50:02,760: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:50:02.761028053Z [2024-06-19 01:50:02,760: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:50:02.761407755Z [2024-06-19 01:50:02,761: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:50:02.761650412Z [2024-06-19 01:50:02,761: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T01:50:02.762206781Z [2024-06-19 01:50:02,762: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T01:50:02.762535004Z [2024-06-19 01:50:02,762: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:50:02.877251235Z [2024-06-19 01:50:02,877: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:50:02.920242513Z [2024-06-19 01:50:02,919: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T01:50:02.924430975Z [2024-06-19 01:50:02,923: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:50:02.944561540Z [2024-06-19 01:50:02,944: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T01:50:02.945881961Z [2024-06-19 01:50:02,945: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:50:02.945897462Z [2024-06-19 01:50:02,945: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:50:02.946074167Z [2024-06-19 01:50:02,945: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:50:02.946115916Z [2024-06-19 01:50:02,946: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T01:50:02.946373153Z [2024-06-19 01:50:02,946: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-06-19T01:50:02.946423965Z [2024-06-19 01:50:02,946: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:50:03.045200769Z [2024-06-19 01:50:03,044: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:50:03.585662044Z [2024-06-19 01:50:03,585: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[efdf70fe-77a3-4f00-baf6-68e89c838628] succeeded in 3.1379078940008185s: None 2024-06-19T01:50:04.085654452Z [2024-06-19 01:50:04,084: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[f1399e8f-f9ae-470c-bc98-2d6d9167a30c] succeeded in 3.629193603001113s: None 2024-06-19T01:50:04.504202752Z [2024-06-19 01:50:04,503: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0f451f6d-c5b7-437e-ace2-e31a00eddd56] received 2024-06-19T01:50:04.520107674Z [2024-06-19 01:50:04,519: INFO/ForkPoolWorker-15] [0f451f6d-c5b7-437e-ace2-e31a00eddd56] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'split_metrics', 'scheduled__2024-06-19T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T01:50:04.835405723Z [2024-06-19 01:50:04,830: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T01:50:04.953181258Z [2024-06-19 01:50:04,952: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7a919396-3626-4e63-a5d2-d81db6456197] succeeded in 4.499645091000275s: None 2024-06-19T01:50:05.998645177Z [2024-06-19 01:50:05,998: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T01:50:06.001909228Z [2024-06-19 01:50:06,001: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:50:06.029128168Z [2024-06-19 01:50:06,028: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T01:50:06.030911298Z [2024-06-19 01:50:06,030: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:50:06.030951590Z [2024-06-19 01:50:06,030: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:50:06.031199855Z [2024-06-19 01:50:06,030: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:50:06.031461695Z [2024-06-19 01:50:06,031: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T01:50:06.031831353Z [2024-06-19 01:50:06,031: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T01:50:06.031963855Z [2024-06-19 01:50:06,031: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:50:06.107223716Z [2024-06-19 01:50:06,106: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:50:06.803024347Z [2024-06-19 01:50:06,801: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0f451f6d-c5b7-437e-ace2-e31a00eddd56] succeeded in 2.294678535999992s: None 2024-06-19T01:50:07.253045522Z [2024-06-19 01:50:07,252: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[977662a8-24db-4980-8ff9-009866480e6a] received 2024-06-19T01:50:07.262422034Z [2024-06-19 01:50:07,262: INFO/ForkPoolWorker-15] [977662a8-24db-4980-8ff9-009866480e6a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'collect_metrics', 'scheduled__2024-06-19T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-19T01:50:07.530527423Z [2024-06-19 01:50:07,527: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T01:50:08.724604742Z [2024-06-19 01:50:08,724: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T01:50:08.727674886Z [2024-06-19 01:50:08,727: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:50:08.747112085Z [2024-06-19 01:50:08,746: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T01:50:08.749093587Z [2024-06-19 01:50:08,748: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:50:08.749189573Z [2024-06-19 01:50:08,748: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:50:08.749383282Z [2024-06-19 01:50:08,749: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:50:08.749438047Z [2024-06-19 01:50:08,749: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T01:50:08.749878362Z [2024-06-19 01:50:08,749: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T01:50:08.749895149Z [2024-06-19 01:50:08,749: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:50:08.844558092Z [2024-06-19 01:50:08,844: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:50:10.671636853Z [2024-06-19 01:50:10,671: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[30e0f4f5-2c72-4c93-97b0-20d6a6245e0d] received 2024-06-19T01:50:10.678374089Z [2024-06-19 01:50:10,678: INFO/ForkPoolWorker-16] [30e0f4f5-2c72-4c93-97b0-20d6a6245e0d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'send_prometheus', 'scheduled__2024-06-19T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T01:50:10.678539553Z [2024-06-19 01:50:10,678: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[977662a8-24db-4980-8ff9-009866480e6a] succeeded in 3.42326491699896s: None 2024-06-19T01:50:10.960208882Z [2024-06-19 01:50:10,957: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T01:50:12.073526103Z [2024-06-19 01:50:12,072: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T01:50:12.076608944Z [2024-06-19 01:50:12,076: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:50:12.098408509Z [2024-06-19 01:50:12,098: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T01:50:12.100197663Z [2024-06-19 01:50:12,099: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:50:12.100458824Z [2024-06-19 01:50:12,100: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:50:12.100728403Z [2024-06-19 01:50:12,100: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:50:12.100944546Z [2024-06-19 01:50:12,100: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T01:50:12.101498793Z [2024-06-19 01:50:12,101: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T01:50:12.101603745Z [2024-06-19 01:50:12,101: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:50:12.235857111Z [2024-06-19 01:50:12,231: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:50:12.851909784Z [2024-06-19 01:50:12,850: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[30e0f4f5-2c72-4c93-97b0-20d6a6245e0d] succeeded in 2.177920780999557s: None 2024-06-19T01:51:00.436468775Z [2024-06-19 01:51:00,436: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f544a56a-64ea-44a3-81b2-988eba6b3576] received 2024-06-19T01:51:00.437660282Z [2024-06-19 01:51:00,437: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1bc7e16a-1231-4cd9-9655-9c0b5b218fa8] received 2024-06-19T01:51:00.449478013Z [2024-06-19 01:51:00,449: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[61b0f999-b06c-4056-b413-6b151692bcd4] received 2024-06-19T01:51:00.457070456Z [2024-06-19 01:51:00,454: INFO/ForkPoolWorker-16] [1bc7e16a-1231-4cd9-9655-9c0b5b218fa8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T01:51:00.461393597Z [2024-06-19 01:51:00,461: INFO/ForkPoolWorker-15] [f544a56a-64ea-44a3-81b2-988eba6b3576] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T01:51:00.466918635Z [2024-06-19 01:51:00,466: INFO/ForkPoolWorker-1] [61b0f999-b06c-4056-b413-6b151692bcd4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T01:51:00.795636939Z [2024-06-19 01:51:00,792: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T01:51:00.823072708Z [2024-06-19 01:51:00,820: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T01:51:00.910721853Z [2024-06-19 01:51:00,907: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T01:51:01.098820851Z [2024-06-19 01:51:01,098: INFO/ForkPoolWorker-15] Getting SDNC list 2024-06-19T01:51:01.103247086Z [2024-06-19 01:51:01,102: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:51:01.123622014Z [2024-06-19 01:51:01,123: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T01:51:01.124875795Z [2024-06-19 01:51:01,124: INFO/ForkPoolWorker-15] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T01:51:01.124894434Z [2024-06-19 01:51:01,124: INFO/ForkPoolWorker-15] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T01:51:01.124972477Z [2024-06-19 01:51:01,124: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-06-19T01:51:01.125271699Z [2024-06-19 01:51:01,125: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T01:51:01.222957603Z [2024-06-19 01:51:01,222: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:51:01.832654416Z [2024-06-19 01:51:01,832: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f544a56a-64ea-44a3-81b2-988eba6b3576] succeeded in 1.39376554699993s: None 2024-06-19T01:51:01.950520441Z [2024-06-19 01:51:01,950: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T01:51:01.953829731Z [2024-06-19 01:51:01,953: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:51:01.956485818Z [2024-06-19 01:51:01,956: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T01:51:01.959497075Z [2024-06-19 01:51:01,959: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:51:01.980712839Z [2024-06-19 01:51:01,980: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T01:51:01.982615527Z [2024-06-19 01:51:01,982: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:51:01.982834194Z [2024-06-19 01:51:01,982: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:51:01.982843256Z [2024-06-19 01:51:01,982: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T01:51:01.983085517Z [2024-06-19 01:51:01,982: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:51:01.983213835Z [2024-06-19 01:51:01,983: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T01:51:01.983549732Z [2024-06-19 01:51:01,983: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-19T01:51:01.983818651Z [2024-06-19 01:51:01,983: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:51:01.984627723Z [2024-06-19 01:51:01,984: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:51:01.984798556Z [2024-06-19 01:51:01,984: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:51:01.985037238Z [2024-06-19 01:51:01,984: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:51:01.985053965Z [2024-06-19 01:51:01,984: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T01:51:01.985414797Z [2024-06-19 01:51:01,985: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T01:51:01.985516218Z [2024-06-19 01:51:01,985: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:51:02.078744491Z [2024-06-19 01:51:02,078: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:51:02.086054948Z [2024-06-19 01:51:02,085: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:51:03.777979628Z [2024-06-19 01:51:03,777: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[61b0f999-b06c-4056-b413-6b151692bcd4] succeeded in 3.324854458000118s: None 2024-06-19T01:51:04.174689956Z [2024-06-19 01:51:04,174: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1bc7e16a-1231-4cd9-9655-9c0b5b218fa8] succeeded in 3.7332542490003107s: None 2024-06-19T01:52:00.320880036Z [2024-06-19 01:52:00,320: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[91146c8a-0b87-417c-973a-8fc18f4d8114] received 2024-06-19T01:52:00.330407725Z [2024-06-19 01:52:00,330: INFO/ForkPoolWorker-15] [91146c8a-0b87-417c-973a-8fc18f4d8114] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-19T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-19T01:52:00.331095960Z [2024-06-19 01:52:00,330: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7a4455de-a379-4c2f-b622-7aeb72f796f4] received 2024-06-19T01:52:00.336451123Z [2024-06-19 01:52:00,336: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b37e010b-35a4-4376-85de-14800340dfb3] received 2024-06-19T01:52:00.338381267Z [2024-06-19 01:52:00,338: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0962cdf7-1204-4d18-a5dc-7e1c667539f9] received 2024-06-19T01:52:00.342783111Z [2024-06-19 01:52:00,342: INFO/ForkPoolWorker-16] [7a4455de-a379-4c2f-b622-7aeb72f796f4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T01:52:00.347904816Z [2024-06-19 01:52:00,347: INFO/ForkPoolWorker-1] [b37e010b-35a4-4376-85de-14800340dfb3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T01:52:00.376643984Z [2024-06-19 01:52:00,376: INFO/ForkPoolWorker-2] [0962cdf7-1204-4d18-a5dc-7e1c667539f9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T01:52:00.713008717Z [2024-06-19 01:52:00,709: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T01:52:00.794909345Z [2024-06-19 01:52:00,790: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T01:52:00.854797390Z [2024-06-19 01:52:00,851: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T01:52:00.967791811Z [2024-06-19 01:52:00,964: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-19T01:52:01.041435058Z [2024-06-19 01:52:01,041: INFO/ForkPoolWorker-2] Getting SDNC list 2024-06-19T01:52:01.045854580Z [2024-06-19 01:52:01,045: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:52:01.094898772Z [2024-06-19 01:52:01,094: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T01:52:01.097552829Z [2024-06-19 01:52:01,097: INFO/ForkPoolWorker-2] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T01:52:01.097779818Z [2024-06-19 01:52:01,097: INFO/ForkPoolWorker-2] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T01:52:01.097957248Z [2024-06-19 01:52:01,097: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-06-19T01:52:01.099525785Z [2024-06-19 01:52:01,099: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T01:52:01.195422652Z [2024-06-19 01:52:01,195: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:52:01.360512844Z [2024-06-19 01:52:01,360: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:52:01.761855313Z [2024-06-19 01:52:01,761: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[0962cdf7-1204-4d18-a5dc-7e1c667539f9] succeeded in 1.4164032280004903s: None 2024-06-19T01:52:01.943073234Z [2024-06-19 01:52:01,942: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[91146c8a-0b87-417c-973a-8fc18f4d8114] succeeded in 1.6194336780008598s: None 2024-06-19T01:52:02.138291375Z [2024-06-19 01:52:02,137: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T01:52:02.141539718Z [2024-06-19 01:52:02,141: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:52:02.161604668Z [2024-06-19 01:52:02,161: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T01:52:02.163327898Z [2024-06-19 01:52:02,163: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:52:02.163489390Z [2024-06-19 01:52:02,163: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:52:02.163773806Z [2024-06-19 01:52:02,163: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:52:02.164204366Z [2024-06-19 01:52:02,164: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T01:52:02.164817306Z [2024-06-19 01:52:02,164: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T01:52:02.165003859Z [2024-06-19 01:52:02,164: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:52:02.170810296Z [2024-06-19 01:52:02,170: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T01:52:02.174505640Z [2024-06-19 01:52:02,174: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:52:02.205793486Z [2024-06-19 01:52:02,205: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T01:52:02.227994457Z [2024-06-19 01:52:02,217: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:52:02.228017569Z [2024-06-19 01:52:02,217: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:52:02.228021827Z [2024-06-19 01:52:02,217: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:52:02.228026553Z [2024-06-19 01:52:02,217: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T01:52:02.228029747Z [2024-06-19 01:52:02,218: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-19T01:52:02.228032966Z [2024-06-19 01:52:02,218: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:52:02.307194151Z [2024-06-19 01:52:02,306: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:52:02.364041196Z [2024-06-19 01:52:02,363: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:52:03.867295053Z [2024-06-19 01:52:03,866: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b37e010b-35a4-4376-85de-14800340dfb3] succeeded in 3.528573356999914s: None 2024-06-19T01:52:04.276108742Z [2024-06-19 01:52:04,275: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7a4455de-a379-4c2f-b622-7aeb72f796f4] succeeded in 3.943023825999262s: None 2024-06-19T01:53:01.208978490Z [2024-06-19 01:53:01,208: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[34dfd5c7-b7c8-4a5a-986d-c6011bbada33] received 2024-06-19T01:53:01.221009265Z [2024-06-19 01:53:01,220: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fba4a7e9-f6e7-4313-83ab-1d853e857c26] received 2024-06-19T01:53:01.223465980Z [2024-06-19 01:53:01,223: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cb16f77e-ef48-4bd0-b182-d8dd24d50ad3] received 2024-06-19T01:53:01.232831855Z [2024-06-19 01:53:01,232: INFO/ForkPoolWorker-1] [cb16f77e-ef48-4bd0-b182-d8dd24d50ad3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T01:53:01.233570826Z [2024-06-19 01:53:01,233: INFO/ForkPoolWorker-16] [fba4a7e9-f6e7-4313-83ab-1d853e857c26] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T01:53:01.240923579Z [2024-06-19 01:53:01,240: INFO/ForkPoolWorker-15] [34dfd5c7-b7c8-4a5a-986d-c6011bbada33] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T01:53:01.545256497Z [2024-06-19 01:53:01,540: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T01:53:01.548422170Z [2024-06-19 01:53:01,543: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T01:53:01.553138803Z [2024-06-19 01:53:01,549: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T01:53:01.755592582Z [2024-06-19 01:53:01,755: INFO/ForkPoolWorker-15] Getting SDNC list 2024-06-19T01:53:01.759719597Z [2024-06-19 01:53:01,759: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:53:01.813322650Z [2024-06-19 01:53:01,813: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T01:53:01.817274253Z [2024-06-19 01:53:01,817: INFO/ForkPoolWorker-15] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T01:53:01.817579069Z [2024-06-19 01:53:01,817: INFO/ForkPoolWorker-15] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T01:53:01.817674380Z [2024-06-19 01:53:01,817: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-06-19T01:53:01.817913844Z [2024-06-19 01:53:01,817: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T01:53:01.953014539Z [2024-06-19 01:53:01,952: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:53:02.698222212Z [2024-06-19 01:53:02,697: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[34dfd5c7-b7c8-4a5a-986d-c6011bbada33] succeeded in 1.485941658000229s: None 2024-06-19T01:53:03.103438692Z [2024-06-19 01:53:03,102: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T01:53:03.107221696Z [2024-06-19 01:53:03,106: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:53:03.153515663Z [2024-06-19 01:53:03,153: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T01:53:03.154715335Z [2024-06-19 01:53:03,154: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:53:03.154947184Z [2024-06-19 01:53:03,154: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:53:03.155051392Z [2024-06-19 01:53:03,154: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:53:03.155092595Z [2024-06-19 01:53:03,154: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T01:53:03.155290619Z [2024-06-19 01:53:03,155: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T01:53:03.155418181Z [2024-06-19 01:53:03,155: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:53:03.198781579Z [2024-06-19 01:53:03,198: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T01:53:03.202737151Z [2024-06-19 01:53:03,202: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:53:03.229566133Z [2024-06-19 01:53:03,229: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T01:53:03.230778812Z [2024-06-19 01:53:03,230: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:53:03.230790912Z [2024-06-19 01:53:03,230: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:53:03.231026312Z [2024-06-19 01:53:03,230: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:53:03.231472760Z [2024-06-19 01:53:03,230: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T01:53:03.232132940Z [2024-06-19 01:53:03,231: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-19T01:53:03.232149844Z [2024-06-19 01:53:03,232: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:53:03.275252027Z [2024-06-19 01:53:03,274: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:53:03.298832300Z [2024-06-19 01:53:03,298: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:53:05.354107776Z [2024-06-19 01:53:05,353: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[cb16f77e-ef48-4bd0-b182-d8dd24d50ad3] succeeded in 4.128805012000157s: None 2024-06-19T01:53:05.456587210Z [2024-06-19 01:53:05,456: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[fba4a7e9-f6e7-4313-83ab-1d853e857c26] succeeded in 4.232963526999811s: None 2024-06-19T01:54:01.249666884Z [2024-06-19 01:54:01,249: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[be7b68a2-7ec9-49f6-b154-b9a64f64970d] received 2024-06-19T01:54:01.255178871Z [2024-06-19 01:54:01,254: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[98591000-bce3-49a2-9f09-52c98438a4c1] received 2024-06-19T01:54:01.262733362Z [2024-06-19 01:54:01,262: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[617ec013-f600-48a6-831f-64bee1eda05b] received 2024-06-19T01:54:01.265549576Z [2024-06-19 01:54:01,265: INFO/ForkPoolWorker-15] [be7b68a2-7ec9-49f6-b154-b9a64f64970d] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-19T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-19T01:54:01.265814748Z [2024-06-19 01:54:01,265: INFO/ForkPoolWorker-16] [98591000-bce3-49a2-9f09-52c98438a4c1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T01:54:01.273499447Z [2024-06-19 01:54:01,273: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[77843e1a-9447-4319-8629-31b448de35df] received 2024-06-19T01:54:01.281639914Z [2024-06-19 01:54:01,281: INFO/ForkPoolWorker-1] [617ec013-f600-48a6-831f-64bee1eda05b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T01:54:01.283716486Z [2024-06-19 01:54:01,283: INFO/ForkPoolWorker-2] [77843e1a-9447-4319-8629-31b448de35df] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T01:54:01.578919951Z [2024-06-19 01:54:01,575: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T01:54:01.690471346Z [2024-06-19 01:54:01,687: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T01:54:01.738395241Z [2024-06-19 01:54:01,735: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-19T01:54:01.747120644Z [2024-06-19 01:54:01,746: INFO/ForkPoolWorker-2] Getting SDNC list 2024-06-19T01:54:01.751369543Z [2024-06-19 01:54:01,750: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:54:01.768105476Z [2024-06-19 01:54:01,762: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T01:54:01.780229053Z [2024-06-19 01:54:01,779: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T01:54:01.782476471Z [2024-06-19 01:54:01,782: INFO/ForkPoolWorker-2] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T01:54:01.782686942Z [2024-06-19 01:54:01,782: INFO/ForkPoolWorker-2] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T01:54:01.782810572Z [2024-06-19 01:54:01,782: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-06-19T01:54:01.783098460Z [2024-06-19 01:54:01,782: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T01:54:01.869427042Z [2024-06-19 01:54:01,869: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:54:01.992283986Z [2024-06-19 01:54:01,991: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:54:02.601379889Z [2024-06-19 01:54:02,600: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[77843e1a-9447-4319-8629-31b448de35df] succeeded in 1.3247520719996828s: None 2024-06-19T01:54:02.804255143Z [2024-06-19 01:54:02,803: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[be7b68a2-7ec9-49f6-b154-b9a64f64970d] succeeded in 1.5508136690004903s: None 2024-06-19T01:54:03.053325986Z [2024-06-19 01:54:03,052: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T01:54:03.056428450Z [2024-06-19 01:54:03,055: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:54:03.083636367Z [2024-06-19 01:54:03,083: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T01:54:03.085478534Z [2024-06-19 01:54:03,085: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:54:03.085697321Z [2024-06-19 01:54:03,085: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:54:03.085966344Z [2024-06-19 01:54:03,085: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:54:03.086145215Z [2024-06-19 01:54:03,085: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T01:54:03.086831876Z [2024-06-19 01:54:03,086: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-19T01:54:03.087015796Z [2024-06-19 01:54:03,086: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:54:03.194130679Z [2024-06-19 01:54:03,193: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:54:03.377557101Z [2024-06-19 01:54:03,376: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T01:54:03.381097780Z [2024-06-19 01:54:03,380: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:54:03.416784212Z [2024-06-19 01:54:03,416: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T01:54:03.419163109Z [2024-06-19 01:54:03,418: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:54:03.419216372Z [2024-06-19 01:54:03,419: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:54:03.419571384Z [2024-06-19 01:54:03,419: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:54:03.419679062Z [2024-06-19 01:54:03,419: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T01:54:03.420407986Z [2024-06-19 01:54:03,420: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T01:54:03.420501085Z [2024-06-19 01:54:03,420: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:54:03.533998876Z [2024-06-19 01:54:03,533: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:54:05.055254046Z [2024-06-19 01:54:05,054: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[98591000-bce3-49a2-9f09-52c98438a4c1] succeeded in 3.797405790000994s: None 2024-06-19T01:54:05.412484411Z [2024-06-19 01:54:05,411: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[617ec013-f600-48a6-831f-64bee1eda05b] succeeded in 4.144765982999161s: None 2024-06-19T01:55:00.562278632Z [2024-06-19 01:55:00,561: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fb50af85-2113-4659-9ff8-a1df0345799a] received 2024-06-19T01:55:00.564689728Z [2024-06-19 01:55:00,564: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[33064ad6-8ce0-4ff3-b687-25d34f42335d] received 2024-06-19T01:55:00.566322180Z [2024-06-19 01:55:00,566: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5fc2c322-cb1c-4804-a62d-f26b70e6e404] received 2024-06-19T01:55:00.572607498Z [2024-06-19 01:55:00,572: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[22e57d55-281d-4793-8573-f2f52d75c6a2] received 2024-06-19T01:55:00.586339223Z [2024-06-19 01:55:00,585: INFO/ForkPoolWorker-16] [33064ad6-8ce0-4ff3-b687-25d34f42335d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T01:55:00.587173907Z [2024-06-19 01:55:00,586: INFO/ForkPoolWorker-2] [22e57d55-281d-4793-8573-f2f52d75c6a2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T01:55:00.587791644Z [2024-06-19 01:55:00,585: INFO/ForkPoolWorker-15] [fb50af85-2113-4659-9ff8-a1df0345799a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-19T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T01:55:00.592094615Z [2024-06-19 01:55:00,587: INFO/ForkPoolWorker-1] [5fc2c322-cb1c-4804-a62d-f26b70e6e404] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T01:55:00.953087131Z [2024-06-19 01:55:00,949: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T01:55:01.170426994Z [2024-06-19 01:55:01,160: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T01:55:01.371370370Z [2024-06-19 01:55:01,370: INFO/ForkPoolWorker-2] Getting SDNC list 2024-06-19T01:55:01.379887337Z [2024-06-19 01:55:01,379: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:55:01.405973056Z [2024-06-19 01:55:01,405: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T01:55:01.412720189Z [2024-06-19 01:55:01,412: INFO/ForkPoolWorker-2] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T01:55:01.412917700Z [2024-06-19 01:55:01,412: INFO/ForkPoolWorker-2] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T01:55:01.413002831Z [2024-06-19 01:55:01,412: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-06-19T01:55:01.413246248Z [2024-06-19 01:55:01,413: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T01:55:01.526805658Z [2024-06-19 01:55:01,523: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T01:55:01.547858665Z [2024-06-19 01:55:01,547: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:55:01.660733165Z [2024-06-19 01:55:01,655: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T01:55:02.622190508Z [2024-06-19 01:55:02,621: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[22e57d55-281d-4793-8573-f2f52d75c6a2] succeeded in 2.0455823779993807s: None 2024-06-19T01:55:03.147143796Z [2024-06-19 01:55:03,146: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T01:55:03.150752700Z [2024-06-19 01:55:03,150: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:55:03.174158281Z [2024-06-19 01:55:03,173: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T01:55:03.177282951Z [2024-06-19 01:55:03,175: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:55:03.177499665Z [2024-06-19 01:55:03,177: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:55:03.177720621Z [2024-06-19 01:55:03,177: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:55:03.177885269Z [2024-06-19 01:55:03,177: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T01:55:03.178234240Z [2024-06-19 01:55:03,178: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-19T01:55:03.178400660Z [2024-06-19 01:55:03,178: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:55:03.230323449Z [2024-06-19 01:55:03,229: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T01:55:03.234407003Z [2024-06-19 01:55:03,233: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:55:03.264457759Z [2024-06-19 01:55:03,264: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T01:55:03.265834343Z [2024-06-19 01:55:03,265: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:55:03.265845745Z [2024-06-19 01:55:03,265: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:55:03.266683130Z [2024-06-19 01:55:03,266: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:55:03.266812637Z [2024-06-19 01:55:03,266: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T01:55:03.267160803Z [2024-06-19 01:55:03,266: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T01:55:03.267249198Z [2024-06-19 01:55:03,267: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:55:03.285810313Z [2024-06-19 01:55:03,285: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:55:03.365085506Z [2024-06-19 01:55:03,364: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T01:55:03.368472082Z [2024-06-19 01:55:03,367: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:55:03.396386633Z [2024-06-19 01:55:03,396: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T01:55:03.398477306Z [2024-06-19 01:55:03,398: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:55:03.398490866Z [2024-06-19 01:55:03,398: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:55:03.398704469Z [2024-06-19 01:55:03,398: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:55:03.398717470Z [2024-06-19 01:55:03,398: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T01:55:03.399113024Z [2024-06-19 01:55:03,398: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T01:55:03.399123454Z [2024-06-19 01:55:03,399: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:55:03.400046216Z [2024-06-19 01:55:03,399: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:55:03.499349779Z [2024-06-19 01:55:03,499: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:55:04.299202161Z [2024-06-19 01:55:04,298: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fb50af85-2113-4659-9ff8-a1df0345799a] succeeded in 3.733380978999776s: None 2024-06-19T01:55:04.780706267Z [2024-06-19 01:55:04,780: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9553a6e5-8a05-40c5-9b92-89b48016eab2] received 2024-06-19T01:55:04.791049894Z [2024-06-19 01:55:04,790: INFO/ForkPoolWorker-15] [9553a6e5-8a05-40c5-9b92-89b48016eab2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'split_metrics', 'scheduled__2024-06-19T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T01:55:05.020997356Z [2024-06-19 01:55:05,020: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5fc2c322-cb1c-4804-a62d-f26b70e6e404] succeeded in 4.443876896999427s: None 2024-06-19T01:55:05.128488022Z [2024-06-19 01:55:05,125: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T01:55:05.190679004Z [2024-06-19 01:55:05,190: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[33064ad6-8ce0-4ff3-b687-25d34f42335d] succeeded in 4.612191365000399s: None 2024-06-19T01:55:06.229157560Z [2024-06-19 01:55:06,228: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T01:55:06.232228136Z [2024-06-19 01:55:06,231: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:55:06.253324173Z [2024-06-19 01:55:06,253: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T01:55:06.254900615Z [2024-06-19 01:55:06,254: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:55:06.254915525Z [2024-06-19 01:55:06,254: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:55:06.255203244Z [2024-06-19 01:55:06,254: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:55:06.255227966Z [2024-06-19 01:55:06,255: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T01:55:06.255644300Z [2024-06-19 01:55:06,255: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T01:55:06.255817221Z [2024-06-19 01:55:06,255: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:55:06.348482112Z [2024-06-19 01:55:06,348: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:55:07.072727953Z [2024-06-19 01:55:07,072: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9553a6e5-8a05-40c5-9b92-89b48016eab2] succeeded in 2.290159424999729s: None 2024-06-19T01:55:07.231418126Z [2024-06-19 01:55:07,230: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1d2cf462-8d8c-42a9-b46d-af168b63f519] received 2024-06-19T01:55:07.242510982Z [2024-06-19 01:55:07,241: INFO/ForkPoolWorker-15] [1d2cf462-8d8c-42a9-b46d-af168b63f519] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'collect_metrics', 'scheduled__2024-06-19T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-19T01:55:07.540014522Z [2024-06-19 01:55:07,537: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T01:55:08.565725630Z [2024-06-19 01:55:08,565: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T01:55:08.568518184Z [2024-06-19 01:55:08,568: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:55:08.617136610Z [2024-06-19 01:55:08,616: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T01:55:08.619510116Z [2024-06-19 01:55:08,619: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:55:08.619934328Z [2024-06-19 01:55:08,619: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:55:08.620380858Z [2024-06-19 01:55:08,619: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:55:08.620618772Z [2024-06-19 01:55:08,620: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T01:55:08.621179131Z [2024-06-19 01:55:08,620: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T01:55:08.621942378Z [2024-06-19 01:55:08,621: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:55:08.758686612Z [2024-06-19 01:55:08,758: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:55:10.421075066Z [2024-06-19 01:55:10,420: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1d2cf462-8d8c-42a9-b46d-af168b63f519] succeeded in 3.187509757999578s: None 2024-06-19T01:55:10.493086736Z [2024-06-19 01:55:10,492: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fdd535c4-d73f-4f47-876e-7464806c383e] received 2024-06-19T01:55:10.500916021Z [2024-06-19 01:55:10,500: INFO/ForkPoolWorker-15] [fdd535c4-d73f-4f47-876e-7464806c383e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'send_prometheus', 'scheduled__2024-06-19T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T01:55:10.778254927Z [2024-06-19 01:55:10,775: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T01:55:11.813105569Z [2024-06-19 01:55:11,812: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T01:55:11.816049513Z [2024-06-19 01:55:11,815: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:55:11.838833017Z [2024-06-19 01:55:11,838: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T01:55:11.841991384Z [2024-06-19 01:55:11,841: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:55:11.842417923Z [2024-06-19 01:55:11,841: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:55:11.844391835Z [2024-06-19 01:55:11,843: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:55:11.844530956Z [2024-06-19 01:55:11,844: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T01:55:11.845361284Z [2024-06-19 01:55:11,844: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T01:55:11.845578364Z [2024-06-19 01:55:11,845: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:55:11.938145975Z [2024-06-19 01:55:11,937: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:55:12.504531851Z [2024-06-19 01:55:12,503: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fdd535c4-d73f-4f47-876e-7464806c383e] succeeded in 2.008809843000563s: None 2024-06-19T01:56:01.079011791Z [2024-06-19 01:56:01,078: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[67a9c417-a38b-445a-a1b8-8a9ab4d79a43] received 2024-06-19T01:56:01.085203241Z [2024-06-19 01:56:01,085: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[90fd0ae8-82a5-4993-afcb-9ed0df9af649] received 2024-06-19T01:56:01.089218191Z [2024-06-19 01:56:01,089: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[86a86ed9-4e64-4fb2-8f8e-32a0eb1bc882] received 2024-06-19T01:56:01.091133873Z [2024-06-19 01:56:01,090: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3d58bc5e-0dd6-4e21-b6e2-27e7046372f2] received 2024-06-19T01:56:01.109688909Z [2024-06-19 01:56:01,109: INFO/ForkPoolWorker-2] [3d58bc5e-0dd6-4e21-b6e2-27e7046372f2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T01:56:01.114460029Z [2024-06-19 01:56:01,114: INFO/ForkPoolWorker-16] [90fd0ae8-82a5-4993-afcb-9ed0df9af649] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-19T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-19T01:56:01.116070044Z [2024-06-19 01:56:01,115: INFO/ForkPoolWorker-15] [67a9c417-a38b-445a-a1b8-8a9ab4d79a43] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T01:56:01.116842785Z [2024-06-19 01:56:01,116: INFO/ForkPoolWorker-1] [86a86ed9-4e64-4fb2-8f8e-32a0eb1bc882] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T01:56:01.463483038Z [2024-06-19 01:56:01,460: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T01:56:01.490818290Z [2024-06-19 01:56:01,483: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-19T01:56:01.607103832Z [2024-06-19 01:56:01,606: INFO/ForkPoolWorker-2] Getting SDNC list 2024-06-19T01:56:01.607147430Z [2024-06-19 01:56:01,603: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T01:56:01.610862493Z [2024-06-19 01:56:01,610: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:56:01.635636409Z [2024-06-19 01:56:01,635: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T01:56:01.636779656Z [2024-06-19 01:56:01,636: INFO/ForkPoolWorker-2] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T01:56:01.636984312Z [2024-06-19 01:56:01,636: INFO/ForkPoolWorker-2] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T01:56:01.637055583Z [2024-06-19 01:56:01,636: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-06-19T01:56:01.637324857Z [2024-06-19 01:56:01,637: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T01:56:01.685978114Z [2024-06-19 01:56:01,681: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T01:56:01.733315853Z [2024-06-19 01:56:01,733: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:56:01.821984627Z [2024-06-19 01:56:01,821: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:56:02.400694901Z [2024-06-19 01:56:02,400: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[3d58bc5e-0dd6-4e21-b6e2-27e7046372f2] succeeded in 1.3072041319992422s: None 2024-06-19T01:56:02.615365552Z [2024-06-19 01:56:02,614: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[90fd0ae8-82a5-4993-afcb-9ed0df9af649] succeeded in 1.5228086690003693s: None 2024-06-19T01:56:02.965768754Z [2024-06-19 01:56:02,965: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T01:56:02.968972155Z [2024-06-19 01:56:02,968: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:56:02.989526760Z [2024-06-19 01:56:02,989: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T01:56:02.990957086Z [2024-06-19 01:56:02,990: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:56:02.991162436Z [2024-06-19 01:56:02,990: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:56:02.991404226Z [2024-06-19 01:56:02,991: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:56:02.991582695Z [2024-06-19 01:56:02,991: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T01:56:02.992080894Z [2024-06-19 01:56:02,991: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-06-19T01:56:02.992253666Z [2024-06-19 01:56:02,992: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:56:03.061545555Z [2024-06-19 01:56:03,061: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:56:03.087901957Z [2024-06-19 01:56:03,087: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T01:56:03.091302742Z [2024-06-19 01:56:03,090: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:56:03.107814145Z [2024-06-19 01:56:03,107: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T01:56:03.108931926Z [2024-06-19 01:56:03,108: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:56:03.108968350Z [2024-06-19 01:56:03,108: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:56:03.109117605Z [2024-06-19 01:56:03,108: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:56:03.109169818Z [2024-06-19 01:56:03,109: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T01:56:03.109401768Z [2024-06-19 01:56:03,109: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T01:56:03.109456023Z [2024-06-19 01:56:03,109: INFO/ForkPoolWorker-15] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:56:03.182354627Z [2024-06-19 01:56:03,182: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:56:04.867240389Z [2024-06-19 01:56:04,866: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[86a86ed9-4e64-4fb2-8f8e-32a0eb1bc882] succeeded in 3.7656177150001895s: None 2024-06-19T01:56:04.894582202Z [2024-06-19 01:56:04,894: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[67a9c417-a38b-445a-a1b8-8a9ab4d79a43] succeeded in 3.809212390999164s: None 2024-06-19T01:57:00.390655816Z [2024-06-19 01:57:00,390: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[455ffb63-5b35-46fe-be81-dd25cf53b12e] received 2024-06-19T01:57:00.394829820Z [2024-06-19 01:57:00,394: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d9964eba-1be0-4f3e-b0e8-ba72255e0003] received 2024-06-19T01:57:00.397726365Z [2024-06-19 01:57:00,397: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8eb45102-71a9-4339-abdb-8230f01264ce] received 2024-06-19T01:57:00.406242814Z [2024-06-19 01:57:00,405: INFO/ForkPoolWorker-15] [455ffb63-5b35-46fe-be81-dd25cf53b12e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T01:57:00.408969289Z [2024-06-19 01:57:00,408: INFO/ForkPoolWorker-1] [8eb45102-71a9-4339-abdb-8230f01264ce] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T01:57:00.409000615Z [2024-06-19 01:57:00,408: INFO/ForkPoolWorker-16] [d9964eba-1be0-4f3e-b0e8-ba72255e0003] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T01:57:00.730884815Z [2024-06-19 01:57:00,726: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T01:57:00.757508124Z [2024-06-19 01:57:00,753: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T01:57:00.758293755Z [2024-06-19 01:57:00,754: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T01:57:00.904505045Z [2024-06-19 01:57:00,904: INFO/ForkPoolWorker-16] Getting SDNC list 2024-06-19T01:57:00.908338359Z [2024-06-19 01:57:00,907: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:57:00.935203700Z [2024-06-19 01:57:00,934: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T01:57:00.941604081Z [2024-06-19 01:57:00,941: INFO/ForkPoolWorker-16] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T01:57:00.941981381Z [2024-06-19 01:57:00,941: INFO/ForkPoolWorker-16] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T01:57:00.942066039Z [2024-06-19 01:57:00,941: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-06-19T01:57:00.942274791Z [2024-06-19 01:57:00,942: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T01:57:01.063108082Z [2024-06-19 01:57:01,062: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:57:01.686743853Z [2024-06-19 01:57:01,686: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d9964eba-1be0-4f3e-b0e8-ba72255e0003] succeeded in 1.2845111280003039s: None 2024-06-19T01:57:01.830252569Z [2024-06-19 01:57:01,829: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T01:57:01.831459929Z [2024-06-19 01:57:01,831: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T01:57:01.833461934Z [2024-06-19 01:57:01,833: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:57:01.834721396Z [2024-06-19 01:57:01,834: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:57:01.856136613Z [2024-06-19 01:57:01,855: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T01:57:01.858296990Z [2024-06-19 01:57:01,858: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T01:57:01.858939239Z [2024-06-19 01:57:01,858: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:57:01.859086128Z [2024-06-19 01:57:01,858: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:57:01.859312729Z [2024-06-19 01:57:01,859: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:57:01.859341115Z [2024-06-19 01:57:01,859: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T01:57:01.859714850Z [2024-06-19 01:57:01,859: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T01:57:01.859796641Z [2024-06-19 01:57:01,859: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:57:01.859860306Z [2024-06-19 01:57:01,859: INFO/ForkPoolWorker-15] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:57:01.859954727Z [2024-06-19 01:57:01,859: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:57:01.860233192Z [2024-06-19 01:57:01,859: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:57:01.860358489Z [2024-06-19 01:57:01,860: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T01:57:01.861149124Z [2024-06-19 01:57:01,860: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-06-19T01:57:01.861263267Z [2024-06-19 01:57:01,861: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:57:01.975480065Z [2024-06-19 01:57:01,975: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:57:01.988916461Z [2024-06-19 01:57:01,988: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:57:03.472499258Z [2024-06-19 01:57:03,471: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[455ffb63-5b35-46fe-be81-dd25cf53b12e] succeeded in 3.0791968230005295s: None 2024-06-19T01:57:03.979540729Z [2024-06-19 01:57:03,979: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8eb45102-71a9-4339-abdb-8230f01264ce] succeeded in 3.579660072000479s: None 2024-06-19T01:58:00.966989864Z [2024-06-19 01:58:00,966: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6480fcf3-08ce-4283-9df9-7cb7406974ad] received 2024-06-19T01:58:00.976257847Z [2024-06-19 01:58:00,975: INFO/ForkPoolWorker-15] [6480fcf3-08ce-4283-9df9-7cb7406974ad] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-19T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-19T01:58:00.983279720Z [2024-06-19 01:58:00,983: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b3a6ff7f-4726-48f7-b890-a005654e85b1] received 2024-06-19T01:58:00.985571918Z [2024-06-19 01:58:00,985: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[29f0e209-ec61-42a6-8b66-aa119ea260d7] received 2024-06-19T01:58:00.987180328Z [2024-06-19 01:58:00,987: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a465a887-ccba-4020-868b-09dd56da90ec] received 2024-06-19T01:58:00.992655760Z [2024-06-19 01:58:00,992: INFO/ForkPoolWorker-1] [29f0e209-ec61-42a6-8b66-aa119ea260d7] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T01:58:00.999146932Z [2024-06-19 01:58:00,998: INFO/ForkPoolWorker-2] [a465a887-ccba-4020-868b-09dd56da90ec] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T01:58:01.012535024Z [2024-06-19 01:58:01,012: INFO/ForkPoolWorker-16] [b3a6ff7f-4726-48f7-b890-a005654e85b1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T01:58:01.393153648Z [2024-06-19 01:58:01,389: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-19T01:58:01.398505776Z [2024-06-19 01:58:01,395: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T01:58:01.408310265Z [2024-06-19 01:58:01,403: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T01:58:01.479212600Z [2024-06-19 01:58:01,475: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T01:58:01.552575778Z [2024-06-19 01:58:01,552: INFO/ForkPoolWorker-1] Getting SDNC list 2024-06-19T01:58:01.556745497Z [2024-06-19 01:58:01,556: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:58:01.575070967Z [2024-06-19 01:58:01,574: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T01:58:01.576102340Z [2024-06-19 01:58:01,575: INFO/ForkPoolWorker-1] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T01:58:01.576368321Z [2024-06-19 01:58:01,576: INFO/ForkPoolWorker-1] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T01:58:01.576530157Z [2024-06-19 01:58:01,576: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-06-19T01:58:01.576844571Z [2024-06-19 01:58:01,576: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T01:58:01.669141685Z [2024-06-19 01:58:01,668: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:58:01.735975933Z [2024-06-19 01:58:01,735: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:58:02.342972488Z [2024-06-19 01:58:02,342: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6480fcf3-08ce-4283-9df9-7cb7406974ad] succeeded in 1.3735178429997177s: None 2024-06-19T01:58:02.547928586Z [2024-06-19 01:58:02,547: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[29f0e209-ec61-42a6-8b66-aa119ea260d7] succeeded in 1.5609547160001966s: None 2024-06-19T01:58:02.789032927Z [2024-06-19 01:58:02,788: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-19T01:58:02.792259098Z [2024-06-19 01:58:02,791: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:58:02.813639115Z [2024-06-19 01:58:02,813: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T01:58:02.815182517Z [2024-06-19 01:58:02,814: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:58:02.815289176Z [2024-06-19 01:58:02,815: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:58:02.815539081Z [2024-06-19 01:58:02,815: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:58:02.815871446Z [2024-06-19 01:58:02,815: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-19T01:58:02.816534625Z [2024-06-19 01:58:02,816: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-06-19T01:58:02.816700634Z [2024-06-19 01:58:02,816: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:58:02.852835167Z [2024-06-19 01:58:02,852: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T01:58:02.856318485Z [2024-06-19 01:58:02,855: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:58:02.891532674Z [2024-06-19 01:58:02,891: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T01:58:02.893944155Z [2024-06-19 01:58:02,893: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:58:02.894232269Z [2024-06-19 01:58:02,893: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:58:02.894453376Z [2024-06-19 01:58:02,894: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:58:02.894508593Z [2024-06-19 01:58:02,894: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T01:58:02.895087208Z [2024-06-19 01:58:02,894: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T01:58:02.895196620Z [2024-06-19 01:58:02,895: INFO/ForkPoolWorker-16] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:58:02.926344302Z [2024-06-19 01:58:02,925: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:58:02.992043894Z [2024-06-19 01:58:02,991: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:58:04.952450741Z [2024-06-19 01:58:04,951: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b3a6ff7f-4726-48f7-b890-a005654e85b1] succeeded in 3.961800230001245s: None 2024-06-19T01:58:05.291564113Z [2024-06-19 01:58:05,291: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a465a887-ccba-4020-868b-09dd56da90ec] succeeded in 4.302388485000847s: None 2024-06-19T01:59:00.269620507Z [2024-06-19 01:59:00,268: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[669c56ec-916c-44dc-9453-5ddaedcf5f25] received 2024-06-19T01:59:00.277213745Z [2024-06-19 01:59:00,276: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[989cf761-91e7-4bb2-a84e-bb0dd55cd427] received 2024-06-19T01:59:00.277724721Z [2024-06-19 01:59:00,277: INFO/ForkPoolWorker-15] [669c56ec-916c-44dc-9453-5ddaedcf5f25] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T01:59:00.280120530Z [2024-06-19 01:59:00,279: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c0581154-4ed4-47af-ae59-169f7cbea477] received 2024-06-19T01:59:00.291834259Z [2024-06-19 01:59:00,291: INFO/ForkPoolWorker-1] [c0581154-4ed4-47af-ae59-169f7cbea477] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T01:59:00.292542191Z [2024-06-19 01:59:00,292: INFO/ForkPoolWorker-16] [989cf761-91e7-4bb2-a84e-bb0dd55cd427] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T01:59:00.557652425Z [2024-06-19 01:59:00,553: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T01:59:00.582466762Z [2024-06-19 01:59:00,579: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T01:59:00.645666992Z [2024-06-19 01:59:00,642: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T01:59:00.733431744Z [2024-06-19 01:59:00,733: INFO/ForkPoolWorker-1] Getting SDNC list 2024-06-19T01:59:00.737585953Z [2024-06-19 01:59:00,737: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:59:00.760202192Z [2024-06-19 01:59:00,759: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T01:59:00.764560808Z [2024-06-19 01:59:00,764: INFO/ForkPoolWorker-1] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T01:59:00.764731307Z [2024-06-19 01:59:00,764: INFO/ForkPoolWorker-1] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T01:59:00.764906852Z [2024-06-19 01:59:00,764: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-06-19T01:59:00.765338389Z [2024-06-19 01:59:00,765: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T01:59:00.851574578Z [2024-06-19 01:59:00,851: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:59:01.440102962Z [2024-06-19 01:59:01,439: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c0581154-4ed4-47af-ae59-169f7cbea477] succeeded in 1.1580123880012252s: None 2024-06-19T01:59:01.690499943Z [2024-06-19 01:59:01,690: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T01:59:01.693623154Z [2024-06-19 01:59:01,693: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:59:01.718321975Z [2024-06-19 01:59:01,718: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T01:59:01.719835367Z [2024-06-19 01:59:01,719: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:59:01.719984825Z [2024-06-19 01:59:01,719: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:59:01.720223905Z [2024-06-19 01:59:01,719: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:59:01.720482628Z [2024-06-19 01:59:01,720: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T01:59:01.720818586Z [2024-06-19 01:59:01,720: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-06-19T01:59:01.721329397Z [2024-06-19 01:59:01,720: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:59:01.738734151Z [2024-06-19 01:59:01,738: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T01:59:01.741866420Z [2024-06-19 01:59:01,741: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T01:59:01.777661392Z [2024-06-19 01:59:01,777: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T01:59:01.778992621Z [2024-06-19 01:59:01,778: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T01:59:01.779023955Z [2024-06-19 01:59:01,778: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T01:59:01.779056922Z [2024-06-19 01:59:01,778: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T01:59:01.779067803Z [2024-06-19 01:59:01,778: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T01:59:01.779304130Z [2024-06-19 01:59:01,779: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T01:59:01.779347844Z [2024-06-19 01:59:01,779: INFO/ForkPoolWorker-16] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T01:59:01.805753387Z [2024-06-19 01:59:01,805: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:59:01.909819825Z [2024-06-19 01:59:01,909: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T01:59:03.467660718Z [2024-06-19 01:59:03,467: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[989cf761-91e7-4bb2-a84e-bb0dd55cd427] succeeded in 3.1874921020007605s: None 2024-06-19T01:59:03.822719229Z [2024-06-19 01:59:03,821: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[669c56ec-916c-44dc-9453-5ddaedcf5f25] succeeded in 3.550333168001089s: None 2024-06-19T02:00:00.469398849Z [2024-06-19 02:00:00,468: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[82abf182-e94d-4900-b256-10b8faf4deb2] received 2024-06-19T02:00:00.472083621Z [2024-06-19 02:00:00,471: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[61f74d0e-8f27-4873-8f2d-4002c290d9eb] received 2024-06-19T02:00:00.479643727Z [2024-06-19 02:00:00,479: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a78e4f27-b147-49f9-80eb-8d8062e235f3] received 2024-06-19T02:00:00.481047539Z [2024-06-19 02:00:00,480: INFO/ForkPoolWorker-16] [61f74d0e-8f27-4873-8f2d-4002c290d9eb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T02:00:00.481637591Z [2024-06-19 02:00:00,481: INFO/ForkPoolWorker-15] [82abf182-e94d-4900-b256-10b8faf4deb2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-19T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T02:00:00.492885712Z [2024-06-19 02:00:00,492: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e83e264f-1b5d-469d-ad31-49b8f41fce8c] received 2024-06-19T02:00:00.496379337Z [2024-06-19 02:00:00,496: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8a6ce62a-3d51-4f00-86de-467b02e45d39] received 2024-06-19T02:00:00.504762336Z [2024-06-19 02:00:00,504: INFO/ForkPoolWorker-2] [e83e264f-1b5d-469d-ad31-49b8f41fce8c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T02:00:00.509999575Z [2024-06-19 02:00:00,509: INFO/ForkPoolWorker-1] [a78e4f27-b147-49f9-80eb-8d8062e235f3] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-19T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-19T02:00:00.536924216Z [2024-06-19 02:00:00,536: INFO/ForkPoolWorker-3] [8a6ce62a-3d51-4f00-86de-467b02e45d39] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T02:00:00.839996503Z [2024-06-19 02:00:00,836: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T02:00:00.874141185Z [2024-06-19 02:00:00,868: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T02:00:00.900036122Z [2024-06-19 02:00:00,895: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T02:00:01.127621543Z [2024-06-19 02:00:01,123: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-19T02:00:01.220832642Z [2024-06-19 02:00:01,200: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T02:00:01.495359697Z [2024-06-19 02:00:01,495: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:00:01.519999011Z [2024-06-19 02:00:01,519: INFO/ForkPoolWorker-3] Getting SDNC list 2024-06-19T02:00:01.528179274Z [2024-06-19 02:00:01,527: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:00:01.571993044Z [2024-06-19 02:00:01,571: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-06-19T02:00:01.576658335Z [2024-06-19 02:00:01,576: INFO/ForkPoolWorker-3] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T02:00:01.576875105Z [2024-06-19 02:00:01,576: INFO/ForkPoolWorker-3] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T02:00:01.577028518Z [2024-06-19 02:00:01,576: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-06-19T02:00:01.577314970Z [2024-06-19 02:00:01,577: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T02:00:01.678053953Z [2024-06-19 02:00:01,677: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:00:02.223246817Z [2024-06-19 02:00:02,219: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a78e4f27-b147-49f9-80eb-8d8062e235f3] succeeded in 1.7286165799996525s: None 2024-06-19T02:00:02.523274016Z [2024-06-19 02:00:02,522: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T02:00:02.527801780Z [2024-06-19 02:00:02,527: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:00:02.542468857Z [2024-06-19 02:00:02,536: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T02:00:02.547517122Z [2024-06-19 02:00:02,546: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:00:02.558301524Z [2024-06-19 02:00:02,558: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T02:00:02.560039793Z [2024-06-19 02:00:02,559: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:00:02.560069153Z [2024-06-19 02:00:02,559: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:00:02.560398573Z [2024-06-19 02:00:02,559: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:00:02.560478169Z [2024-06-19 02:00:02,560: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T02:00:02.561034835Z [2024-06-19 02:00:02,560: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T02:00:02.561101733Z [2024-06-19 02:00:02,560: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:00:02.574328708Z [2024-06-19 02:00:02,574: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T02:00:02.576524659Z [2024-06-19 02:00:02,576: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:00:02.576588911Z [2024-06-19 02:00:02,576: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:00:02.576639096Z [2024-06-19 02:00:02,576: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:00:02.576691641Z [2024-06-19 02:00:02,576: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T02:00:02.580177516Z [2024-06-19 02:00:02,579: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-19T02:00:02.580228301Z [2024-06-19 02:00:02,580: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:00:02.598180800Z [2024-06-19 02:00:02,597: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[8a6ce62a-3d51-4f00-86de-467b02e45d39] succeeded in 2.095961924000221s: None 2024-06-19T02:00:02.630213747Z [2024-06-19 02:00:02,629: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-19T02:00:02.633441671Z [2024-06-19 02:00:02,633: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:00:02.656304413Z [2024-06-19 02:00:02,656: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T02:00:02.657973457Z [2024-06-19 02:00:02,657: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:00:02.658050698Z [2024-06-19 02:00:02,657: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:00:02.658095341Z [2024-06-19 02:00:02,657: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:00:02.658155446Z [2024-06-19 02:00:02,658: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-19T02:00:02.658747707Z [2024-06-19 02:00:02,658: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T02:00:02.658762778Z [2024-06-19 02:00:02,658: INFO/ForkPoolWorker-2] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:00:02.673234999Z [2024-06-19 02:00:02,672: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:00:02.685530842Z [2024-06-19 02:00:02,685: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:00:02.744563231Z [2024-06-19 02:00:02,744: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:00:03.213896757Z [2024-06-19 02:00:03,213: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[82abf182-e94d-4900-b256-10b8faf4deb2] succeeded in 2.7411004360001243s: None 2024-06-19T02:00:03.534338423Z [2024-06-19 02:00:03,533: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e30703c6-d085-4b02-972b-82fad6c2dbaa] received 2024-06-19T02:00:03.545432105Z [2024-06-19 02:00:03,544: INFO/ForkPoolWorker-15] [e30703c6-d085-4b02-972b-82fad6c2dbaa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'split_metrics', 'scheduled__2024-06-19T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T02:00:03.846071622Z [2024-06-19 02:00:03,842: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T02:00:04.199868874Z [2024-06-19 02:00:04,199: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[e83e264f-1b5d-469d-ad31-49b8f41fce8c] succeeded in 3.7031330919999164s: None 2024-06-19T02:00:04.611776618Z [2024-06-19 02:00:04,611: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[61f74d0e-8f27-4873-8f2d-4002c290d9eb] succeeded in 4.1371963799992955s: None 2024-06-19T02:00:04.987774349Z [2024-06-19 02:00:04,987: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T02:00:04.990888225Z [2024-06-19 02:00:04,990: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:00:05.012917941Z [2024-06-19 02:00:05,012: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T02:00:05.014651531Z [2024-06-19 02:00:05,014: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:00:05.014840251Z [2024-06-19 02:00:05,014: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:00:05.015352761Z [2024-06-19 02:00:05,015: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:00:05.015621627Z [2024-06-19 02:00:05,015: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T02:00:05.016152357Z [2024-06-19 02:00:05,015: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T02:00:05.016551014Z [2024-06-19 02:00:05,016: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:00:05.106459432Z [2024-06-19 02:00:05,106: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:00:05.810829806Z [2024-06-19 02:00:05,810: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e30703c6-d085-4b02-972b-82fad6c2dbaa] succeeded in 2.2740022739999404s: None 2024-06-19T02:00:06.024594018Z [2024-06-19 02:00:06,024: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d8041cd0-cbc1-48b3-8607-7f996ac55437] received 2024-06-19T02:00:06.034276893Z [2024-06-19 02:00:06,033: INFO/ForkPoolWorker-15] [d8041cd0-cbc1-48b3-8607-7f996ac55437] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'collect_metrics', 'scheduled__2024-06-19T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-19T02:00:06.338976016Z [2024-06-19 02:00:06,335: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T02:00:07.437957107Z [2024-06-19 02:00:07,437: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T02:00:07.442331280Z [2024-06-19 02:00:07,441: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:00:07.465009865Z [2024-06-19 02:00:07,464: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T02:00:07.466294486Z [2024-06-19 02:00:07,466: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:00:07.466318045Z [2024-06-19 02:00:07,466: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:00:07.466452918Z [2024-06-19 02:00:07,466: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:00:07.466539836Z [2024-06-19 02:00:07,466: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T02:00:07.466780553Z [2024-06-19 02:00:07,466: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T02:00:07.466791204Z [2024-06-19 02:00:07,466: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:00:07.558121518Z [2024-06-19 02:00:07,557: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:00:09.126048808Z [2024-06-19 02:00:09,125: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d8041cd0-cbc1-48b3-8607-7f996ac55437] succeeded in 3.0980777550012135s: None 2024-06-19T02:00:09.860459141Z [2024-06-19 02:00:09,860: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[73c97d2b-bdf2-4a64-84fb-d4af9d071c9a] received 2024-06-19T02:00:09.875461474Z [2024-06-19 02:00:09,875: INFO/ForkPoolWorker-15] [73c97d2b-bdf2-4a64-84fb-d4af9d071c9a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'send_prometheus', 'scheduled__2024-06-19T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T02:00:10.160950037Z [2024-06-19 02:00:10,151: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T02:00:11.208207021Z [2024-06-19 02:00:11,207: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T02:00:11.211393733Z [2024-06-19 02:00:11,210: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:00:11.233284029Z [2024-06-19 02:00:11,233: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T02:00:11.234618778Z [2024-06-19 02:00:11,234: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:00:11.234724537Z [2024-06-19 02:00:11,234: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:00:11.234910365Z [2024-06-19 02:00:11,234: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:00:11.235011118Z [2024-06-19 02:00:11,234: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T02:00:11.235269681Z [2024-06-19 02:00:11,235: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T02:00:11.235367977Z [2024-06-19 02:00:11,235: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:00:11.328250056Z [2024-06-19 02:00:11,327: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:00:11.945684014Z [2024-06-19 02:00:11,945: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[73c97d2b-bdf2-4a64-84fb-d4af9d071c9a] succeeded in 2.0759617229996365s: None 2024-06-19T02:01:00.301877281Z [2024-06-19 02:01:00,301: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d6cf21d2-6b26-423c-8ef1-63b101fbdd06] received 2024-06-19T02:01:00.307396190Z [2024-06-19 02:01:00,307: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[90b4691b-218e-46c3-96ee-32f6225c439b] received 2024-06-19T02:01:00.318122675Z [2024-06-19 02:01:00,317: INFO/ForkPoolWorker-15] [d6cf21d2-6b26-423c-8ef1-63b101fbdd06] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T02:01:00.319389541Z [2024-06-19 02:01:00,319: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[99ad5396-75bb-4240-ab52-56edae4bee8b] received 2024-06-19T02:01:00.324668771Z [2024-06-19 02:01:00,324: INFO/ForkPoolWorker-16] [90b4691b-218e-46c3-96ee-32f6225c439b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T02:01:00.340669158Z [2024-06-19 02:01:00,339: INFO/ForkPoolWorker-1] [99ad5396-75bb-4240-ab52-56edae4bee8b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T02:01:00.630391278Z [2024-06-19 02:01:00,627: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T02:01:00.665366075Z [2024-06-19 02:01:00,661: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T02:01:00.669137363Z [2024-06-19 02:01:00,665: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T02:01:00.835940151Z [2024-06-19 02:01:00,835: INFO/ForkPoolWorker-1] Getting SDNC list 2024-06-19T02:01:00.840532195Z [2024-06-19 02:01:00,840: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:01:00.861492381Z [2024-06-19 02:01:00,861: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T02:01:00.862516181Z [2024-06-19 02:01:00,862: INFO/ForkPoolWorker-1] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T02:01:00.862594659Z [2024-06-19 02:01:00,862: INFO/ForkPoolWorker-1] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T02:01:00.862637305Z [2024-06-19 02:01:00,862: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-06-19T02:01:00.862831869Z [2024-06-19 02:01:00,862: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T02:01:00.963360120Z [2024-06-19 02:01:00,963: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:01:01.527591500Z [2024-06-19 02:01:01,527: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[99ad5396-75bb-4240-ab52-56edae4bee8b] succeeded in 1.197295818999919s: None 2024-06-19T02:01:01.811515657Z [2024-06-19 02:01:01,811: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T02:01:01.814974530Z [2024-06-19 02:01:01,814: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:01:01.835350631Z [2024-06-19 02:01:01,835: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T02:01:01.837044720Z [2024-06-19 02:01:01,836: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:01:01.837241763Z [2024-06-19 02:01:01,836: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:01:01.837463966Z [2024-06-19 02:01:01,837: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:01:01.837597329Z [2024-06-19 02:01:01,837: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T02:01:01.838036744Z [2024-06-19 02:01:01,837: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T02:01:01.838187957Z [2024-06-19 02:01:01,838: INFO/ForkPoolWorker-16] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:01:01.934456670Z [2024-06-19 02:01:01,934: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:01:01.957933109Z [2024-06-19 02:01:01,957: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T02:01:01.961000175Z [2024-06-19 02:01:01,960: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:01:01.985851180Z [2024-06-19 02:01:01,985: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T02:01:01.987348797Z [2024-06-19 02:01:01,987: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:01:01.987529420Z [2024-06-19 02:01:01,987: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:01:01.987868483Z [2024-06-19 02:01:01,987: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:01:01.988013162Z [2024-06-19 02:01:01,987: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T02:01:01.988502080Z [2024-06-19 02:01:01,988: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-06-19T02:01:01.988649226Z [2024-06-19 02:01:01,988: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:01:02.072456830Z [2024-06-19 02:01:02,072: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:01:03.697695874Z [2024-06-19 02:01:03,697: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[90b4691b-218e-46c3-96ee-32f6225c439b] succeeded in 3.38799539700085s: None 2024-06-19T02:01:04.029487897Z [2024-06-19 02:01:04,028: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d6cf21d2-6b26-423c-8ef1-63b101fbdd06] succeeded in 3.725161364000087s: None 2024-06-19T02:02:00.241072295Z [2024-06-19 02:02:00,240: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cf514e5f-90e6-459f-8258-0f1a32e15df6] received 2024-06-19T02:02:00.247948241Z [2024-06-19 02:02:00,247: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f4f86933-6beb-4dd1-b8ef-e424d7720da7] received 2024-06-19T02:02:00.253410338Z [2024-06-19 02:02:00,253: INFO/ForkPoolWorker-15] [cf514e5f-90e6-459f-8258-0f1a32e15df6] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-19T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-19T02:02:00.262077463Z [2024-06-19 02:02:00,260: INFO/ForkPoolWorker-16] [f4f86933-6beb-4dd1-b8ef-e424d7720da7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T02:02:00.269799815Z [2024-06-19 02:02:00,269: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[705e3e43-f1f3-400f-b1a9-09020b47b1fb] received 2024-06-19T02:02:00.271238538Z [2024-06-19 02:02:00,271: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a202024d-27ed-4929-a7a3-ae260e7e4f1f] received 2024-06-19T02:02:00.285192683Z [2024-06-19 02:02:00,284: INFO/ForkPoolWorker-2] [a202024d-27ed-4929-a7a3-ae260e7e4f1f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T02:02:00.291590832Z [2024-06-19 02:02:00,291: INFO/ForkPoolWorker-1] [705e3e43-f1f3-400f-b1a9-09020b47b1fb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T02:02:00.609204670Z [2024-06-19 02:02:00,603: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T02:02:00.663635066Z [2024-06-19 02:02:00,659: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-19T02:02:00.694629238Z [2024-06-19 02:02:00,690: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T02:02:00.700176013Z [2024-06-19 02:02:00,690: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T02:02:00.890826529Z [2024-06-19 02:02:00,887: INFO/ForkPoolWorker-2] Getting SDNC list 2024-06-19T02:02:00.899950277Z [2024-06-19 02:02:00,893: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:02:00.941149253Z [2024-06-19 02:02:00,940: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T02:02:00.943788902Z [2024-06-19 02:02:00,943: INFO/ForkPoolWorker-2] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T02:02:00.943803767Z [2024-06-19 02:02:00,943: INFO/ForkPoolWorker-2] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T02:02:00.943807973Z [2024-06-19 02:02:00,943: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-06-19T02:02:00.943910933Z [2024-06-19 02:02:00,943: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T02:02:01.048788615Z [2024-06-19 02:02:01,048: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:02:01.049885731Z [2024-06-19 02:02:01,049: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:02:01.687337280Z [2024-06-19 02:02:01,686: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cf514e5f-90e6-459f-8258-0f1a32e15df6] succeeded in 1.444329744001152s: None 2024-06-19T02:02:01.983510705Z [2024-06-19 02:02:01,983: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a202024d-27ed-4929-a7a3-ae260e7e4f1f] succeeded in 1.7075093389994436s: None 2024-06-19T02:02:02.221177446Z [2024-06-19 02:02:02,217: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T02:02:02.226154592Z [2024-06-19 02:02:02,220: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:02:02.341473843Z [2024-06-19 02:02:02,341: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T02:02:02.348397478Z [2024-06-19 02:02:02,348: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:02:02.351450260Z [2024-06-19 02:02:02,348: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:02:02.351676928Z [2024-06-19 02:02:02,351: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:02:02.351775818Z [2024-06-19 02:02:02,351: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T02:02:02.354686894Z [2024-06-19 02:02:02,352: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-19T02:02:02.354977593Z [2024-06-19 02:02:02,354: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:02:02.446500023Z [2024-06-19 02:02:02,446: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:02:02.655757214Z [2024-06-19 02:02:02,655: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T02:02:02.659415949Z [2024-06-19 02:02:02,659: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:02:02.692718672Z [2024-06-19 02:02:02,692: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T02:02:02.694537025Z [2024-06-19 02:02:02,694: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:02:02.694553808Z [2024-06-19 02:02:02,694: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:02:02.694682190Z [2024-06-19 02:02:02,694: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:02:02.694705019Z [2024-06-19 02:02:02,694: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T02:02:02.694921188Z [2024-06-19 02:02:02,694: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T02:02:02.695022472Z [2024-06-19 02:02:02,694: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:02:02.790481458Z [2024-06-19 02:02:02,790: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:02:04.380130718Z [2024-06-19 02:02:04,379: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[705e3e43-f1f3-400f-b1a9-09020b47b1fb] succeeded in 4.096797918000448s: None 2024-06-19T02:02:04.415239283Z [2024-06-19 02:02:04,414: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f4f86933-6beb-4dd1-b8ef-e424d7720da7] succeeded in 4.161544051999954s: None 2024-06-19T02:03:01.210655362Z [2024-06-19 02:03:01,210: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d3e1294a-46aa-4f2a-aeb1-9a4f2e778c3d] received 2024-06-19T02:03:01.222056916Z [2024-06-19 02:03:01,221: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cd8d4a4a-7c69-445a-8996-0545446cada3] received 2024-06-19T02:03:01.224791819Z [2024-06-19 02:03:01,223: INFO/ForkPoolWorker-15] [d3e1294a-46aa-4f2a-aeb1-9a4f2e778c3d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T02:03:01.228571315Z [2024-06-19 02:03:01,228: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c58b5396-2cef-42b7-b39b-3b872aafeef0] received 2024-06-19T02:03:01.235497469Z [2024-06-19 02:03:01,235: INFO/ForkPoolWorker-16] [cd8d4a4a-7c69-445a-8996-0545446cada3] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T02:03:01.242282270Z [2024-06-19 02:03:01,242: INFO/ForkPoolWorker-1] [c58b5396-2cef-42b7-b39b-3b872aafeef0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T02:03:01.515247837Z [2024-06-19 02:03:01,511: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T02:03:01.520232635Z [2024-06-19 02:03:01,516: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T02:03:01.528844031Z [2024-06-19 02:03:01,525: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T02:03:01.671283979Z [2024-06-19 02:03:01,670: INFO/ForkPoolWorker-16] Getting SDNC list 2024-06-19T02:03:01.675171024Z [2024-06-19 02:03:01,674: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:03:01.698903504Z [2024-06-19 02:03:01,698: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T02:03:01.700179462Z [2024-06-19 02:03:01,699: INFO/ForkPoolWorker-16] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T02:03:01.700329574Z [2024-06-19 02:03:01,700: INFO/ForkPoolWorker-16] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T02:03:01.700444766Z [2024-06-19 02:03:01,700: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-06-19T02:03:01.700946569Z [2024-06-19 02:03:01,700: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T02:03:01.784591538Z [2024-06-19 02:03:01,784: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:03:02.613947180Z [2024-06-19 02:03:02,613: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[cd8d4a4a-7c69-445a-8996-0545446cada3] succeeded in 1.3876672290007264s: None 2024-06-19T02:03:02.770843390Z [2024-06-19 02:03:02,770: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T02:03:02.774241640Z [2024-06-19 02:03:02,773: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:03:02.795824248Z [2024-06-19 02:03:02,795: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T02:03:02.799152249Z [2024-06-19 02:03:02,798: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:03:02.799403467Z [2024-06-19 02:03:02,799: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T02:03:02.801276497Z [2024-06-19 02:03:02,801: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:03:02.801423782Z [2024-06-19 02:03:02,801: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:03:02.801705969Z [2024-06-19 02:03:02,801: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:03:02.801865221Z [2024-06-19 02:03:02,801: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T02:03:02.802277727Z [2024-06-19 02:03:02,802: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-06-19T02:03:02.802295289Z [2024-06-19 02:03:02,802: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:03:02.825228965Z [2024-06-19 02:03:02,825: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T02:03:02.826391649Z [2024-06-19 02:03:02,826: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:03:02.826470396Z [2024-06-19 02:03:02,826: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:03:02.826641433Z [2024-06-19 02:03:02,826: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:03:02.826702585Z [2024-06-19 02:03:02,826: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T02:03:02.826958179Z [2024-06-19 02:03:02,826: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T02:03:02.827029162Z [2024-06-19 02:03:02,826: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:03:02.883353489Z [2024-06-19 02:03:02,883: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:03:02.926824183Z [2024-06-19 02:03:02,926: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:03:04.943140845Z [2024-06-19 02:03:04,942: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c58b5396-2cef-42b7-b39b-3b872aafeef0] succeeded in 3.711012693000157s: None 2024-06-19T02:03:05.579426545Z [2024-06-19 02:03:05,578: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d3e1294a-46aa-4f2a-aeb1-9a4f2e778c3d] succeeded in 4.366301531999852s: None 2024-06-19T02:04:01.192383003Z [2024-06-19 02:04:01,192: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a1745f3b-cc12-4b8c-9ac7-93dc45f4f00a] received 2024-06-19T02:04:01.200651289Z [2024-06-19 02:04:01,200: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[93a4f12c-6e98-433b-8768-bf8bdf37e870] received 2024-06-19T02:04:01.202209463Z [2024-06-19 02:04:01,202: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ab661cc6-2c48-47f5-a3e5-6b6f91f3e02f] received 2024-06-19T02:04:01.203926202Z [2024-06-19 02:04:01,203: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[64c99ee9-b51d-45c2-88f5-e34a1f0644aa] received 2024-06-19T02:04:01.214610166Z [2024-06-19 02:04:01,213: INFO/ForkPoolWorker-2] [64c99ee9-b51d-45c2-88f5-e34a1f0644aa] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T02:04:01.215595071Z [2024-06-19 02:04:01,215: INFO/ForkPoolWorker-15] [a1745f3b-cc12-4b8c-9ac7-93dc45f4f00a] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-19T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-19T02:04:01.216068829Z [2024-06-19 02:04:01,215: INFO/ForkPoolWorker-1] [ab661cc6-2c48-47f5-a3e5-6b6f91f3e02f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T02:04:01.218382406Z [2024-06-19 02:04:01,217: INFO/ForkPoolWorker-16] [93a4f12c-6e98-433b-8768-bf8bdf37e870] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T02:04:01.546588307Z [2024-06-19 02:04:01,542: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T02:04:01.565692815Z [2024-06-19 02:04:01,562: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T02:04:01.641185477Z [2024-06-19 02:04:01,638: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T02:04:01.726520931Z [2024-06-19 02:04:01,723: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-19T02:04:01.729717850Z [2024-06-19 02:04:01,729: INFO/ForkPoolWorker-2] Getting SDNC list 2024-06-19T02:04:01.733473777Z [2024-06-19 02:04:01,733: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:04:01.766665388Z [2024-06-19 02:04:01,766: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T02:04:01.770194068Z [2024-06-19 02:04:01,769: INFO/ForkPoolWorker-2] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T02:04:01.770302621Z [2024-06-19 02:04:01,770: INFO/ForkPoolWorker-2] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T02:04:01.770592237Z [2024-06-19 02:04:01,770: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-06-19T02:04:01.770867370Z [2024-06-19 02:04:01,770: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T02:04:01.902318218Z [2024-06-19 02:04:01,902: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:04:02.050791874Z [2024-06-19 02:04:02,050: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:04:02.623621439Z [2024-06-19 02:04:02,623: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[64c99ee9-b51d-45c2-88f5-e34a1f0644aa] succeeded in 1.4175583159994858s: None 2024-06-19T02:04:02.784560394Z [2024-06-19 02:04:02,784: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a1745f3b-cc12-4b8c-9ac7-93dc45f4f00a] succeeded in 1.582302869999694s: None 2024-06-19T02:04:03.069314463Z [2024-06-19 02:04:03,068: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T02:04:03.072366733Z [2024-06-19 02:04:03,071: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:04:03.109006447Z [2024-06-19 02:04:03,105: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T02:04:03.109086002Z [2024-06-19 02:04:03,106: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:04:03.109107140Z [2024-06-19 02:04:03,106: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:04:03.109113778Z [2024-06-19 02:04:03,106: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:04:03.109118497Z [2024-06-19 02:04:03,106: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T02:04:03.109138209Z [2024-06-19 02:04:03,107: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-19T02:04:03.109142906Z [2024-06-19 02:04:03,107: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:04:03.236576102Z [2024-06-19 02:04:03,235: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:04:03.327924069Z [2024-06-19 02:04:03,327: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T02:04:03.331191895Z [2024-06-19 02:04:03,330: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:04:03.358141796Z [2024-06-19 02:04:03,357: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T02:04:03.359192363Z [2024-06-19 02:04:03,358: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:04:03.359305943Z [2024-06-19 02:04:03,359: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:04:03.359513040Z [2024-06-19 02:04:03,359: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:04:03.359644002Z [2024-06-19 02:04:03,359: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T02:04:03.360079948Z [2024-06-19 02:04:03,359: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T02:04:03.360231575Z [2024-06-19 02:04:03,360: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:04:03.445447163Z [2024-06-19 02:04:03,445: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:04:05.761530026Z [2024-06-19 02:04:05,761: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ab661cc6-2c48-47f5-a3e5-6b6f91f3e02f] succeeded in 4.55748014799974s: None 2024-06-19T02:04:05.920359974Z [2024-06-19 02:04:05,919: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[93a4f12c-6e98-433b-8768-bf8bdf37e870] succeeded in 4.715896587998941s: None 2024-06-19T02:05:00.356602667Z [2024-06-19 02:05:00,356: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bc7c11fc-a5ad-4c0d-9dc7-268830b1f749] received 2024-06-19T02:05:00.368782242Z [2024-06-19 02:05:00,368: INFO/ForkPoolWorker-15] [bc7c11fc-a5ad-4c0d-9dc7-268830b1f749] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-19T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T02:05:00.371894123Z [2024-06-19 02:05:00,367: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7c28a343-68aa-42c4-8ae0-5b4aa90fcb95] received 2024-06-19T02:05:00.380228608Z [2024-06-19 02:05:00,379: INFO/ForkPoolWorker-16] [7c28a343-68aa-42c4-8ae0-5b4aa90fcb95] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T02:05:00.384585604Z [2024-06-19 02:05:00,384: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6d1a49e7-2c86-47ce-8ee2-3277f4013d4b] received 2024-06-19T02:05:00.386107581Z [2024-06-19 02:05:00,385: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0575dff9-be8a-46b3-95fe-d7b9a72945fd] received 2024-06-19T02:05:00.403299551Z [2024-06-19 02:05:00,402: INFO/ForkPoolWorker-2] [0575dff9-be8a-46b3-95fe-d7b9a72945fd] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T02:05:00.408856318Z [2024-06-19 02:05:00,408: INFO/ForkPoolWorker-1] [6d1a49e7-2c86-47ce-8ee2-3277f4013d4b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T02:05:00.710556146Z [2024-06-19 02:05:00,703: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T02:05:00.731522452Z [2024-06-19 02:05:00,726: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T02:05:00.793662844Z [2024-06-19 02:05:00,790: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T02:05:00.890446506Z [2024-06-19 02:05:00,886: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T02:05:01.154237806Z [2024-06-19 02:05:01,153: INFO/ForkPoolWorker-2] Getting SDNC list 2024-06-19T02:05:01.158198275Z [2024-06-19 02:05:01,157: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:05:01.186333675Z [2024-06-19 02:05:01,186: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T02:05:01.188357899Z [2024-06-19 02:05:01,188: INFO/ForkPoolWorker-2] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T02:05:01.188586796Z [2024-06-19 02:05:01,188: INFO/ForkPoolWorker-2] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T02:05:01.188740512Z [2024-06-19 02:05:01,188: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-06-19T02:05:01.189027886Z [2024-06-19 02:05:01,188: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T02:05:01.302127407Z [2024-06-19 02:05:01,301: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:05:01.843458792Z [2024-06-19 02:05:01,843: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[0575dff9-be8a-46b3-95fe-d7b9a72945fd] succeeded in 1.4547684640001535s: None 2024-06-19T02:05:01.870238740Z [2024-06-19 02:05:01,869: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T02:05:01.873389966Z [2024-06-19 02:05:01,872: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:05:01.906016700Z [2024-06-19 02:05:01,905: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T02:05:01.907510565Z [2024-06-19 02:05:01,907: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:05:01.907558723Z [2024-06-19 02:05:01,907: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:05:01.907698716Z [2024-06-19 02:05:01,907: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:05:01.907814549Z [2024-06-19 02:05:01,907: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T02:05:01.908417024Z [2024-06-19 02:05:01,908: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-19T02:05:01.908500055Z [2024-06-19 02:05:01,908: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:05:01.924203304Z [2024-06-19 02:05:01,923: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T02:05:01.927413685Z [2024-06-19 02:05:01,927: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:05:01.949091897Z [2024-06-19 02:05:01,948: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T02:05:01.950202870Z [2024-06-19 02:05:01,950: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:05:01.950392111Z [2024-06-19 02:05:01,950: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:05:01.950592106Z [2024-06-19 02:05:01,950: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:05:01.950747538Z [2024-06-19 02:05:01,950: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T02:05:01.951146147Z [2024-06-19 02:05:01,950: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T02:05:01.951296930Z [2024-06-19 02:05:01,951: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:05:01.979856726Z [2024-06-19 02:05:01,979: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:05:02.046392730Z [2024-06-19 02:05:02,046: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:05:02.090755058Z [2024-06-19 02:05:02,090: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T02:05:02.094555188Z [2024-06-19 02:05:02,094: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:05:02.125852829Z [2024-06-19 02:05:02,125: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T02:05:02.130613727Z [2024-06-19 02:05:02,130: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:05:02.130745630Z [2024-06-19 02:05:02,130: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:05:02.130891554Z [2024-06-19 02:05:02,130: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:05:02.131008771Z [2024-06-19 02:05:02,130: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T02:05:02.131961794Z [2024-06-19 02:05:02,131: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T02:05:02.132087449Z [2024-06-19 02:05:02,131: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:05:02.306356105Z [2024-06-19 02:05:02,306: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:05:02.684080852Z [2024-06-19 02:05:02,683: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bc7c11fc-a5ad-4c0d-9dc7-268830b1f749] succeeded in 2.3247368249994906s: None 2024-06-19T02:05:03.302311219Z [2024-06-19 02:05:03,301: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[72d14966-a4d0-4d98-963a-222af9d39cfe] received 2024-06-19T02:05:03.311299328Z [2024-06-19 02:05:03,310: INFO/ForkPoolWorker-15] [72d14966-a4d0-4d98-963a-222af9d39cfe] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'split_metrics', 'scheduled__2024-06-19T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T02:05:03.587013257Z [2024-06-19 02:05:03,583: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T02:05:03.871790943Z [2024-06-19 02:05:03,871: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7c28a343-68aa-42c4-8ae0-5b4aa90fcb95] succeeded in 3.4974926089998917s: None 2024-06-19T02:05:03.898033011Z [2024-06-19 02:05:03,897: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6d1a49e7-2c86-47ce-8ee2-3277f4013d4b] succeeded in 3.510048565998659s: None 2024-06-19T02:05:04.792740952Z [2024-06-19 02:05:04,792: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T02:05:04.796214002Z [2024-06-19 02:05:04,795: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:05:04.819532282Z [2024-06-19 02:05:04,819: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T02:05:04.821115284Z [2024-06-19 02:05:04,820: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:05:04.821262941Z [2024-06-19 02:05:04,821: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:05:04.821489079Z [2024-06-19 02:05:04,821: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:05:04.821638572Z [2024-06-19 02:05:04,821: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T02:05:04.822694030Z [2024-06-19 02:05:04,822: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T02:05:04.822835470Z [2024-06-19 02:05:04,822: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:05:04.908578633Z [2024-06-19 02:05:04,908: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:05:05.647388084Z [2024-06-19 02:05:05,646: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[72d14966-a4d0-4d98-963a-222af9d39cfe] succeeded in 2.3421408320009505s: None 2024-06-19T02:05:06.045461031Z [2024-06-19 02:05:06,045: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[894a291b-cf31-4703-bdb0-a61a01167e8b] received 2024-06-19T02:05:06.054099245Z [2024-06-19 02:05:06,053: INFO/ForkPoolWorker-15] [894a291b-cf31-4703-bdb0-a61a01167e8b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'collect_metrics', 'scheduled__2024-06-19T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-19T02:05:06.312719708Z [2024-06-19 02:05:06,309: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T02:05:07.326066740Z [2024-06-19 02:05:07,325: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T02:05:07.329335356Z [2024-06-19 02:05:07,328: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:05:07.354045293Z [2024-06-19 02:05:07,353: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T02:05:07.355448836Z [2024-06-19 02:05:07,355: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:05:07.355473165Z [2024-06-19 02:05:07,355: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:05:07.355653053Z [2024-06-19 02:05:07,355: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:05:07.355838969Z [2024-06-19 02:05:07,355: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T02:05:07.356298357Z [2024-06-19 02:05:07,356: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T02:05:07.356501496Z [2024-06-19 02:05:07,356: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:05:07.455388286Z [2024-06-19 02:05:07,454: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:05:08.963513990Z [2024-06-19 02:05:08,963: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[64187eb3-51a7-407b-b73a-fe8be73548b4] received 2024-06-19T02:05:08.975527154Z [2024-06-19 02:05:08,975: INFO/ForkPoolWorker-16] [64187eb3-51a7-407b-b73a-fe8be73548b4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'send_prometheus', 'scheduled__2024-06-19T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T02:05:09.018623700Z [2024-06-19 02:05:09,018: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[894a291b-cf31-4703-bdb0-a61a01167e8b] succeeded in 2.970885017999535s: None 2024-06-19T02:05:09.233101753Z [2024-06-19 02:05:09,230: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T02:05:10.228163662Z [2024-06-19 02:05:10,227: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T02:05:10.231266087Z [2024-06-19 02:05:10,230: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:05:10.252001963Z [2024-06-19 02:05:10,251: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T02:05:10.253452489Z [2024-06-19 02:05:10,253: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:05:10.253471109Z [2024-06-19 02:05:10,253: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:05:10.253649532Z [2024-06-19 02:05:10,253: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:05:10.253671255Z [2024-06-19 02:05:10,253: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T02:05:10.254079658Z [2024-06-19 02:05:10,253: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T02:05:10.254100369Z [2024-06-19 02:05:10,254: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:05:10.352313628Z [2024-06-19 02:05:10,351: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:05:10.971608975Z [2024-06-19 02:05:10,971: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[64187eb3-51a7-407b-b73a-fe8be73548b4] succeeded in 2.0051752729996224s: None 2024-06-19T02:06:00.267208251Z [2024-06-19 02:06:00,266: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f95f27ff-0bb4-4f80-9cb9-956e2e336ca3] received 2024-06-19T02:06:00.273373869Z [2024-06-19 02:06:00,273: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[96acc683-ae46-4849-84d7-acb6c833f45d] received 2024-06-19T02:06:00.277169857Z [2024-06-19 02:06:00,276: INFO/ForkPoolWorker-15] [f95f27ff-0bb4-4f80-9cb9-956e2e336ca3] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-19T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-19T02:06:00.280342203Z [2024-06-19 02:06:00,280: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3b56a4b6-12ee-4269-8fb8-9276080306fb] received 2024-06-19T02:06:00.287836094Z [2024-06-19 02:06:00,281: INFO/ForkPoolWorker-16] [96acc683-ae46-4849-84d7-acb6c833f45d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T02:06:00.287852173Z [2024-06-19 02:06:00,286: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[08cbbd5e-16af-4df7-815e-bb9bc132a108] received 2024-06-19T02:06:00.288260955Z [2024-06-19 02:06:00,288: INFO/ForkPoolWorker-1] [3b56a4b6-12ee-4269-8fb8-9276080306fb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T02:06:00.296437004Z [2024-06-19 02:06:00,296: INFO/ForkPoolWorker-2] [08cbbd5e-16af-4df7-815e-bb9bc132a108] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T02:06:00.584984209Z [2024-06-19 02:06:00,581: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T02:06:00.594123424Z [2024-06-19 02:06:00,590: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-19T02:06:00.610143368Z [2024-06-19 02:06:00,606: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T02:06:00.653591217Z [2024-06-19 02:06:00,643: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T02:06:00.762007701Z [2024-06-19 02:06:00,761: INFO/ForkPoolWorker-2] Getting SDNC list 2024-06-19T02:06:00.765701256Z [2024-06-19 02:06:00,765: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:06:00.796621028Z [2024-06-19 02:06:00,796: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T02:06:00.798687216Z [2024-06-19 02:06:00,798: INFO/ForkPoolWorker-2] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T02:06:00.798845565Z [2024-06-19 02:06:00,798: INFO/ForkPoolWorker-2] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T02:06:00.798992541Z [2024-06-19 02:06:00,798: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-06-19T02:06:00.799285612Z [2024-06-19 02:06:00,799: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T02:06:00.889852081Z [2024-06-19 02:06:00,889: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:06:00.893870107Z [2024-06-19 02:06:00,893: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:06:01.458718657Z [2024-06-19 02:06:01,458: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[08cbbd5e-16af-4df7-815e-bb9bc132a108] succeeded in 1.1703833490009856s: None 2024-06-19T02:06:01.502079326Z [2024-06-19 02:06:01,501: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f95f27ff-0bb4-4f80-9cb9-956e2e336ca3] succeeded in 1.2327366280005663s: None 2024-06-19T02:06:01.844993647Z [2024-06-19 02:06:01,844: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T02:06:01.848102328Z [2024-06-19 02:06:01,847: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:06:01.871957420Z [2024-06-19 02:06:01,871: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T02:06:01.873906729Z [2024-06-19 02:06:01,873: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:06:01.874026421Z [2024-06-19 02:06:01,873: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:06:01.874229503Z [2024-06-19 02:06:01,873: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:06:01.874281476Z [2024-06-19 02:06:01,874: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T02:06:01.874616904Z [2024-06-19 02:06:01,874: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T02:06:01.875035575Z [2024-06-19 02:06:01,874: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:06:01.877521640Z [2024-06-19 02:06:01,877: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T02:06:01.881355597Z [2024-06-19 02:06:01,880: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:06:01.920750592Z [2024-06-19 02:06:01,919: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T02:06:01.922880728Z [2024-06-19 02:06:01,922: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:06:01.923144820Z [2024-06-19 02:06:01,922: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:06:01.923455149Z [2024-06-19 02:06:01,923: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:06:01.923673019Z [2024-06-19 02:06:01,923: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T02:06:01.924140571Z [2024-06-19 02:06:01,923: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-19T02:06:01.924411981Z [2024-06-19 02:06:01,924: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:06:01.970933264Z [2024-06-19 02:06:01,970: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:06:02.015841135Z [2024-06-19 02:06:02,015: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:06:03.499377422Z [2024-06-19 02:06:03,498: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3b56a4b6-12ee-4269-8fb8-9276080306fb] succeeded in 3.2171184979997633s: None 2024-06-19T02:06:03.873609468Z [2024-06-19 02:06:03,872: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[96acc683-ae46-4849-84d7-acb6c833f45d] succeeded in 3.5979304859993135s: None 2024-06-19T02:07:00.249874082Z [2024-06-19 02:07:00,249: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dd81be6a-ea26-4bd6-bed6-a29ad2666d3f] received 2024-06-19T02:07:00.256566545Z [2024-06-19 02:07:00,256: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bdd8e8a6-6a16-434c-ba33-f91b9ddadb25] received 2024-06-19T02:07:00.259494658Z [2024-06-19 02:07:00,259: INFO/ForkPoolWorker-15] [dd81be6a-ea26-4bd6-bed6-a29ad2666d3f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T02:07:00.272131052Z [2024-06-19 02:07:00,271: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6b2cbaf4-afe7-457d-8153-bfe526dfec39] received 2024-06-19T02:07:00.273761710Z [2024-06-19 02:07:00,273: INFO/ForkPoolWorker-16] [bdd8e8a6-6a16-434c-ba33-f91b9ddadb25] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T02:07:00.286829789Z [2024-06-19 02:07:00,286: INFO/ForkPoolWorker-1] [6b2cbaf4-afe7-457d-8153-bfe526dfec39] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T02:07:00.558632422Z [2024-06-19 02:07:00,555: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T02:07:00.570185122Z [2024-06-19 02:07:00,567: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T02:07:00.591121851Z [2024-06-19 02:07:00,588: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T02:07:00.702205957Z [2024-06-19 02:07:00,701: INFO/ForkPoolWorker-16] Getting SDNC list 2024-06-19T02:07:00.705587908Z [2024-06-19 02:07:00,705: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:07:00.746857891Z [2024-06-19 02:07:00,746: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T02:07:00.748550416Z [2024-06-19 02:07:00,748: INFO/ForkPoolWorker-16] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T02:07:00.748745993Z [2024-06-19 02:07:00,748: INFO/ForkPoolWorker-16] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T02:07:00.748896576Z [2024-06-19 02:07:00,748: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-06-19T02:07:00.749285269Z [2024-06-19 02:07:00,749: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T02:07:00.866051739Z [2024-06-19 02:07:00,865: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:07:01.452768028Z [2024-06-19 02:07:01,452: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[bdd8e8a6-6a16-434c-ba33-f91b9ddadb25] succeeded in 1.1946167269998114s: None 2024-06-19T02:07:01.662470163Z [2024-06-19 02:07:01,662: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T02:07:01.665697641Z [2024-06-19 02:07:01,665: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:07:01.685686687Z [2024-06-19 02:07:01,685: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T02:07:01.686960022Z [2024-06-19 02:07:01,686: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:07:01.687112471Z [2024-06-19 02:07:01,686: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:07:01.687333782Z [2024-06-19 02:07:01,687: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:07:01.687454919Z [2024-06-19 02:07:01,687: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T02:07:01.687807597Z [2024-06-19 02:07:01,687: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-06-19T02:07:01.687877519Z [2024-06-19 02:07:01,687: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:07:01.709418645Z [2024-06-19 02:07:01,709: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T02:07:01.713747369Z [2024-06-19 02:07:01,713: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:07:01.742266135Z [2024-06-19 02:07:01,742: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T02:07:01.743523547Z [2024-06-19 02:07:01,743: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:07:01.743545826Z [2024-06-19 02:07:01,743: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:07:01.743746084Z [2024-06-19 02:07:01,743: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:07:01.743794688Z [2024-06-19 02:07:01,743: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T02:07:01.744029431Z [2024-06-19 02:07:01,743: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T02:07:01.744040949Z [2024-06-19 02:07:01,743: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:07:01.771866799Z [2024-06-19 02:07:01,771: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:07:01.838882179Z [2024-06-19 02:07:01,838: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:07:03.469872261Z [2024-06-19 02:07:03,469: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6b2cbaf4-afe7-457d-8153-bfe526dfec39] succeeded in 3.1895552890000545s: None 2024-06-19T02:07:03.686872538Z [2024-06-19 02:07:03,686: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[dd81be6a-ea26-4bd6-bed6-a29ad2666d3f] succeeded in 3.4352860620001593s: None 2024-06-19T02:08:01.036286387Z [2024-06-19 02:08:01,035: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[65fe1fd1-1b50-48b6-9d71-7636f464bb4e] received 2024-06-19T02:08:01.039394870Z [2024-06-19 02:08:01,038: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e2e64382-d04a-49ad-a205-ac105719854b] received 2024-06-19T02:08:01.043954039Z [2024-06-19 02:08:01,043: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[62e362ac-db69-4ee6-a944-971f4cf9c1a2] received 2024-06-19T02:08:01.047125695Z [2024-06-19 02:08:01,046: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d584d7fc-95b0-4ae3-b116-95c1fbdcc055] received 2024-06-19T02:08:01.049556622Z [2024-06-19 02:08:01,049: INFO/ForkPoolWorker-15] [65fe1fd1-1b50-48b6-9d71-7636f464bb4e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T02:08:01.059126784Z [2024-06-19 02:08:01,058: INFO/ForkPoolWorker-16] [e2e64382-d04a-49ad-a205-ac105719854b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T02:08:01.070493832Z [2024-06-19 02:08:01,070: INFO/ForkPoolWorker-2] [d584d7fc-95b0-4ae3-b116-95c1fbdcc055] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T02:08:01.071238293Z [2024-06-19 02:08:01,070: INFO/ForkPoolWorker-1] [62e362ac-db69-4ee6-a944-971f4cf9c1a2] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-19T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-19T02:08:01.398986695Z [2024-06-19 02:08:01,383: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T02:08:01.424144724Z [2024-06-19 02:08:01,420: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-19T02:08:01.456236921Z [2024-06-19 02:08:01,452: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T02:08:01.476231937Z [2024-06-19 02:08:01,461: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T02:08:01.584515094Z [2024-06-19 02:08:01,584: INFO/ForkPoolWorker-16] Getting SDNC list 2024-06-19T02:08:01.589028781Z [2024-06-19 02:08:01,588: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:08:01.628569393Z [2024-06-19 02:08:01,628: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T02:08:01.641967091Z [2024-06-19 02:08:01,640: INFO/ForkPoolWorker-16] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T02:08:01.643201900Z [2024-06-19 02:08:01,641: INFO/ForkPoolWorker-16] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T02:08:01.643475912Z [2024-06-19 02:08:01,643: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-06-19T02:08:01.648486062Z [2024-06-19 02:08:01,648: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T02:08:01.678110513Z [2024-06-19 02:08:01,677: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:08:01.738443405Z [2024-06-19 02:08:01,738: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:08:02.377037094Z [2024-06-19 02:08:02,376: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[62e362ac-db69-4ee6-a944-971f4cf9c1a2] succeeded in 1.3247903520004911s: None 2024-06-19T02:08:02.395091483Z [2024-06-19 02:08:02,394: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e2e64382-d04a-49ad-a205-ac105719854b] succeeded in 1.3511365450012818s: None 2024-06-19T02:08:02.746567421Z [2024-06-19 02:08:02,746: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-19T02:08:02.749769722Z [2024-06-19 02:08:02,749: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:08:02.785988221Z [2024-06-19 02:08:02,785: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T02:08:02.788340676Z [2024-06-19 02:08:02,788: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:08:02.788489426Z [2024-06-19 02:08:02,788: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:08:02.788876398Z [2024-06-19 02:08:02,788: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:08:02.789231343Z [2024-06-19 02:08:02,788: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-19T02:08:02.789769575Z [2024-06-19 02:08:02,789: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-06-19T02:08:02.789935043Z [2024-06-19 02:08:02,789: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:08:02.792758893Z [2024-06-19 02:08:02,792: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T02:08:02.795837215Z [2024-06-19 02:08:02,795: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:08:02.823162617Z [2024-06-19 02:08:02,822: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T02:08:02.825079151Z [2024-06-19 02:08:02,824: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:08:02.825091959Z [2024-06-19 02:08:02,824: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:08:02.825262237Z [2024-06-19 02:08:02,825: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:08:02.825297249Z [2024-06-19 02:08:02,825: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T02:08:02.825585179Z [2024-06-19 02:08:02,825: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T02:08:02.825681266Z [2024-06-19 02:08:02,825: INFO/ForkPoolWorker-15] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:08:02.896386488Z [2024-06-19 02:08:02,895: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:08:02.922657847Z [2024-06-19 02:08:02,922: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:08:04.975248662Z [2024-06-19 02:08:04,974: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[65fe1fd1-1b50-48b6-9d71-7636f464bb4e] succeeded in 3.9332658469993476s: None 2024-06-19T02:08:05.623987119Z [2024-06-19 02:08:05,623: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d584d7fc-95b0-4ae3-b116-95c1fbdcc055] succeeded in 4.5619409660012025s: None 2024-06-19T02:09:00.986792823Z [2024-06-19 02:09:00,986: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c4910eaa-b3d0-4946-aed1-285df32ce27d] received 2024-06-19T02:09:00.997257044Z [2024-06-19 02:09:00,996: INFO/ForkPoolWorker-15] [c4910eaa-b3d0-4946-aed1-285df32ce27d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T02:09:00.998542000Z [2024-06-19 02:09:00,998: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c7e48dbd-1519-4e5c-afae-8dee70011334] received 2024-06-19T02:09:01.010102602Z [2024-06-19 02:09:01,009: INFO/ForkPoolWorker-16] [c7e48dbd-1519-4e5c-afae-8dee70011334] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T02:09:01.020351331Z [2024-06-19 02:09:01,020: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7ea30c33-3d33-44f2-b149-ee728bd6ed50] received 2024-06-19T02:09:01.033241299Z [2024-06-19 02:09:01,032: INFO/ForkPoolWorker-1] [7ea30c33-3d33-44f2-b149-ee728bd6ed50] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T02:09:01.303075912Z [2024-06-19 02:09:01,299: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T02:09:01.310833909Z [2024-06-19 02:09:01,307: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T02:09:01.319975024Z [2024-06-19 02:09:01,316: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T02:09:01.473629790Z [2024-06-19 02:09:01,473: INFO/ForkPoolWorker-1] Getting SDNC list 2024-06-19T02:09:01.477558127Z [2024-06-19 02:09:01,477: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:09:01.503997082Z [2024-06-19 02:09:01,503: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T02:09:01.505438370Z [2024-06-19 02:09:01,505: INFO/ForkPoolWorker-1] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T02:09:01.505561285Z [2024-06-19 02:09:01,505: INFO/ForkPoolWorker-1] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T02:09:01.505693148Z [2024-06-19 02:09:01,505: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-06-19T02:09:01.506115314Z [2024-06-19 02:09:01,505: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T02:09:01.611911057Z [2024-06-19 02:09:01,611: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:09:02.369839962Z [2024-06-19 02:09:02,369: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7ea30c33-3d33-44f2-b149-ee728bd6ed50] succeeded in 1.3449316379992524s: None 2024-06-19T02:09:02.540097124Z [2024-06-19 02:09:02,539: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T02:09:02.543775856Z [2024-06-19 02:09:02,543: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:09:02.561614350Z [2024-06-19 02:09:02,561: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T02:09:02.562684125Z [2024-06-19 02:09:02,562: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:09:02.562712302Z [2024-06-19 02:09:02,562: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:09:02.562843553Z [2024-06-19 02:09:02,562: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:09:02.562927967Z [2024-06-19 02:09:02,562: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T02:09:02.563153118Z [2024-06-19 02:09:02,563: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T02:09:02.563173301Z [2024-06-19 02:09:02,563: INFO/ForkPoolWorker-16] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:09:02.612822445Z [2024-06-19 02:09:02,612: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T02:09:02.615944453Z [2024-06-19 02:09:02,615: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:09:02.632015312Z [2024-06-19 02:09:02,631: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T02:09:02.633094487Z [2024-06-19 02:09:02,632: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:09:02.633110500Z [2024-06-19 02:09:02,633: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:09:02.633251605Z [2024-06-19 02:09:02,633: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:09:02.633271573Z [2024-06-19 02:09:02,633: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T02:09:02.633459903Z [2024-06-19 02:09:02,633: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-06-19T02:09:02.633475891Z [2024-06-19 02:09:02,633: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:09:02.667490819Z [2024-06-19 02:09:02,667: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:09:02.717946168Z [2024-06-19 02:09:02,717: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:09:04.552900601Z [2024-06-19 02:09:04,552: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c7e48dbd-1519-4e5c-afae-8dee70011334] succeeded in 3.551948424999864s: None 2024-06-19T02:09:05.306837658Z [2024-06-19 02:09:05,306: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c4910eaa-b3d0-4946-aed1-285df32ce27d] succeeded in 4.316987267000513s: None 2024-06-19T02:10:00.696661872Z [2024-06-19 02:10:00,696: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[46bdc9cc-0038-4eec-a2c3-25e0c0b6791b] received 2024-06-19T02:10:00.702175167Z [2024-06-19 02:10:00,702: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[96144f99-c4a4-44af-9f4d-30eb46be5c44] received 2024-06-19T02:10:00.708981934Z [2024-06-19 02:10:00,708: INFO/ForkPoolWorker-15] [46bdc9cc-0038-4eec-a2c3-25e0c0b6791b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T02:10:00.713202442Z [2024-06-19 02:10:00,712: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0235f05d-5746-4a7d-87fc-742010bc5c27] received 2024-06-19T02:10:00.713805822Z [2024-06-19 02:10:00,713: INFO/ForkPoolWorker-16] [96144f99-c4a4-44af-9f4d-30eb46be5c44] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-19T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T02:10:00.721067600Z [2024-06-19 02:10:00,720: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[67720dc4-50fe-4482-851b-c41ee72c9d76] received 2024-06-19T02:10:00.729697804Z [2024-06-19 02:10:00,729: INFO/ForkPoolWorker-1] [0235f05d-5746-4a7d-87fc-742010bc5c27] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T02:10:00.734653087Z [2024-06-19 02:10:00,734: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[df6fe115-1263-429f-8e73-2d47c0dd0d8f] received 2024-06-19T02:10:00.743877254Z [2024-06-19 02:10:00,743: INFO/ForkPoolWorker-2] [67720dc4-50fe-4482-851b-c41ee72c9d76] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-19T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-19T02:10:00.744529513Z [2024-06-19 02:10:00,744: INFO/ForkPoolWorker-3] [df6fe115-1263-429f-8e73-2d47c0dd0d8f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T02:10:01.027975534Z [2024-06-19 02:10:01,024: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T02:10:01.038819856Z [2024-06-19 02:10:01,035: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T02:10:01.125956628Z [2024-06-19 02:10:01,112: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-19T02:10:01.198724047Z [2024-06-19 02:10:01,198: INFO/ForkPoolWorker-3] Getting SDNC list 2024-06-19T02:10:01.200660481Z [2024-06-19 02:10:01,197: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T02:10:01.202823414Z [2024-06-19 02:10:01,202: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:10:01.257117779Z [2024-06-19 02:10:01,256: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-06-19T02:10:01.261125013Z [2024-06-19 02:10:01,260: INFO/ForkPoolWorker-3] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T02:10:01.261188645Z [2024-06-19 02:10:01,261: INFO/ForkPoolWorker-3] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T02:10:01.261194359Z [2024-06-19 02:10:01,261: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-06-19T02:10:01.261372910Z [2024-06-19 02:10:01,261: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T02:10:01.345825133Z [2024-06-19 02:10:01,337: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T02:10:01.410341418Z [2024-06-19 02:10:01,410: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:10:01.554550798Z [2024-06-19 02:10:01,554: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:10:02.080388607Z [2024-06-19 02:10:02,079: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[df6fe115-1263-429f-8e73-2d47c0dd0d8f] succeeded in 1.3379216860012093s: None 2024-06-19T02:10:02.530520398Z [2024-06-19 02:10:02,530: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[67720dc4-50fe-4482-851b-c41ee72c9d76] succeeded in 1.7929602089989203s: None 2024-06-19T02:10:02.784056795Z [2024-06-19 02:10:02,783: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T02:10:02.790756623Z [2024-06-19 02:10:02,790: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:10:02.849466936Z [2024-06-19 02:10:02,849: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T02:10:02.854415515Z [2024-06-19 02:10:02,854: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:10:02.854471160Z [2024-06-19 02:10:02,854: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:10:02.854665701Z [2024-06-19 02:10:02,854: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:10:02.854686821Z [2024-06-19 02:10:02,854: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T02:10:02.854928840Z [2024-06-19 02:10:02,854: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-06-19T02:10:02.854940795Z [2024-06-19 02:10:02,854: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:10:02.941337348Z [2024-06-19 02:10:02,940: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T02:10:02.945069447Z [2024-06-19 02:10:02,944: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:10:02.961368274Z [2024-06-19 02:10:02,961: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:10:02.991767853Z [2024-06-19 02:10:02,991: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T02:10:02.997319665Z [2024-06-19 02:10:02,997: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:10:02.997344938Z [2024-06-19 02:10:02,997: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:10:02.997602096Z [2024-06-19 02:10:02,997: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:10:02.997718191Z [2024-06-19 02:10:02,997: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T02:10:02.998076954Z [2024-06-19 02:10:02,997: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T02:10:02.998345173Z [2024-06-19 02:10:02,998: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:10:03.084241300Z [2024-06-19 02:10:03,083: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:10:03.124168663Z [2024-06-19 02:10:03,123: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T02:10:03.127403549Z [2024-06-19 02:10:03,126: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:10:03.159868971Z [2024-06-19 02:10:03,159: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T02:10:03.161759097Z [2024-06-19 02:10:03,161: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:10:03.161949111Z [2024-06-19 02:10:03,161: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:10:03.162222611Z [2024-06-19 02:10:03,161: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:10:03.162401111Z [2024-06-19 02:10:03,162: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T02:10:03.162770389Z [2024-06-19 02:10:03,162: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T02:10:03.163468304Z [2024-06-19 02:10:03,162: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:10:03.281797271Z [2024-06-19 02:10:03,281: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:10:03.887071017Z [2024-06-19 02:10:03,886: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[96144f99-c4a4-44af-9f4d-30eb46be5c44] succeeded in 3.182778125999903s: None 2024-06-19T02:10:04.104626577Z [2024-06-19 02:10:04,104: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e0c3b543-8e6b-4617-aeaa-4263b6b0a43b] received 2024-06-19T02:10:04.118497255Z [2024-06-19 02:10:04,118: INFO/ForkPoolWorker-16] [e0c3b543-8e6b-4617-aeaa-4263b6b0a43b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'split_metrics', 'scheduled__2024-06-19T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T02:10:04.418418798Z [2024-06-19 02:10:04,415: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T02:10:04.726994252Z [2024-06-19 02:10:04,726: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0235f05d-5746-4a7d-87fc-742010bc5c27] succeeded in 4.0064977960009855s: None 2024-06-19T02:10:04.920963696Z [2024-06-19 02:10:04,920: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[46bdc9cc-0038-4eec-a2c3-25e0c0b6791b] succeeded in 4.222174903999985s: None 2024-06-19T02:10:05.608550029Z [2024-06-19 02:10:05,608: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T02:10:05.611554558Z [2024-06-19 02:10:05,611: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:10:05.634009379Z [2024-06-19 02:10:05,633: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T02:10:05.635217141Z [2024-06-19 02:10:05,635: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:10:05.635284966Z [2024-06-19 02:10:05,635: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:10:05.635426444Z [2024-06-19 02:10:05,635: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:10:05.635436490Z [2024-06-19 02:10:05,635: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T02:10:05.635657054Z [2024-06-19 02:10:05,635: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T02:10:05.635743531Z [2024-06-19 02:10:05,635: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:10:05.742137393Z [2024-06-19 02:10:05,741: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:10:06.467319843Z [2024-06-19 02:10:06,466: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e0c3b543-8e6b-4617-aeaa-4263b6b0a43b] succeeded in 2.354123400999015s: None 2024-06-19T02:10:06.488776181Z [2024-06-19 02:10:06,488: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4a0742ce-9c6b-4767-9014-6ebfc9f1ba0e] received 2024-06-19T02:10:06.499668165Z [2024-06-19 02:10:06,499: INFO/ForkPoolWorker-15] [4a0742ce-9c6b-4767-9014-6ebfc9f1ba0e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'collect_metrics', 'scheduled__2024-06-19T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-19T02:10:06.767860750Z [2024-06-19 02:10:06,763: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T02:10:07.795895459Z [2024-06-19 02:10:07,795: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T02:10:07.799937448Z [2024-06-19 02:10:07,798: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:10:07.817429499Z [2024-06-19 02:10:07,816: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T02:10:07.818256257Z [2024-06-19 02:10:07,818: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:10:07.818402857Z [2024-06-19 02:10:07,818: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:10:07.818579309Z [2024-06-19 02:10:07,818: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:10:07.818677744Z [2024-06-19 02:10:07,818: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T02:10:07.818949331Z [2024-06-19 02:10:07,818: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T02:10:07.819050534Z [2024-06-19 02:10:07,818: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:10:07.912034486Z [2024-06-19 02:10:07,910: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:10:09.510958783Z [2024-06-19 02:10:09,510: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4a0742ce-9c6b-4767-9014-6ebfc9f1ba0e] succeeded in 3.0192363830010436s: None 2024-06-19T02:10:10.290485290Z [2024-06-19 02:10:10,289: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d984033c-496e-4e77-b1ab-27e6ea508f0d] received 2024-06-19T02:10:10.297525831Z [2024-06-19 02:10:10,297: INFO/ForkPoolWorker-15] [d984033c-496e-4e77-b1ab-27e6ea508f0d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'send_prometheus', 'scheduled__2024-06-19T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T02:10:10.613330057Z [2024-06-19 02:10:10,609: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T02:10:11.778631665Z [2024-06-19 02:10:11,778: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T02:10:11.783316542Z [2024-06-19 02:10:11,781: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:10:11.806078858Z [2024-06-19 02:10:11,805: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T02:10:11.807468995Z [2024-06-19 02:10:11,807: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:10:11.807974827Z [2024-06-19 02:10:11,807: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:10:11.808151117Z [2024-06-19 02:10:11,807: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:10:11.808329079Z [2024-06-19 02:10:11,808: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T02:10:11.809095730Z [2024-06-19 02:10:11,808: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T02:10:11.809382798Z [2024-06-19 02:10:11,809: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:10:11.952034556Z [2024-06-19 02:10:11,951: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:10:12.533181481Z [2024-06-19 02:10:12,532: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d984033c-496e-4e77-b1ab-27e6ea508f0d] succeeded in 2.2402189089989406s: None 2024-06-19T02:11:00.803321770Z [2024-06-19 02:11:00,802: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d2125af6-3a44-436c-b95c-c2b6ad72b391] received 2024-06-19T02:11:00.811682603Z [2024-06-19 02:11:00,811: INFO/ForkPoolWorker-15] [d2125af6-3a44-436c-b95c-c2b6ad72b391] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T02:11:00.830853563Z [2024-06-19 02:11:00,830: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c482b3b2-80a5-4bd9-8b30-3de52ea40e2e] received 2024-06-19T02:11:00.832756924Z [2024-06-19 02:11:00,832: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[218ec27d-58a4-42ab-8c58-3f64923b0040] received 2024-06-19T02:11:00.845514750Z [2024-06-19 02:11:00,845: INFO/ForkPoolWorker-16] [c482b3b2-80a5-4bd9-8b30-3de52ea40e2e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T02:11:00.852421960Z [2024-06-19 02:11:00,852: INFO/ForkPoolWorker-1] [218ec27d-58a4-42ab-8c58-3f64923b0040] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T02:11:01.168229840Z [2024-06-19 02:11:01,165: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T02:11:01.172556776Z [2024-06-19 02:11:01,169: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T02:11:01.213003851Z [2024-06-19 02:11:01,208: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T02:11:01.379539879Z [2024-06-19 02:11:01,379: INFO/ForkPoolWorker-1] Getting SDNC list 2024-06-19T02:11:01.383890555Z [2024-06-19 02:11:01,383: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:11:01.402831964Z [2024-06-19 02:11:01,402: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T02:11:01.403891525Z [2024-06-19 02:11:01,403: INFO/ForkPoolWorker-1] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T02:11:01.404033560Z [2024-06-19 02:11:01,403: INFO/ForkPoolWorker-1] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T02:11:01.404382889Z [2024-06-19 02:11:01,404: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-06-19T02:11:01.404848496Z [2024-06-19 02:11:01,404: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T02:11:01.518157019Z [2024-06-19 02:11:01,517: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:11:02.216302841Z [2024-06-19 02:11:02,215: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[218ec27d-58a4-42ab-8c58-3f64923b0040] succeeded in 1.3811916169997858s: None 2024-06-19T02:11:02.320523451Z [2024-06-19 02:11:02,315: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T02:11:02.320551754Z [2024-06-19 02:11:02,318: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:11:02.396329155Z [2024-06-19 02:11:02,396: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T02:11:02.404544621Z [2024-06-19 02:11:02,404: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:11:02.404649233Z [2024-06-19 02:11:02,404: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:11:02.404742248Z [2024-06-19 02:11:02,404: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:11:02.404837203Z [2024-06-19 02:11:02,404: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T02:11:02.405122763Z [2024-06-19 02:11:02,404: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T02:11:02.405190436Z [2024-06-19 02:11:02,405: INFO/ForkPoolWorker-16] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:11:02.505218318Z [2024-06-19 02:11:02,504: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:11:02.568841211Z [2024-06-19 02:11:02,568: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T02:11:02.572058611Z [2024-06-19 02:11:02,571: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:11:02.609104778Z [2024-06-19 02:11:02,608: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T02:11:02.610248473Z [2024-06-19 02:11:02,610: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:11:02.610265553Z [2024-06-19 02:11:02,610: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:11:02.610431235Z [2024-06-19 02:11:02,610: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:11:02.610435907Z [2024-06-19 02:11:02,610: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T02:11:02.610704137Z [2024-06-19 02:11:02,610: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-06-19T02:11:02.610834306Z [2024-06-19 02:11:02,610: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:11:02.752445180Z [2024-06-19 02:11:02,752: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:11:04.036237152Z [2024-06-19 02:11:04,035: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c482b3b2-80a5-4bd9-8b30-3de52ea40e2e] succeeded in 3.20180672800052s: None 2024-06-19T02:11:05.108046760Z [2024-06-19 02:11:05,107: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d2125af6-3a44-436c-b95c-c2b6ad72b391] succeeded in 4.302168599000652s: None 2024-06-19T02:12:00.801283835Z [2024-06-19 02:12:00,800: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[382087fe-040a-4a58-a281-f0255b999d85] received 2024-06-19T02:12:00.803534041Z [2024-06-19 02:12:00,803: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b408f696-657f-470e-8fa3-6bd316c44e0f] received 2024-06-19T02:12:00.817322264Z [2024-06-19 02:12:00,816: INFO/ForkPoolWorker-15] [382087fe-040a-4a58-a281-f0255b999d85] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-19T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-19T02:12:00.817640424Z [2024-06-19 02:12:00,817: INFO/ForkPoolWorker-16] [b408f696-657f-470e-8fa3-6bd316c44e0f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T02:12:00.818108620Z [2024-06-19 02:12:00,817: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b547dc5f-2e55-42de-81b3-65a038cc4e34] received 2024-06-19T02:12:00.820592214Z [2024-06-19 02:12:00,820: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[072850ba-1ba5-43a2-ace8-cc6c81aa64e1] received 2024-06-19T02:12:00.832202606Z [2024-06-19 02:12:00,831: INFO/ForkPoolWorker-1] [b547dc5f-2e55-42de-81b3-65a038cc4e34] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T02:12:00.840616782Z [2024-06-19 02:12:00,840: INFO/ForkPoolWorker-2] [072850ba-1ba5-43a2-ace8-cc6c81aa64e1] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T02:12:01.128559086Z [2024-06-19 02:12:01,125: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T02:12:01.215724889Z [2024-06-19 02:12:01,211: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T02:12:01.323799718Z [2024-06-19 02:12:01,313: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-19T02:12:01.347551824Z [2024-06-19 02:12:01,343: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T02:12:01.496207537Z [2024-06-19 02:12:01,495: INFO/ForkPoolWorker-2] Getting SDNC list 2024-06-19T02:12:01.501102158Z [2024-06-19 02:12:01,500: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:12:01.533067318Z [2024-06-19 02:12:01,532: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T02:12:01.550602518Z [2024-06-19 02:12:01,550: INFO/ForkPoolWorker-2] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T02:12:01.552080760Z [2024-06-19 02:12:01,550: INFO/ForkPoolWorker-2] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T02:12:01.552095920Z [2024-06-19 02:12:01,550: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-06-19T02:12:01.552101013Z [2024-06-19 02:12:01,551: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T02:12:01.630487589Z [2024-06-19 02:12:01,628: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:12:01.717051573Z [2024-06-19 02:12:01,716: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:12:02.362308008Z [2024-06-19 02:12:02,361: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[382087fe-040a-4a58-a281-f0255b999d85] succeeded in 1.5577353030002996s: None 2024-06-19T02:12:02.457171181Z [2024-06-19 02:12:02,456: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[072850ba-1ba5-43a2-ace8-cc6c81aa64e1] succeeded in 1.6340489269987302s: None 2024-06-19T02:12:02.651188212Z [2024-06-19 02:12:02,650: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T02:12:02.654456275Z [2024-06-19 02:12:02,654: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:12:02.656022875Z [2024-06-19 02:12:02,655: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T02:12:02.660073932Z [2024-06-19 02:12:02,659: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:12:02.673143890Z [2024-06-19 02:12:02,672: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T02:12:02.674476205Z [2024-06-19 02:12:02,674: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:12:02.674557461Z [2024-06-19 02:12:02,674: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:12:02.674687205Z [2024-06-19 02:12:02,674: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:12:02.674775086Z [2024-06-19 02:12:02,674: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T02:12:02.674998957Z [2024-06-19 02:12:02,674: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-19T02:12:02.675114654Z [2024-06-19 02:12:02,675: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:12:02.682519169Z [2024-06-19 02:12:02,682: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T02:12:02.683817013Z [2024-06-19 02:12:02,683: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:12:02.683838643Z [2024-06-19 02:12:02,683: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:12:02.684216481Z [2024-06-19 02:12:02,683: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:12:02.684283456Z [2024-06-19 02:12:02,684: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T02:12:02.685290791Z [2024-06-19 02:12:02,685: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T02:12:02.685306198Z [2024-06-19 02:12:02,685: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:12:02.786427936Z [2024-06-19 02:12:02,785: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:12:02.793555830Z [2024-06-19 02:12:02,793: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:12:04.709726308Z [2024-06-19 02:12:04,709: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eeb705dd-5919-42a8-8064-c017c7791cea] received 2024-06-19T02:12:04.723125996Z [2024-06-19 02:12:04,722: INFO/ForkPoolWorker-15] [eeb705dd-5919-42a8-8064-c017c7791cea] Executing command in Celery: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240619021203_412583', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-06-19T02:12:04.966065725Z [2024-06-19 02:12:04,965: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b547dc5f-2e55-42de-81b3-65a038cc4e34] succeeded in 4.146083063000333s: None 2024-06-19T02:12:05.038229165Z [2024-06-19 02:12:05,035: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/scaleout_vdu.py 2024-06-19T02:12:05.343608959Z [2024-06-19 02:12:05,343: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:12:05.638807839Z [2024-06-19 02:12:05,638: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b408f696-657f-470e-8fa3-6bd316c44e0f] succeeded in 4.832673262000753s: None 2024-06-19T02:12:05.967203831Z [2024-06-19 02:12:05,966: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[eeb705dd-5919-42a8-8064-c017c7791cea] succeeded in 1.2553118920004636s: None 2024-06-19T02:13:00.659358480Z [2024-06-19 02:13:00,658: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f7bdae6b-16f7-40a9-b451-5814bcbbb912] received 2024-06-19T02:13:00.666537161Z [2024-06-19 02:13:00,666: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[061ed6b4-a9c9-4426-9967-948b6e7150bb] received 2024-06-19T02:13:00.668061963Z [2024-06-19 02:13:00,667: INFO/ForkPoolWorker-15] [f7bdae6b-16f7-40a9-b451-5814bcbbb912] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T02:13:00.675362680Z [2024-06-19 02:13:00,675: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1cbab40a-9b78-4e3d-b693-809ebebbb214] received 2024-06-19T02:13:00.676340089Z [2024-06-19 02:13:00,676: INFO/ForkPoolWorker-16] [061ed6b4-a9c9-4426-9967-948b6e7150bb] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T02:13:00.685719626Z [2024-06-19 02:13:00,685: INFO/ForkPoolWorker-1] [1cbab40a-9b78-4e3d-b693-809ebebbb214] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T02:13:00.982734242Z [2024-06-19 02:13:00,979: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T02:13:00.988254410Z [2024-06-19 02:13:00,984: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T02:13:01.016600196Z [2024-06-19 02:13:01,010: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T02:13:01.175253589Z [2024-06-19 02:13:01,174: INFO/ForkPoolWorker-16] Getting SDNC list 2024-06-19T02:13:01.179128647Z [2024-06-19 02:13:01,178: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:13:01.200212551Z [2024-06-19 02:13:01,199: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T02:13:01.202069230Z [2024-06-19 02:13:01,201: INFO/ForkPoolWorker-16] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T02:13:01.202143719Z [2024-06-19 02:13:01,201: INFO/ForkPoolWorker-16] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T02:13:01.202305853Z [2024-06-19 02:13:01,202: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-06-19T02:13:01.202636165Z [2024-06-19 02:13:01,202: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T02:13:01.293296652Z [2024-06-19 02:13:01,292: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:13:01.878949407Z [2024-06-19 02:13:01,878: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[061ed6b4-a9c9-4426-9967-948b6e7150bb] succeeded in 1.2110680059995502s: None 2024-06-19T02:13:02.151475725Z [2024-06-19 02:13:02,151: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T02:13:02.159993296Z [2024-06-19 02:13:02,159: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:13:02.187819130Z [2024-06-19 02:13:02,187: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T02:13:02.189305892Z [2024-06-19 02:13:02,189: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:13:02.189357742Z [2024-06-19 02:13:02,189: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:13:02.189598906Z [2024-06-19 02:13:02,189: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:13:02.189613314Z [2024-06-19 02:13:02,189: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T02:13:02.189927681Z [2024-06-19 02:13:02,189: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-06-19T02:13:02.189943739Z [2024-06-19 02:13:02,189: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:13:02.210726492Z [2024-06-19 02:13:02,210: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T02:13:02.233334827Z [2024-06-19 02:13:02,228: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:13:02.324724316Z [2024-06-19 02:13:02,324: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T02:13:02.335293107Z [2024-06-19 02:13:02,332: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:13:02.335331617Z [2024-06-19 02:13:02,333: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:13:02.335335700Z [2024-06-19 02:13:02,333: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:13:02.335339525Z [2024-06-19 02:13:02,333: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T02:13:02.335343130Z [2024-06-19 02:13:02,333: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T02:13:02.335346103Z [2024-06-19 02:13:02,333: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:13:02.365086378Z [2024-06-19 02:13:02,364: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:13:02.447614841Z [2024-06-19 02:13:02,447: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:13:03.999173143Z [2024-06-19 02:13:03,998: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1cbab40a-9b78-4e3d-b693-809ebebbb214] succeeded in 3.3210133209995547s: None 2024-06-19T02:13:04.354921163Z [2024-06-19 02:13:04,354: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f7bdae6b-16f7-40a9-b451-5814bcbbb912] succeeded in 3.692890976999479s: None 2024-06-19T02:14:00.288668181Z [2024-06-19 02:14:00,288: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6c2207b6-f494-4018-85b9-4327340a30b0] received 2024-06-19T02:14:00.291543081Z [2024-06-19 02:14:00,291: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[018898cb-9862-43ae-a739-c3315d85ca63] received 2024-06-19T02:14:00.293521586Z [2024-06-19 02:14:00,293: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4b46ea0c-7935-4eea-8d05-c2ee7020e0be] received 2024-06-19T02:14:00.298899412Z [2024-06-19 02:14:00,298: INFO/ForkPoolWorker-15] [6c2207b6-f494-4018-85b9-4327340a30b0] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-19T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-19T02:14:00.305258006Z [2024-06-19 02:14:00,305: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f452bc61-9ef0-4763-a018-cafc5ecc08a7] received 2024-06-19T02:14:00.306875021Z [2024-06-19 02:14:00,306: INFO/ForkPoolWorker-1] [4b46ea0c-7935-4eea-8d05-c2ee7020e0be] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T02:14:00.310238207Z [2024-06-19 02:14:00,309: INFO/ForkPoolWorker-16] [018898cb-9862-43ae-a739-c3315d85ca63] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T02:14:00.321696094Z [2024-06-19 02:14:00,321: INFO/ForkPoolWorker-2] [f452bc61-9ef0-4763-a018-cafc5ecc08a7] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T02:14:00.700849053Z [2024-06-19 02:14:00,685: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-19T02:14:00.721169808Z [2024-06-19 02:14:00,717: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T02:14:00.772222535Z [2024-06-19 02:14:00,758: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T02:14:00.836203489Z [2024-06-19 02:14:00,832: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T02:14:00.958475481Z [2024-06-19 02:14:00,958: INFO/ForkPoolWorker-2] Getting SDNC list 2024-06-19T02:14:00.975932442Z [2024-06-19 02:14:00,975: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:14:01.022002866Z [2024-06-19 02:14:01,021: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T02:14:01.023487180Z [2024-06-19 02:14:01,023: INFO/ForkPoolWorker-2] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T02:14:01.023592258Z [2024-06-19 02:14:01,023: INFO/ForkPoolWorker-2] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T02:14:01.023675406Z [2024-06-19 02:14:01,023: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-06-19T02:14:01.023934738Z [2024-06-19 02:14:01,023: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T02:14:01.194451971Z [2024-06-19 02:14:01,194: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:14:01.361584509Z [2024-06-19 02:14:01,361: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:14:02.006444126Z [2024-06-19 02:14:02,005: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[f452bc61-9ef0-4763-a018-cafc5ecc08a7] succeeded in 1.6916864500017255s: None 2024-06-19T02:14:02.112857822Z [2024-06-19 02:14:02,112: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6c2207b6-f494-4018-85b9-4327340a30b0] succeeded in 1.8200357779987826s: None 2024-06-19T02:14:02.350793442Z [2024-06-19 02:14:02,350: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T02:14:02.357372229Z [2024-06-19 02:14:02,356: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:14:02.382495629Z [2024-06-19 02:14:02,382: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T02:14:02.383606677Z [2024-06-19 02:14:02,383: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:14:02.383713202Z [2024-06-19 02:14:02,383: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:14:02.383864602Z [2024-06-19 02:14:02,383: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:14:02.383937648Z [2024-06-19 02:14:02,383: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T02:14:02.384770143Z [2024-06-19 02:14:02,384: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-19T02:14:02.384892642Z [2024-06-19 02:14:02,384: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:14:02.461909789Z [2024-06-19 02:14:02,461: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:14:02.672902932Z [2024-06-19 02:14:02,672: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T02:14:02.676944113Z [2024-06-19 02:14:02,676: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:14:02.724810444Z [2024-06-19 02:14:02,724: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T02:14:02.730971981Z [2024-06-19 02:14:02,730: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:14:02.731199385Z [2024-06-19 02:14:02,731: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:14:02.731411174Z [2024-06-19 02:14:02,731: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:14:02.731597748Z [2024-06-19 02:14:02,731: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T02:14:02.731993196Z [2024-06-19 02:14:02,731: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T02:14:02.732361441Z [2024-06-19 02:14:02,732: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:14:02.851548601Z [2024-06-19 02:14:02,851: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:14:04.349992813Z [2024-06-19 02:14:04,349: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4b46ea0c-7935-4eea-8d05-c2ee7020e0be] succeeded in 4.054116653000165s: None 2024-06-19T02:14:04.624164808Z [2024-06-19 02:14:04,623: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[018898cb-9862-43ae-a739-c3315d85ca63] succeeded in 4.327497371999925s: None 2024-06-19T02:15:00.687573397Z [2024-06-19 02:15:00,687: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[007bf928-0722-4d29-8962-882ed46fc21b] received 2024-06-19T02:15:00.692261701Z [2024-06-19 02:15:00,692: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f5293a2a-5ff6-4360-a550-3410e24d06cd] received 2024-06-19T02:15:00.693773980Z [2024-06-19 02:15:00,693: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[75fb4767-0047-4d62-b4a2-a6098830e7f5] received 2024-06-19T02:15:00.695299856Z [2024-06-19 02:15:00,695: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b5612b70-f159-4e7a-b257-820f974a95b2] received 2024-06-19T02:15:00.698898901Z [2024-06-19 02:15:00,698: INFO/ForkPoolWorker-15] [007bf928-0722-4d29-8962-882ed46fc21b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-19T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T02:15:00.703527194Z [2024-06-19 02:15:00,703: INFO/ForkPoolWorker-16] [f5293a2a-5ff6-4360-a550-3410e24d06cd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T02:15:00.709010716Z [2024-06-19 02:15:00,708: INFO/ForkPoolWorker-1] [75fb4767-0047-4d62-b4a2-a6098830e7f5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T02:15:00.709526993Z [2024-06-19 02:15:00,709: INFO/ForkPoolWorker-2] [b5612b70-f159-4e7a-b257-820f974a95b2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T02:15:00.996556594Z [2024-06-19 02:15:00,992: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T02:15:01.125375032Z [2024-06-19 02:15:01,121: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T02:15:01.142448669Z [2024-06-19 02:15:01,134: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T02:15:01.144133737Z [2024-06-19 02:15:01,138: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T02:15:01.330665999Z [2024-06-19 02:15:01,330: INFO/ForkPoolWorker-2] Getting SDNC list 2024-06-19T02:15:01.334358021Z [2024-06-19 02:15:01,333: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:15:01.358644148Z [2024-06-19 02:15:01,358: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T02:15:01.359909910Z [2024-06-19 02:15:01,359: INFO/ForkPoolWorker-2] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T02:15:01.360044619Z [2024-06-19 02:15:01,359: INFO/ForkPoolWorker-2] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T02:15:01.360164516Z [2024-06-19 02:15:01,360: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-06-19T02:15:01.360466276Z [2024-06-19 02:15:01,360: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T02:15:01.438409775Z [2024-06-19 02:15:01,438: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:15:01.993433264Z [2024-06-19 02:15:01,993: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b5612b70-f159-4e7a-b257-820f974a95b2] succeeded in 1.296269262998976s: None 2024-06-19T02:15:02.645023926Z [2024-06-19 02:15:02,644: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T02:15:02.652980321Z [2024-06-19 02:15:02,652: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:15:02.659153432Z [2024-06-19 02:15:02,658: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T02:15:02.662381411Z [2024-06-19 02:15:02,661: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:15:02.674193323Z [2024-06-19 02:15:02,674: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T02:15:02.676372933Z [2024-06-19 02:15:02,676: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:15:02.676503865Z [2024-06-19 02:15:02,676: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:15:02.676765745Z [2024-06-19 02:15:02,676: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:15:02.677265497Z [2024-06-19 02:15:02,676: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T02:15:02.677608858Z [2024-06-19 02:15:02,677: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T02:15:02.677624217Z [2024-06-19 02:15:02,677: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T02:15:02.678440937Z [2024-06-19 02:15:02,677: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:15:02.681252723Z [2024-06-19 02:15:02,680: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:15:02.699522247Z [2024-06-19 02:15:02,699: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T02:15:02.702865769Z [2024-06-19 02:15:02,702: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:15:02.702937410Z [2024-06-19 02:15:02,702: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:15:02.703144974Z [2024-06-19 02:15:02,702: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:15:02.703405850Z [2024-06-19 02:15:02,703: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T02:15:02.703813834Z [2024-06-19 02:15:02,703: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-19T02:15:02.703869190Z [2024-06-19 02:15:02,703: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:15:02.718465500Z [2024-06-19 02:15:02,718: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T02:15:02.720009182Z [2024-06-19 02:15:02,719: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:15:02.720025973Z [2024-06-19 02:15:02,719: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:15:02.720146693Z [2024-06-19 02:15:02,720: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:15:02.720157795Z [2024-06-19 02:15:02,720: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T02:15:02.720375287Z [2024-06-19 02:15:02,720: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T02:15:02.720405462Z [2024-06-19 02:15:02,720: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:15:02.780199955Z [2024-06-19 02:15:02,779: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:15:02.841331476Z [2024-06-19 02:15:02,841: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:15:02.901853316Z [2024-06-19 02:15:02,901: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:15:03.427697556Z [2024-06-19 02:15:03,427: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[007bf928-0722-4d29-8962-882ed46fc21b] succeeded in 2.7382495049987483s: None 2024-06-19T02:15:04.058310010Z [2024-06-19 02:15:04,057: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[41ab5e04-3d41-46a4-b90b-51b408cad140] received 2024-06-19T02:15:04.065294417Z [2024-06-19 02:15:04,065: INFO/ForkPoolWorker-15] [41ab5e04-3d41-46a4-b90b-51b408cad140] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'split_metrics', 'scheduled__2024-06-19T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T02:15:04.381275254Z [2024-06-19 02:15:04,377: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T02:15:04.491606838Z [2024-06-19 02:15:04,490: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[75fb4767-0047-4d62-b4a2-a6098830e7f5] succeeded in 3.793459176999022s: None 2024-06-19T02:15:05.005600185Z [2024-06-19 02:15:05,005: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f5293a2a-5ff6-4360-a550-3410e24d06cd] succeeded in 4.31147067999882s: None 2024-06-19T02:15:05.622656814Z [2024-06-19 02:15:05,622: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T02:15:05.626011850Z [2024-06-19 02:15:05,625: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:15:05.650321376Z [2024-06-19 02:15:05,650: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T02:15:05.652412722Z [2024-06-19 02:15:05,651: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:15:05.652693433Z [2024-06-19 02:15:05,652: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:15:05.652949178Z [2024-06-19 02:15:05,652: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:15:05.653145533Z [2024-06-19 02:15:05,652: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T02:15:05.653487969Z [2024-06-19 02:15:05,653: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T02:15:05.653714074Z [2024-06-19 02:15:05,653: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:15:05.743770508Z [2024-06-19 02:15:05,743: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:15:06.466455736Z [2024-06-19 02:15:06,465: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[41ab5e04-3d41-46a4-b90b-51b408cad140] succeeded in 2.405673492999995s: None 2024-06-19T02:15:06.508422019Z [2024-06-19 02:15:06,507: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2e358509-6762-46b9-9002-ae1fd7436c1c] received 2024-06-19T02:15:06.520898249Z [2024-06-19 02:15:06,520: INFO/ForkPoolWorker-15] [2e358509-6762-46b9-9002-ae1fd7436c1c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'collect_metrics', 'scheduled__2024-06-19T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-19T02:15:06.784251195Z [2024-06-19 02:15:06,781: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T02:15:07.891819071Z [2024-06-19 02:15:07,889: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T02:15:07.896752830Z [2024-06-19 02:15:07,893: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:15:07.911891434Z [2024-06-19 02:15:07,911: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T02:15:07.914362788Z [2024-06-19 02:15:07,912: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:15:07.914378291Z [2024-06-19 02:15:07,913: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:15:07.914383945Z [2024-06-19 02:15:07,913: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:15:07.914388935Z [2024-06-19 02:15:07,913: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T02:15:07.914392085Z [2024-06-19 02:15:07,913: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T02:15:07.914395470Z [2024-06-19 02:15:07,913: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:15:07.992692601Z [2024-06-19 02:15:07,992: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:15:08.648892357Z [2024-06-19 02:15:08,648: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2e358509-6762-46b9-9002-ae1fd7436c1c] succeeded in 2.1355082289992424s: None 2024-06-19T02:15:09.551669415Z [2024-06-19 02:15:09,551: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9288f795-eba5-49e5-a4f2-95b10ceee51f] received 2024-06-19T02:15:09.560819148Z [2024-06-19 02:15:09,560: INFO/ForkPoolWorker-15] [9288f795-eba5-49e5-a4f2-95b10ceee51f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'send_prometheus', 'scheduled__2024-06-19T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T02:15:09.851400226Z [2024-06-19 02:15:09,848: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T02:15:10.946897173Z [2024-06-19 02:15:10,946: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T02:15:10.949917029Z [2024-06-19 02:15:10,949: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:15:10.972456766Z [2024-06-19 02:15:10,972: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T02:15:10.974094940Z [2024-06-19 02:15:10,973: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:15:10.974114971Z [2024-06-19 02:15:10,973: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:15:10.974204459Z [2024-06-19 02:15:10,974: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:15:10.974254210Z [2024-06-19 02:15:10,974: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T02:15:10.974570375Z [2024-06-19 02:15:10,974: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T02:15:10.974590240Z [2024-06-19 02:15:10,974: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:15:11.061708212Z [2024-06-19 02:15:11,061: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:15:11.727513777Z [2024-06-19 02:15:11,726: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9288f795-eba5-49e5-a4f2-95b10ceee51f] succeeded in 2.171901406998586s: None 2024-06-19T02:16:01.099937810Z [2024-06-19 02:16:01,099: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6ab62453-19a9-42a2-89b2-5858349ece90] received 2024-06-19T02:16:01.104351184Z [2024-06-19 02:16:01,104: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5ae9d15e-8f55-42e4-b447-db09aadd45ea] received 2024-06-19T02:16:01.106290985Z [2024-06-19 02:16:01,106: INFO/ForkPoolWorker-15] [6ab62453-19a9-42a2-89b2-5858349ece90] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-19T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-19T02:16:01.109358402Z [2024-06-19 02:16:01,109: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cc1516ca-b37d-4598-8b4a-4c3f0eb5faed] received 2024-06-19T02:16:01.122083526Z [2024-06-19 02:16:01,121: INFO/ForkPoolWorker-1] [cc1516ca-b37d-4598-8b4a-4c3f0eb5faed] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T02:16:01.126399583Z [2024-06-19 02:16:01,125: INFO/ForkPoolWorker-16] [5ae9d15e-8f55-42e4-b447-db09aadd45ea] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T02:16:01.134208567Z [2024-06-19 02:16:01,133: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b94df25f-48bb-4746-b357-87db91ba6129] received 2024-06-19T02:16:01.161165944Z [2024-06-19 02:16:01,160: INFO/ForkPoolWorker-2] [b94df25f-48bb-4746-b357-87db91ba6129] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T02:16:01.443556338Z [2024-06-19 02:16:01,440: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-19T02:16:01.466305270Z [2024-06-19 02:16:01,457: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T02:16:01.502396710Z [2024-06-19 02:16:01,499: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T02:16:01.632319347Z [2024-06-19 02:16:01,628: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T02:16:01.707469662Z [2024-06-19 02:16:01,707: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:16:01.790085716Z [2024-06-19 02:16:01,789: INFO/ForkPoolWorker-2] Getting SDNC list 2024-06-19T02:16:01.793825260Z [2024-06-19 02:16:01,793: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:16:01.816742350Z [2024-06-19 02:16:01,816: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T02:16:01.819917755Z [2024-06-19 02:16:01,819: INFO/ForkPoolWorker-2] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T02:16:01.820211304Z [2024-06-19 02:16:01,819: INFO/ForkPoolWorker-2] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T02:16:01.820718658Z [2024-06-19 02:16:01,820: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-06-19T02:16:01.821241705Z [2024-06-19 02:16:01,821: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T02:16:01.928715227Z [2024-06-19 02:16:01,928: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:16:02.357423953Z [2024-06-19 02:16:02,357: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6ab62453-19a9-42a2-89b2-5858349ece90] succeeded in 1.256220935998499s: None 2024-06-19T02:16:02.598289009Z [2024-06-19 02:16:02,597: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b94df25f-48bb-4746-b357-87db91ba6129] succeeded in 1.4614981770009763s: None 2024-06-19T02:16:02.721423819Z [2024-06-19 02:16:02,721: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T02:16:02.725027512Z [2024-06-19 02:16:02,724: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:16:02.744586655Z [2024-06-19 02:16:02,744: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T02:16:02.745834994Z [2024-06-19 02:16:02,745: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:16:02.746013629Z [2024-06-19 02:16:02,745: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:16:02.746225620Z [2024-06-19 02:16:02,746: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:16:02.746367235Z [2024-06-19 02:16:02,746: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T02:16:02.746664012Z [2024-06-19 02:16:02,746: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-19T02:16:02.746816627Z [2024-06-19 02:16:02,746: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:16:02.812821416Z [2024-06-19 02:16:02,812: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T02:16:02.815931558Z [2024-06-19 02:16:02,815: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:16:02.826228673Z [2024-06-19 02:16:02,825: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:16:02.839071718Z [2024-06-19 02:16:02,838: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T02:16:02.840382783Z [2024-06-19 02:16:02,840: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:16:02.840446622Z [2024-06-19 02:16:02,840: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:16:02.840632907Z [2024-06-19 02:16:02,840: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:16:02.840706542Z [2024-06-19 02:16:02,840: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T02:16:02.840975072Z [2024-06-19 02:16:02,840: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T02:16:02.841044468Z [2024-06-19 02:16:02,840: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:16:02.930192955Z [2024-06-19 02:16:02,929: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:16:04.548694152Z [2024-06-19 02:16:04,548: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[cc1516ca-b37d-4598-8b4a-4c3f0eb5faed] succeeded in 3.4370727490004356s: None 2024-06-19T02:16:04.913441100Z [2024-06-19 02:16:04,912: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5ae9d15e-8f55-42e4-b447-db09aadd45ea] succeeded in 3.8031359700016765s: None 2024-06-19T02:17:00.461850279Z [2024-06-19 02:17:00,461: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bb69ffb7-3ac1-4eb8-ab10-b0552cb53258] received 2024-06-19T02:17:00.465319338Z [2024-06-19 02:17:00,465: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b41f3797-d3f2-44d5-b5f4-3b2be978cb80] received 2024-06-19T02:17:00.467293340Z [2024-06-19 02:17:00,466: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[058706d7-7729-4ced-af41-ddc74856947c] received 2024-06-19T02:17:00.468765636Z [2024-06-19 02:17:00,468: INFO/ForkPoolWorker-15] [bb69ffb7-3ac1-4eb8-ab10-b0552cb53258] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T02:17:00.477834388Z [2024-06-19 02:17:00,477: INFO/ForkPoolWorker-16] [b41f3797-d3f2-44d5-b5f4-3b2be978cb80] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T02:17:00.485167168Z [2024-06-19 02:17:00,484: INFO/ForkPoolWorker-1] [058706d7-7729-4ced-af41-ddc74856947c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T02:17:00.760765317Z [2024-06-19 02:17:00,757: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T02:17:00.765664525Z [2024-06-19 02:17:00,762: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T02:17:00.798515758Z [2024-06-19 02:17:00,795: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T02:17:00.934895896Z [2024-06-19 02:17:00,934: INFO/ForkPoolWorker-1] Getting SDNC list 2024-06-19T02:17:00.938916247Z [2024-06-19 02:17:00,938: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:17:00.965760753Z [2024-06-19 02:17:00,965: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T02:17:00.966953813Z [2024-06-19 02:17:00,966: INFO/ForkPoolWorker-1] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T02:17:00.967100803Z [2024-06-19 02:17:00,966: INFO/ForkPoolWorker-1] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T02:17:00.967177225Z [2024-06-19 02:17:00,967: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-06-19T02:17:00.967467312Z [2024-06-19 02:17:00,967: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T02:17:01.059776638Z [2024-06-19 02:17:01,059: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:17:01.652136597Z [2024-06-19 02:17:01,651: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[058706d7-7729-4ced-af41-ddc74856947c] succeeded in 1.1826617429996986s: None 2024-06-19T02:17:01.814473258Z [2024-06-19 02:17:01,814: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T02:17:01.817662568Z [2024-06-19 02:17:01,817: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:17:01.844076195Z [2024-06-19 02:17:01,843: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T02:17:01.846683304Z [2024-06-19 02:17:01,846: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:17:01.846707706Z [2024-06-19 02:17:01,846: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:17:01.846844538Z [2024-06-19 02:17:01,846: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:17:01.846887511Z [2024-06-19 02:17:01,846: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T02:17:01.847130518Z [2024-06-19 02:17:01,847: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T02:17:01.847348113Z [2024-06-19 02:17:01,847: INFO/ForkPoolWorker-16] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:17:01.912930971Z [2024-06-19 02:17:01,912: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T02:17:01.916052399Z [2024-06-19 02:17:01,915: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:17:01.923756577Z [2024-06-19 02:17:01,923: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:17:01.933479764Z [2024-06-19 02:17:01,933: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T02:17:01.934592444Z [2024-06-19 02:17:01,934: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:17:01.934645067Z [2024-06-19 02:17:01,934: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:17:01.934787926Z [2024-06-19 02:17:01,934: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:17:01.934850228Z [2024-06-19 02:17:01,934: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T02:17:01.935105234Z [2024-06-19 02:17:01,934: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-06-19T02:17:01.935550956Z [2024-06-19 02:17:01,935: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:17:02.013495316Z [2024-06-19 02:17:02,013: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:17:03.467883110Z [2024-06-19 02:17:03,467: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b41f3797-d3f2-44d5-b5f4-3b2be978cb80] succeeded in 3.000831809000374s: None 2024-06-19T02:17:03.930442365Z [2024-06-19 02:17:03,930: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bb69ffb7-3ac1-4eb8-ab10-b0552cb53258] succeeded in 3.4668485100010002s: None 2024-06-19T02:18:00.926125366Z [2024-06-19 02:18:00,925: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a3b3f95d-8fe6-415a-9835-46e5fb3b168e] received 2024-06-19T02:18:00.928929994Z [2024-06-19 02:18:00,928: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f2fdc00f-8b33-49a5-8156-f85c7f698c8d] received 2024-06-19T02:18:00.938130003Z [2024-06-19 02:18:00,937: INFO/ForkPoolWorker-15] [a3b3f95d-8fe6-415a-9835-46e5fb3b168e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-19T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-19T02:18:00.938465435Z [2024-06-19 02:18:00,938: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[028bddbc-b0d9-43e5-9084-25335a789784] received 2024-06-19T02:18:00.958515148Z [2024-06-19 02:18:00,958: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f761bb3e-0d1e-457a-85fa-8cacbd1ac1be] received 2024-06-19T02:18:00.961921252Z [2024-06-19 02:18:00,961: INFO/ForkPoolWorker-16] [f2fdc00f-8b33-49a5-8156-f85c7f698c8d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T02:18:00.967553302Z [2024-06-19 02:18:00,967: INFO/ForkPoolWorker-2] [f761bb3e-0d1e-457a-85fa-8cacbd1ac1be] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T02:18:00.968655080Z [2024-06-19 02:18:00,968: INFO/ForkPoolWorker-1] [028bddbc-b0d9-43e5-9084-25335a789784] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T02:18:01.270868084Z [2024-06-19 02:18:01,267: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-19T02:18:01.271459446Z [2024-06-19 02:18:01,267: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T02:18:01.292614872Z [2024-06-19 02:18:01,288: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T02:18:01.297223120Z [2024-06-19 02:18:01,291: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T02:18:01.479706033Z [2024-06-19 02:18:01,479: INFO/ForkPoolWorker-2] Getting SDNC list 2024-06-19T02:18:01.487646364Z [2024-06-19 02:18:01,487: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:18:01.541092920Z [2024-06-19 02:18:01,540: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T02:18:01.542448808Z [2024-06-19 02:18:01,541: INFO/ForkPoolWorker-2] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T02:18:01.542661258Z [2024-06-19 02:18:01,542: INFO/ForkPoolWorker-2] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T02:18:01.542799596Z [2024-06-19 02:18:01,542: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-06-19T02:18:01.543174428Z [2024-06-19 02:18:01,542: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T02:18:01.567941304Z [2024-06-19 02:18:01,567: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:18:01.627574124Z [2024-06-19 02:18:01,627: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:18:02.128440023Z [2024-06-19 02:18:02,127: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[f761bb3e-0d1e-457a-85fa-8cacbd1ac1be] succeeded in 1.1674734860007447s: None 2024-06-19T02:18:02.137939815Z [2024-06-19 02:18:02,137: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a3b3f95d-8fe6-415a-9835-46e5fb3b168e] succeeded in 1.208910735000245s: None 2024-06-19T02:18:02.601924478Z [2024-06-19 02:18:02,601: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T02:18:02.605385565Z [2024-06-19 02:18:02,604: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:18:02.632783673Z [2024-06-19 02:18:02,632: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T02:18:02.636697820Z [2024-06-19 02:18:02,634: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:18:02.636984198Z [2024-06-19 02:18:02,636: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:18:02.637316524Z [2024-06-19 02:18:02,636: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:18:02.638882612Z [2024-06-19 02:18:02,637: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T02:18:02.639745754Z [2024-06-19 02:18:02,639: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T02:18:02.639974771Z [2024-06-19 02:18:02,639: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:18:02.737083086Z [2024-06-19 02:18:02,736: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:18:02.778950144Z [2024-06-19 02:18:02,778: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T02:18:02.782304070Z [2024-06-19 02:18:02,781: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:18:02.811085649Z [2024-06-19 02:18:02,810: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T02:18:02.813767197Z [2024-06-19 02:18:02,813: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:18:02.813796770Z [2024-06-19 02:18:02,813: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:18:02.813953632Z [2024-06-19 02:18:02,813: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:18:02.814004559Z [2024-06-19 02:18:02,813: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T02:18:02.814252781Z [2024-06-19 02:18:02,814: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-19T02:18:02.814364226Z [2024-06-19 02:18:02,814: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:18:02.899551739Z [2024-06-19 02:18:02,899: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:18:04.031995553Z [2024-06-19 02:18:04,031: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5b50f3a1-53f3-4609-b407-841ad6c1b2e5] received 2024-06-19T02:18:04.038766415Z [2024-06-19 02:18:04,038: INFO/ForkPoolWorker-15] [5b50f3a1-53f3-4609-b407-841ad6c1b2e5] Executing command in Celery: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240619021803_825954', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-06-19T02:18:04.355411969Z [2024-06-19 02:18:04,352: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/scaleout_vdu.py 2024-06-19T02:18:04.427510812Z [2024-06-19 02:18:04,426: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[028bddbc-b0d9-43e5-9084-25335a789784] succeeded in 3.4855521119989135s: None 2024-06-19T02:18:04.713466333Z [2024-06-19 02:18:04,713: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:18:05.283593756Z [2024-06-19 02:18:05,283: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f2fdc00f-8b33-49a5-8156-f85c7f698c8d] succeeded in 4.35176367799977s: None 2024-06-19T02:18:05.323486953Z [2024-06-19 02:18:05,322: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5b50f3a1-53f3-4609-b407-841ad6c1b2e5] succeeded in 1.2899512800013326s: None 2024-06-19T02:19:00.273416026Z [2024-06-19 02:19:00,273: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1535af48-158e-4b77-830d-ffc4fd124c26] received 2024-06-19T02:19:00.279087884Z [2024-06-19 02:19:00,278: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e0a6aaa3-44ab-4a37-bb39-c2f982202250] received 2024-06-19T02:19:00.289723975Z [2024-06-19 02:19:00,289: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d5ff5991-2e95-4bfe-8aad-31c9fe1d4379] received 2024-06-19T02:19:00.296415073Z [2024-06-19 02:19:00,296: INFO/ForkPoolWorker-15] [1535af48-158e-4b77-830d-ffc4fd124c26] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T02:19:00.303657659Z [2024-06-19 02:19:00,303: INFO/ForkPoolWorker-16] [e0a6aaa3-44ab-4a37-bb39-c2f982202250] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T02:19:00.310237277Z [2024-06-19 02:19:00,309: INFO/ForkPoolWorker-1] [d5ff5991-2e95-4bfe-8aad-31c9fe1d4379] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T02:19:00.705035054Z [2024-06-19 02:19:00,700: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T02:19:00.713133548Z [2024-06-19 02:19:00,709: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T02:19:00.866186922Z [2024-06-19 02:19:00,865: INFO/ForkPoolWorker-1] Getting SDNC list 2024-06-19T02:19:00.869084863Z [2024-06-19 02:19:00,865: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T02:19:00.869913941Z [2024-06-19 02:19:00,869: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:19:00.909181273Z [2024-06-19 02:19:00,908: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T02:19:00.912285822Z [2024-06-19 02:19:00,912: INFO/ForkPoolWorker-1] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T02:19:00.913042493Z [2024-06-19 02:19:00,912: INFO/ForkPoolWorker-1] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T02:19:00.913141751Z [2024-06-19 02:19:00,912: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-06-19T02:19:00.913749376Z [2024-06-19 02:19:00,913: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T02:19:00.997969441Z [2024-06-19 02:19:00,997: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:19:01.873934074Z [2024-06-19 02:19:01,873: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d5ff5991-2e95-4bfe-8aad-31c9fe1d4379] succeeded in 1.5821518569991895s: None 2024-06-19T02:19:02.013816203Z [2024-06-19 02:19:02,013: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T02:19:02.017456138Z [2024-06-19 02:19:02,016: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:19:02.068794594Z [2024-06-19 02:19:02,068: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T02:19:02.072987615Z [2024-06-19 02:19:02,072: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:19:02.073169832Z [2024-06-19 02:19:02,072: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:19:02.073201142Z [2024-06-19 02:19:02,072: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:19:02.073211463Z [2024-06-19 02:19:02,073: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T02:19:02.073693935Z [2024-06-19 02:19:02,073: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T02:19:02.073714007Z [2024-06-19 02:19:02,073: INFO/ForkPoolWorker-16] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:19:02.109118250Z [2024-06-19 02:19:02,108: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T02:19:02.112148561Z [2024-06-19 02:19:02,111: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:19:02.126770253Z [2024-06-19 02:19:02,126: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T02:19:02.127857759Z [2024-06-19 02:19:02,127: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:19:02.127922441Z [2024-06-19 02:19:02,127: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:19:02.128107666Z [2024-06-19 02:19:02,127: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:19:02.128162982Z [2024-06-19 02:19:02,128: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T02:19:02.128396675Z [2024-06-19 02:19:02,128: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-06-19T02:19:02.128451006Z [2024-06-19 02:19:02,128: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:19:02.196124191Z [2024-06-19 02:19:02,195: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:19:02.295399187Z [2024-06-19 02:19:02,295: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:19:03.903940027Z [2024-06-19 02:19:03,903: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e0a6aaa3-44ab-4a37-bb39-c2f982202250] succeeded in 3.6185176180006238s: None 2024-06-19T02:19:04.224321698Z [2024-06-19 02:19:04,223: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1535af48-158e-4b77-830d-ffc4fd124c26] succeeded in 3.947443092998583s: None 2024-06-19T02:20:00.311925233Z [2024-06-19 02:20:00,311: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f91dd796-4a58-4912-b3c8-5e8ec657a454] received 2024-06-19T02:20:00.314966702Z [2024-06-19 02:20:00,314: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ceced5b5-5ac2-40a0-a9d3-5f0d44bacd5e] received 2024-06-19T02:20:00.316379837Z [2024-06-19 02:20:00,316: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[148f4c80-aa73-4184-9277-69473ffb7c93] received 2024-06-19T02:20:00.327971952Z [2024-06-19 02:20:00,325: INFO/ForkPoolWorker-16] [ceced5b5-5ac2-40a0-a9d3-5f0d44bacd5e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-19T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T02:20:00.329839625Z [2024-06-19 02:20:00,329: INFO/ForkPoolWorker-1] [148f4c80-aa73-4184-9277-69473ffb7c93] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T02:20:00.330565244Z [2024-06-19 02:20:00,330: INFO/ForkPoolWorker-15] [f91dd796-4a58-4912-b3c8-5e8ec657a454] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T02:20:00.334908256Z [2024-06-19 02:20:00,334: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[630fd477-d70f-4950-8d1b-e858b282b6ff] received 2024-06-19T02:20:00.340360710Z [2024-06-19 02:20:00,340: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ee32097a-4383-4c7c-8221-d9cd6be9d101] received 2024-06-19T02:20:00.365231442Z [2024-06-19 02:20:00,364: INFO/ForkPoolWorker-2] [630fd477-d70f-4950-8d1b-e858b282b6ff] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-19T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-19T02:20:00.366153168Z [2024-06-19 02:20:00,365: INFO/ForkPoolWorker-3] [ee32097a-4383-4c7c-8221-d9cd6be9d101] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T02:20:00.619406658Z [2024-06-19 02:20:00,615: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T02:20:00.702383991Z [2024-06-19 02:20:00,698: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T02:20:00.783329639Z [2024-06-19 02:20:00,778: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T02:20:00.800924610Z [2024-06-19 02:20:00,794: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T02:20:00.938191472Z [2024-06-19 02:20:00,934: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-19T02:20:01.132968305Z [2024-06-19 02:20:01,132: INFO/ForkPoolWorker-3] Getting SDNC list 2024-06-19T02:20:01.137438009Z [2024-06-19 02:20:01,137: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:20:01.166556463Z [2024-06-19 02:20:01,166: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-06-19T02:20:01.167498729Z [2024-06-19 02:20:01,167: INFO/ForkPoolWorker-3] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T02:20:01.167669349Z [2024-06-19 02:20:01,167: INFO/ForkPoolWorker-3] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T02:20:01.167898744Z [2024-06-19 02:20:01,167: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-06-19T02:20:01.168188826Z [2024-06-19 02:20:01,168: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T02:20:01.263107777Z [2024-06-19 02:20:01,262: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:20:01.354672402Z [2024-06-19 02:20:01,354: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:20:01.974334206Z [2024-06-19 02:20:01,973: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[630fd477-d70f-4950-8d1b-e858b282b6ff] succeeded in 1.6360402169993904s: None 2024-06-19T02:20:01.977523069Z [2024-06-19 02:20:01,977: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[ee32097a-4383-4c7c-8221-d9cd6be9d101] succeeded in 1.6285119599997415s: None 2024-06-19T02:20:02.059837913Z [2024-06-19 02:20:02,059: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T02:20:02.062954764Z [2024-06-19 02:20:02,062: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:20:02.092773103Z [2024-06-19 02:20:02,092: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T02:20:02.093936147Z [2024-06-19 02:20:02,093: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:20:02.093955357Z [2024-06-19 02:20:02,093: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:20:02.094145093Z [2024-06-19 02:20:02,093: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:20:02.094210044Z [2024-06-19 02:20:02,094: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T02:20:02.094577309Z [2024-06-19 02:20:02,094: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T02:20:02.094673179Z [2024-06-19 02:20:02,094: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:20:02.178128785Z [2024-06-19 02:20:02,177: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:20:02.424403674Z [2024-06-19 02:20:02,424: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T02:20:02.433903564Z [2024-06-19 02:20:02,433: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:20:02.468047955Z [2024-06-19 02:20:02,467: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T02:20:02.470769815Z [2024-06-19 02:20:02,470: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:20:02.470993539Z [2024-06-19 02:20:02,470: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:20:02.471256739Z [2024-06-19 02:20:02,470: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:20:02.471518065Z [2024-06-19 02:20:02,471: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T02:20:02.471997139Z [2024-06-19 02:20:02,471: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T02:20:02.472172810Z [2024-06-19 02:20:02,471: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:20:02.539365286Z [2024-06-19 02:20:02,539: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T02:20:02.542646514Z [2024-06-19 02:20:02,542: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:20:02.551988437Z [2024-06-19 02:20:02,551: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:20:02.582108163Z [2024-06-19 02:20:02,581: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T02:20:02.585153885Z [2024-06-19 02:20:02,584: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:20:02.585429535Z [2024-06-19 02:20:02,585: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:20:02.585767700Z [2024-06-19 02:20:02,585: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:20:02.585980547Z [2024-06-19 02:20:02,585: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T02:20:02.586559341Z [2024-06-19 02:20:02,586: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-06-19T02:20:02.586877293Z [2024-06-19 02:20:02,586: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:20:02.675497822Z [2024-06-19 02:20:02,674: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:20:03.140611404Z [2024-06-19 02:20:03,139: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ceced5b5-5ac2-40a0-a9d3-5f0d44bacd5e] succeeded in 2.822299243998714s: None 2024-06-19T02:20:03.686181838Z [2024-06-19 02:20:03,685: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[148f4c80-aa73-4184-9277-69473ffb7c93] succeeded in 3.3664313579993177s: None 2024-06-19T02:20:04.170998024Z [2024-06-19 02:20:04,170: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6c142be1-eccb-4d01-95d8-20cc8efe105e] received 2024-06-19T02:20:04.187629284Z [2024-06-19 02:20:04,186: INFO/ForkPoolWorker-16] [6c142be1-eccb-4d01-95d8-20cc8efe105e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'split_metrics', 'scheduled__2024-06-19T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T02:20:04.327893430Z [2024-06-19 02:20:04,327: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[069420db-2771-42a7-8f43-1f697eef90a3] received 2024-06-19T02:20:04.343966392Z [2024-06-19 02:20:04,343: INFO/ForkPoolWorker-1] [069420db-2771-42a7-8f43-1f697eef90a3] Executing command in Celery: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240619022003_513751', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-06-19T02:20:04.525822728Z [2024-06-19 02:20:04,519: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T02:20:04.734493146Z [2024-06-19 02:20:04,731: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/scaleout_vdu.py 2024-06-19T02:20:04.779293442Z [2024-06-19 02:20:04,778: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f91dd796-4a58-4912-b3c8-5e8ec657a454] succeeded in 4.463193479999973s: None 2024-06-19T02:20:05.042392998Z [2024-06-19 02:20:05,042: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:20:05.613950638Z [2024-06-19 02:20:05,613: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[069420db-2771-42a7-8f43-1f697eef90a3] succeeded in 1.2834307760003867s: None 2024-06-19T02:20:05.787122585Z [2024-06-19 02:20:05,786: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T02:20:05.790383585Z [2024-06-19 02:20:05,789: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:20:05.822135820Z [2024-06-19 02:20:05,821: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T02:20:05.823569408Z [2024-06-19 02:20:05,823: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:20:05.823766393Z [2024-06-19 02:20:05,823: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:20:05.824312696Z [2024-06-19 02:20:05,823: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:20:05.824548030Z [2024-06-19 02:20:05,824: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T02:20:05.825084394Z [2024-06-19 02:20:05,824: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T02:20:05.825326607Z [2024-06-19 02:20:05,825: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:20:05.925982219Z [2024-06-19 02:20:05,925: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:20:06.615997461Z [2024-06-19 02:20:06,615: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6c142be1-eccb-4d01-95d8-20cc8efe105e] succeeded in 2.4433142919988313s: None 2024-06-19T02:20:06.664066454Z [2024-06-19 02:20:06,663: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[912e2196-1190-4c2a-b0fb-29e0f349831e] received 2024-06-19T02:20:06.671961323Z [2024-06-19 02:20:06,671: INFO/ForkPoolWorker-15] [912e2196-1190-4c2a-b0fb-29e0f349831e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'collect_metrics', 'scheduled__2024-06-19T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-19T02:20:06.937254807Z [2024-06-19 02:20:06,934: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T02:20:08.011307470Z [2024-06-19 02:20:08,010: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T02:20:08.014499472Z [2024-06-19 02:20:08,014: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:20:08.041377344Z [2024-06-19 02:20:08,041: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T02:20:08.042904395Z [2024-06-19 02:20:08,042: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:20:08.043165263Z [2024-06-19 02:20:08,042: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:20:08.043547705Z [2024-06-19 02:20:08,043: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:20:08.043796295Z [2024-06-19 02:20:08,043: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T02:20:08.044120201Z [2024-06-19 02:20:08,043: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T02:20:08.044295738Z [2024-06-19 02:20:08,044: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:20:08.130228722Z [2024-06-19 02:20:08,129: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:20:09.499432266Z [2024-06-19 02:20:09,498: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[912e2196-1190-4c2a-b0fb-29e0f349831e] succeeded in 2.833143588000894s: None 2024-06-19T02:20:10.270291378Z [2024-06-19 02:20:10,269: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ba854903-ba5f-4cf4-a7e1-fa9feedd95cf] received 2024-06-19T02:20:10.281077195Z [2024-06-19 02:20:10,280: INFO/ForkPoolWorker-15] [ba854903-ba5f-4cf4-a7e1-fa9feedd95cf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'send_prometheus', 'scheduled__2024-06-19T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T02:20:10.592307952Z [2024-06-19 02:20:10,589: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T02:20:11.612134802Z [2024-06-19 02:20:11,611: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T02:20:11.615063580Z [2024-06-19 02:20:11,614: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:20:11.633113537Z [2024-06-19 02:20:11,632: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T02:20:11.634071138Z [2024-06-19 02:20:11,633: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:20:11.634096054Z [2024-06-19 02:20:11,633: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:20:11.634180570Z [2024-06-19 02:20:11,634: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:20:11.634217277Z [2024-06-19 02:20:11,634: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T02:20:11.634619583Z [2024-06-19 02:20:11,634: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T02:20:11.634637153Z [2024-06-19 02:20:11,634: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:20:11.725179954Z [2024-06-19 02:20:11,724: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:20:12.378865154Z [2024-06-19 02:20:12,378: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ba854903-ba5f-4cf4-a7e1-fa9feedd95cf] succeeded in 2.106192134999219s: None 2024-06-19T02:21:01.164492774Z [2024-06-19 02:21:01,164: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[11b64ba8-8b50-4350-8540-434546250fae] received 2024-06-19T02:21:01.169017673Z [2024-06-19 02:21:01,168: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[63e1d264-df6a-45d3-b118-91e67e21dda1] received 2024-06-19T02:21:01.179370019Z [2024-06-19 02:21:01,179: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c908698e-6e57-4bf2-a755-c8260dfc67c2] received 2024-06-19T02:21:01.186625433Z [2024-06-19 02:21:01,186: INFO/ForkPoolWorker-16] [63e1d264-df6a-45d3-b118-91e67e21dda1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T02:21:01.194655398Z [2024-06-19 02:21:01,194: INFO/ForkPoolWorker-1] [c908698e-6e57-4bf2-a755-c8260dfc67c2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T02:21:01.201194364Z [2024-06-19 02:21:01,200: INFO/ForkPoolWorker-15] [11b64ba8-8b50-4350-8540-434546250fae] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T02:21:01.533561754Z [2024-06-19 02:21:01,529: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T02:21:01.570542857Z [2024-06-19 02:21:01,567: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T02:21:01.600468289Z [2024-06-19 02:21:01,596: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T02:21:01.799220553Z [2024-06-19 02:21:01,798: INFO/ForkPoolWorker-1] Getting SDNC list 2024-06-19T02:21:01.803077051Z [2024-06-19 02:21:01,802: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:21:01.826308348Z [2024-06-19 02:21:01,826: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T02:21:01.828248066Z [2024-06-19 02:21:01,828: INFO/ForkPoolWorker-1] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T02:21:01.828408393Z [2024-06-19 02:21:01,828: INFO/ForkPoolWorker-1] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T02:21:01.828464650Z [2024-06-19 02:21:01,828: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-06-19T02:21:01.828689791Z [2024-06-19 02:21:01,828: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T02:21:01.945205077Z [2024-06-19 02:21:01,944: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:21:02.755294988Z [2024-06-19 02:21:02,754: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c908698e-6e57-4bf2-a755-c8260dfc67c2] succeeded in 1.5741244860000734s: None 2024-06-19T02:21:02.805546016Z [2024-06-19 02:21:02,805: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T02:21:02.809872201Z [2024-06-19 02:21:02,809: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:21:02.831002030Z [2024-06-19 02:21:02,830: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T02:21:02.835277701Z [2024-06-19 02:21:02,834: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:21:02.844688479Z [2024-06-19 02:21:02,844: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T02:21:02.848588257Z [2024-06-19 02:21:02,848: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:21:02.848645018Z [2024-06-19 02:21:02,848: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:21:02.848749358Z [2024-06-19 02:21:02,848: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:21:02.848825269Z [2024-06-19 02:21:02,848: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T02:21:02.849081060Z [2024-06-19 02:21:02,848: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-19T02:21:02.849116761Z [2024-06-19 02:21:02,849: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:21:02.870513444Z [2024-06-19 02:21:02,870: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T02:21:02.872042831Z [2024-06-19 02:21:02,871: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:21:02.872079422Z [2024-06-19 02:21:02,872: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:21:02.872212326Z [2024-06-19 02:21:02,872: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:21:02.872247056Z [2024-06-19 02:21:02,872: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T02:21:02.872469993Z [2024-06-19 02:21:02,872: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T02:21:02.872501830Z [2024-06-19 02:21:02,872: INFO/ForkPoolWorker-15] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:21:02.957684501Z [2024-06-19 02:21:02,957: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:21:02.959790696Z [2024-06-19 02:21:02,959: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:21:04.685417671Z [2024-06-19 02:21:04,684: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[11b64ba8-8b50-4350-8540-434546250fae] succeeded in 3.5189018479995866s: None 2024-06-19T02:21:04.874146854Z [2024-06-19 02:21:04,873: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[63e1d264-df6a-45d3-b118-91e67e21dda1] succeeded in 3.7028749409982993s: None 2024-06-19T02:22:01.112421626Z [2024-06-19 02:22:01,111: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8487aa2a-c51f-44c8-ae80-97cb7f17fcff] received 2024-06-19T02:22:01.116267389Z [2024-06-19 02:22:01,116: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a752f3aa-b309-4883-bcba-2e69c81b2e3a] received 2024-06-19T02:22:01.121931624Z [2024-06-19 02:22:01,121: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7e5129c3-9b15-42ad-8b71-5496d74e0a7c] received 2024-06-19T02:22:01.123570203Z [2024-06-19 02:22:01,123: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[df4ed2d8-93ed-47bd-b016-b71f307b0733] received 2024-06-19T02:22:01.123944741Z [2024-06-19 02:22:01,123: INFO/ForkPoolWorker-15] [8487aa2a-c51f-44c8-ae80-97cb7f17fcff] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-19T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-19T02:22:01.137076100Z [2024-06-19 02:22:01,136: INFO/ForkPoolWorker-2] [df4ed2d8-93ed-47bd-b016-b71f307b0733] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T02:22:01.138742137Z [2024-06-19 02:22:01,138: INFO/ForkPoolWorker-1] [7e5129c3-9b15-42ad-8b71-5496d74e0a7c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T02:22:01.146566824Z [2024-06-19 02:22:01,146: INFO/ForkPoolWorker-16] [a752f3aa-b309-4883-bcba-2e69c81b2e3a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T02:22:01.458211652Z [2024-06-19 02:22:01,455: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T02:22:01.522392114Z [2024-06-19 02:22:01,518: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-19T02:22:01.560222256Z [2024-06-19 02:22:01,557: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T02:22:01.653297026Z [2024-06-19 02:22:01,650: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T02:22:01.721995767Z [2024-06-19 02:22:01,721: INFO/ForkPoolWorker-2] Getting SDNC list 2024-06-19T02:22:01.726523279Z [2024-06-19 02:22:01,725: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:22:01.767654878Z [2024-06-19 02:22:01,767: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T02:22:01.768790193Z [2024-06-19 02:22:01,768: INFO/ForkPoolWorker-2] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T02:22:01.768823125Z [2024-06-19 02:22:01,768: INFO/ForkPoolWorker-2] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T02:22:01.768907550Z [2024-06-19 02:22:01,768: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-06-19T02:22:01.769090903Z [2024-06-19 02:22:01,768: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T02:22:01.778426636Z [2024-06-19 02:22:01,778: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:22:01.918460510Z [2024-06-19 02:22:01,918: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:22:02.526511915Z [2024-06-19 02:22:02,526: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8487aa2a-c51f-44c8-ae80-97cb7f17fcff] succeeded in 1.412411585000882s: None 2024-06-19T02:22:02.722877165Z [2024-06-19 02:22:02,722: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[df4ed2d8-93ed-47bd-b016-b71f307b0733] succeeded in 1.59745457399913s: None 2024-06-19T02:22:02.879637886Z [2024-06-19 02:22:02,879: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T02:22:02.882895706Z [2024-06-19 02:22:02,882: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:22:02.906797963Z [2024-06-19 02:22:02,906: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T02:22:02.908377321Z [2024-06-19 02:22:02,907: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:22:02.908417029Z [2024-06-19 02:22:02,908: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:22:02.908529935Z [2024-06-19 02:22:02,908: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:22:02.908558289Z [2024-06-19 02:22:02,908: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T02:22:02.908901023Z [2024-06-19 02:22:02,908: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T02:22:02.908919073Z [2024-06-19 02:22:02,908: INFO/ForkPoolWorker-16] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:22:03.018687376Z [2024-06-19 02:22:03,018: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:22:03.175795324Z [2024-06-19 02:22:03,175: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T02:22:03.178892108Z [2024-06-19 02:22:03,178: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:22:03.205108635Z [2024-06-19 02:22:03,204: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T02:22:03.206804168Z [2024-06-19 02:22:03,206: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:22:03.206817778Z [2024-06-19 02:22:03,206: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:22:03.206985076Z [2024-06-19 02:22:03,206: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:22:03.206997599Z [2024-06-19 02:22:03,206: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T02:22:03.207370051Z [2024-06-19 02:22:03,207: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-06-19T02:22:03.207382017Z [2024-06-19 02:22:03,207: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:22:03.283126299Z [2024-06-19 02:22:03,282: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:22:05.056406178Z [2024-06-19 02:22:05,055: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a752f3aa-b309-4883-bcba-2e69c81b2e3a] succeeded in 3.934834862999196s: None 2024-06-19T02:22:05.641215243Z [2024-06-19 02:22:05,640: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7e5129c3-9b15-42ad-8b71-5496d74e0a7c] succeeded in 4.515900320000583s: None 2024-06-19T02:23:01.000130224Z [2024-06-19 02:23:00,999: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d2200eeb-5070-412f-8c8f-92eadc99c9dc] received 2024-06-19T02:23:01.012555194Z [2024-06-19 02:23:01,012: INFO/ForkPoolWorker-15] [d2200eeb-5070-412f-8c8f-92eadc99c9dc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T02:23:01.013837579Z [2024-06-19 02:23:01,013: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ed6b1f05-eda4-497d-8e2e-75e2fed1e336] received 2024-06-19T02:23:01.023151568Z [2024-06-19 02:23:01,022: INFO/ForkPoolWorker-16] [ed6b1f05-eda4-497d-8e2e-75e2fed1e336] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T02:23:01.023636837Z [2024-06-19 02:23:01,023: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ec80d36b-e80a-4cad-90bc-16ba9834fb86] received 2024-06-19T02:23:01.036161263Z [2024-06-19 02:23:01,035: INFO/ForkPoolWorker-1] [ec80d36b-e80a-4cad-90bc-16ba9834fb86] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T02:23:01.326687338Z [2024-06-19 02:23:01,323: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T02:23:01.348762164Z [2024-06-19 02:23:01,345: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T02:23:01.368172840Z [2024-06-19 02:23:01,364: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T02:23:01.477525434Z [2024-06-19 02:23:01,476: INFO/ForkPoolWorker-16] Getting SDNC list 2024-06-19T02:23:01.481283955Z [2024-06-19 02:23:01,480: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:23:01.508871051Z [2024-06-19 02:23:01,508: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T02:23:01.512102475Z [2024-06-19 02:23:01,511: INFO/ForkPoolWorker-16] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T02:23:01.512345376Z [2024-06-19 02:23:01,512: INFO/ForkPoolWorker-16] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T02:23:01.512601966Z [2024-06-19 02:23:01,512: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-06-19T02:23:01.513046376Z [2024-06-19 02:23:01,512: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T02:23:01.610179334Z [2024-06-19 02:23:01,609: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:23:02.335359911Z [2024-06-19 02:23:02,334: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ed6b1f05-eda4-497d-8e2e-75e2fed1e336] succeeded in 1.3188683490006952s: None 2024-06-19T02:23:02.580149153Z [2024-06-19 02:23:02,579: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T02:23:02.583409458Z [2024-06-19 02:23:02,583: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:23:02.603098167Z [2024-06-19 02:23:02,602: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T02:23:02.605159069Z [2024-06-19 02:23:02,604: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:23:02.605204393Z [2024-06-19 02:23:02,605: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:23:02.605383960Z [2024-06-19 02:23:02,605: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:23:02.605504860Z [2024-06-19 02:23:02,605: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T02:23:02.606211512Z [2024-06-19 02:23:02,606: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-06-19T02:23:02.606484886Z [2024-06-19 02:23:02,606: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:23:02.616778763Z [2024-06-19 02:23:02,616: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T02:23:02.619977813Z [2024-06-19 02:23:02,619: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:23:02.650809790Z [2024-06-19 02:23:02,650: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T02:23:02.653724709Z [2024-06-19 02:23:02,652: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:23:02.654242639Z [2024-06-19 02:23:02,654: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:23:02.654836820Z [2024-06-19 02:23:02,654: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:23:02.655335038Z [2024-06-19 02:23:02,655: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T02:23:02.655961126Z [2024-06-19 02:23:02,655: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T02:23:02.656707089Z [2024-06-19 02:23:02,656: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:23:02.699525852Z [2024-06-19 02:23:02,699: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:23:02.752611322Z [2024-06-19 02:23:02,752: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:23:05.440608323Z [2024-06-19 02:23:05,439: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ec80d36b-e80a-4cad-90bc-16ba9834fb86] succeeded in 4.41123282099943s: None 2024-06-19T02:23:06.191611006Z [2024-06-19 02:23:06,191: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d2200eeb-5070-412f-8c8f-92eadc99c9dc] succeeded in 5.187791334001304s: None 2024-06-19T02:24:00.297770524Z [2024-06-19 02:24:00,296: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[080333e2-2507-465f-a575-8dd6ff5533ef] received 2024-06-19T02:24:00.304617739Z [2024-06-19 02:24:00,304: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[805c4baa-f6bd-43a9-b9f9-db1f7a57e458] received 2024-06-19T02:24:00.310356731Z [2024-06-19 02:24:00,310: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4e443b1a-4cc8-40b0-bf1b-d3c2f73663e6] received 2024-06-19T02:24:00.313003749Z [2024-06-19 02:24:00,312: INFO/ForkPoolWorker-15] [080333e2-2507-465f-a575-8dd6ff5533ef] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-19T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-19T02:24:00.319800025Z [2024-06-19 02:24:00,319: INFO/ForkPoolWorker-1] [4e443b1a-4cc8-40b0-bf1b-d3c2f73663e6] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T02:24:00.322067982Z [2024-06-19 02:24:00,321: INFO/ForkPoolWorker-16] [805c4baa-f6bd-43a9-b9f9-db1f7a57e458] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T02:24:00.325070476Z [2024-06-19 02:24:00,324: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c957c0b9-055d-4ddc-b4f5-654078bfe02a] received 2024-06-19T02:24:00.334058585Z [2024-06-19 02:24:00,333: INFO/ForkPoolWorker-2] [c957c0b9-055d-4ddc-b4f5-654078bfe02a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T02:24:00.677914277Z [2024-06-19 02:24:00,674: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T02:24:00.720810144Z [2024-06-19 02:24:00,717: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-19T02:24:00.722902373Z [2024-06-19 02:24:00,718: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T02:24:00.835235691Z [2024-06-19 02:24:00,831: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T02:24:00.977671736Z [2024-06-19 02:24:00,977: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:24:01.040932472Z [2024-06-19 02:24:01,040: INFO/ForkPoolWorker-1] Getting SDNC list 2024-06-19T02:24:01.046728657Z [2024-06-19 02:24:01,046: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:24:01.088527447Z [2024-06-19 02:24:01,088: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T02:24:01.091380190Z [2024-06-19 02:24:01,091: INFO/ForkPoolWorker-1] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T02:24:01.092355049Z [2024-06-19 02:24:01,091: INFO/ForkPoolWorker-1] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T02:24:01.094503750Z [2024-06-19 02:24:01,092: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-06-19T02:24:01.094514686Z [2024-06-19 02:24:01,093: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T02:24:01.189192528Z [2024-06-19 02:24:01,188: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:24:01.618158494Z [2024-06-19 02:24:01,617: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[080333e2-2507-465f-a575-8dd6ff5533ef] succeeded in 1.3174173410006915s: None 2024-06-19T02:24:01.833832563Z [2024-06-19 02:24:01,833: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4e443b1a-4cc8-40b0-bf1b-d3c2f73663e6] succeeded in 1.5213802329999453s: None 2024-06-19T02:24:02.016459051Z [2024-06-19 02:24:02,016: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T02:24:02.020027695Z [2024-06-19 02:24:02,019: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:24:02.038992493Z [2024-06-19 02:24:02,038: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T02:24:02.040426678Z [2024-06-19 02:24:02,040: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:24:02.040581721Z [2024-06-19 02:24:02,040: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:24:02.040795211Z [2024-06-19 02:24:02,040: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:24:02.041154874Z [2024-06-19 02:24:02,041: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T02:24:02.041526308Z [2024-06-19 02:24:02,041: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T02:24:02.041667952Z [2024-06-19 02:24:02,041: INFO/ForkPoolWorker-16] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:24:02.072698577Z [2024-06-19 02:24:02,072: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-19T02:24:02.075930034Z [2024-06-19 02:24:02,075: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:24:02.101069143Z [2024-06-19 02:24:02,100: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T02:24:02.102092171Z [2024-06-19 02:24:02,101: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:24:02.102117436Z [2024-06-19 02:24:02,101: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:24:02.102241266Z [2024-06-19 02:24:02,102: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:24:02.102312871Z [2024-06-19 02:24:02,102: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-19T02:24:02.102569412Z [2024-06-19 02:24:02,102: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-06-19T02:24:02.102588173Z [2024-06-19 02:24:02,102: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:24:02.137713333Z [2024-06-19 02:24:02,137: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:24:02.180075083Z [2024-06-19 02:24:02,179: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:24:03.812698531Z [2024-06-19 02:24:03,812: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[805c4baa-f6bd-43a9-b9f9-db1f7a57e458] succeeded in 3.503232345001379s: None 2024-06-19T02:24:03.999852681Z [2024-06-19 02:24:03,999: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[c957c0b9-055d-4ddc-b4f5-654078bfe02a] succeeded in 3.6724103590004233s: None 2024-06-19T02:25:00.596373703Z [2024-06-19 02:25:00,596: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9556e37a-a01a-473a-af2d-a6af4c9dbfb3] received 2024-06-19T02:25:00.597914252Z [2024-06-19 02:25:00,597: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ff7962fc-a7de-4a0b-8993-38fce63c80c6] received 2024-06-19T02:25:00.603368889Z [2024-06-19 02:25:00,603: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[417a4810-733e-46b1-b148-651af260881c] received 2024-06-19T02:25:00.607627294Z [2024-06-19 02:25:00,606: INFO/ForkPoolWorker-15] [9556e37a-a01a-473a-af2d-a6af4c9dbfb3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-19T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T02:25:00.609343803Z [2024-06-19 02:25:00,609: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[27f22e10-6246-41e8-a12c-150cbb5670f2] received 2024-06-19T02:25:00.611510768Z [2024-06-19 02:25:00,611: INFO/ForkPoolWorker-1] [417a4810-733e-46b1-b148-651af260881c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T02:25:00.622118161Z [2024-06-19 02:25:00,621: INFO/ForkPoolWorker-2] [27f22e10-6246-41e8-a12c-150cbb5670f2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T02:25:00.628774193Z [2024-06-19 02:25:00,628: INFO/ForkPoolWorker-16] [ff7962fc-a7de-4a0b-8993-38fce63c80c6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T02:25:00.936380494Z [2024-06-19 02:25:00,933: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T02:25:00.990727064Z [2024-06-19 02:25:00,985: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T02:25:01.028426801Z [2024-06-19 02:25:01,025: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T02:25:01.131044474Z [2024-06-19 02:25:01,126: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T02:25:01.294357689Z [2024-06-19 02:25:01,293: INFO/ForkPoolWorker-2] Getting SDNC list 2024-06-19T02:25:01.298742395Z [2024-06-19 02:25:01,298: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:25:01.340827363Z [2024-06-19 02:25:01,340: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T02:25:01.341881362Z [2024-06-19 02:25:01,341: INFO/ForkPoolWorker-2] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T02:25:01.342028807Z [2024-06-19 02:25:01,341: INFO/ForkPoolWorker-2] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T02:25:01.342057451Z [2024-06-19 02:25:01,341: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-06-19T02:25:01.342265417Z [2024-06-19 02:25:01,342: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T02:25:01.462870893Z [2024-06-19 02:25:01,462: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:25:02.033100221Z [2024-06-19 02:25:02,032: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[27f22e10-6246-41e8-a12c-150cbb5670f2] succeeded in 1.421553522000977s: None 2024-06-19T02:25:02.137164449Z [2024-06-19 02:25:02,136: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T02:25:02.140431083Z [2024-06-19 02:25:02,140: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:25:02.158904500Z [2024-06-19 02:25:02,158: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T02:25:02.160665644Z [2024-06-19 02:25:02,160: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:25:02.160874162Z [2024-06-19 02:25:02,160: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:25:02.161423956Z [2024-06-19 02:25:02,161: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:25:02.161701082Z [2024-06-19 02:25:02,161: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T02:25:02.162256818Z [2024-06-19 02:25:02,162: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T02:25:02.162455909Z [2024-06-19 02:25:02,162: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:25:02.308517338Z [2024-06-19 02:25:02,308: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:25:02.397981778Z [2024-06-19 02:25:02,397: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T02:25:02.401533768Z [2024-06-19 02:25:02,401: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:25:02.417316339Z [2024-06-19 02:25:02,416: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T02:25:02.420662264Z [2024-06-19 02:25:02,420: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:25:02.433127702Z [2024-06-19 02:25:02,432: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T02:25:02.435088728Z [2024-06-19 02:25:02,434: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:25:02.435305067Z [2024-06-19 02:25:02,435: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:25:02.435736394Z [2024-06-19 02:25:02,435: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:25:02.435957539Z [2024-06-19 02:25:02,435: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T02:25:02.436397947Z [2024-06-19 02:25:02,436: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-19T02:25:02.436593217Z [2024-06-19 02:25:02,436: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:25:02.442691003Z [2024-06-19 02:25:02,442: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T02:25:02.444355374Z [2024-06-19 02:25:02,444: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:25:02.444483235Z [2024-06-19 02:25:02,444: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:25:02.444685306Z [2024-06-19 02:25:02,444: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:25:02.444699175Z [2024-06-19 02:25:02,444: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T02:25:02.445047297Z [2024-06-19 02:25:02,444: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T02:25:02.445115609Z [2024-06-19 02:25:02,445: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:25:02.529172532Z [2024-06-19 02:25:02,528: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:25:02.544177263Z [2024-06-19 02:25:02,543: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:25:02.924845372Z [2024-06-19 02:25:02,924: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9556e37a-a01a-473a-af2d-a6af4c9dbfb3] succeeded in 2.325780406999911s: None 2024-06-19T02:25:03.050046603Z [2024-06-19 02:25:03,049: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f329ee06-2691-414c-8566-58378af0dda6] received 2024-06-19T02:25:03.065611465Z [2024-06-19 02:25:03,065: INFO/ForkPoolWorker-15] [f329ee06-2691-414c-8566-58378af0dda6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'split_metrics', 'scheduled__2024-06-19T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T02:25:03.322103908Z [2024-06-19 02:25:03,319: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T02:25:04.118079523Z [2024-06-19 02:25:04,117: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[417a4810-733e-46b1-b148-651af260881c] succeeded in 3.5123422800006665s: None 2024-06-19T02:25:04.443705209Z [2024-06-19 02:25:04,443: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ff7962fc-a7de-4a0b-8993-38fce63c80c6] succeeded in 3.839112218000082s: None 2024-06-19T02:25:04.474114445Z [2024-06-19 02:25:04,473: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T02:25:04.477544649Z [2024-06-19 02:25:04,477: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:25:04.504570022Z [2024-06-19 02:25:04,504: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T02:25:04.505863246Z [2024-06-19 02:25:04,505: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:25:04.505913423Z [2024-06-19 02:25:04,505: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:25:04.506036861Z [2024-06-19 02:25:04,505: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:25:04.506082790Z [2024-06-19 02:25:04,505: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T02:25:04.506379411Z [2024-06-19 02:25:04,506: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T02:25:04.506422316Z [2024-06-19 02:25:04,506: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:25:04.594586826Z [2024-06-19 02:25:04,594: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:25:05.319527129Z [2024-06-19 02:25:05,319: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f329ee06-2691-414c-8566-58378af0dda6] succeeded in 2.267094311000619s: None 2024-06-19T02:25:05.674019825Z [2024-06-19 02:25:05,673: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6c0ec1c3-8166-4ebc-a9a0-2dc4039bc04c] received 2024-06-19T02:25:05.683546701Z [2024-06-19 02:25:05,683: INFO/ForkPoolWorker-15] [6c0ec1c3-8166-4ebc-a9a0-2dc4039bc04c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'collect_metrics', 'scheduled__2024-06-19T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-19T02:25:05.987028253Z [2024-06-19 02:25:05,983: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T02:25:07.065580819Z [2024-06-19 02:25:07,065: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T02:25:07.068811415Z [2024-06-19 02:25:07,068: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:25:07.096251214Z [2024-06-19 02:25:07,095: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T02:25:07.098536845Z [2024-06-19 02:25:07,098: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:25:07.098683711Z [2024-06-19 02:25:07,098: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:25:07.098985745Z [2024-06-19 02:25:07,098: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:25:07.099160869Z [2024-06-19 02:25:07,098: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T02:25:07.099779218Z [2024-06-19 02:25:07,099: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T02:25:07.100025488Z [2024-06-19 02:25:07,099: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:25:07.222063004Z [2024-06-19 02:25:07,221: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:25:08.721343198Z [2024-06-19 02:25:08,720: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6c0ec1c3-8166-4ebc-a9a0-2dc4039bc04c] succeeded in 3.043848887000422s: None 2024-06-19T02:25:09.280230147Z [2024-06-19 02:25:09,279: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cc8faa37-a7fc-41f6-bcb7-e81d32c99086] received 2024-06-19T02:25:09.293560922Z [2024-06-19 02:25:09,293: INFO/ForkPoolWorker-15] [cc8faa37-a7fc-41f6-bcb7-e81d32c99086] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'send_prometheus', 'scheduled__2024-06-19T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T02:25:09.616318895Z [2024-06-19 02:25:09,613: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T02:25:10.607208096Z [2024-06-19 02:25:10,606: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T02:25:10.610296541Z [2024-06-19 02:25:10,609: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:25:10.641648608Z [2024-06-19 02:25:10,641: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T02:25:10.643658842Z [2024-06-19 02:25:10,643: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:25:10.643760015Z [2024-06-19 02:25:10,643: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:25:10.644037280Z [2024-06-19 02:25:10,643: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:25:10.644135667Z [2024-06-19 02:25:10,643: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T02:25:10.645635762Z [2024-06-19 02:25:10,645: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T02:25:10.645902900Z [2024-06-19 02:25:10,645: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:25:10.746180228Z [2024-06-19 02:25:10,745: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:25:11.315044839Z [2024-06-19 02:25:11,314: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cc8faa37-a7fc-41f6-bcb7-e81d32c99086] succeeded in 2.0319963229994755s: None 2024-06-19T02:26:00.822120343Z [2024-06-19 02:26:00,821: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9febee3e-2a4b-4493-958c-035652b9d8df] received 2024-06-19T02:26:00.827672957Z [2024-06-19 02:26:00,827: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[65737ee1-9819-496c-ba6c-60bff886372b] received 2024-06-19T02:26:00.830867470Z [2024-06-19 02:26:00,830: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[25d34af8-2c91-44b4-8a82-e892b0aed973] received 2024-06-19T02:26:00.839627825Z [2024-06-19 02:26:00,839: INFO/ForkPoolWorker-15] [9febee3e-2a4b-4493-958c-035652b9d8df] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-19T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-19T02:26:00.841112489Z [2024-06-19 02:26:00,840: INFO/ForkPoolWorker-16] [65737ee1-9819-496c-ba6c-60bff886372b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T02:26:00.842727561Z [2024-06-19 02:26:00,842: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[858c0cff-63d9-402e-b3ce-8f05639eb741] received 2024-06-19T02:26:00.844593424Z [2024-06-19 02:26:00,844: INFO/ForkPoolWorker-1] [25d34af8-2c91-44b4-8a82-e892b0aed973] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T02:26:00.850506798Z [2024-06-19 02:26:00,850: INFO/ForkPoolWorker-2] [858c0cff-63d9-402e-b3ce-8f05639eb741] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T02:26:01.143441490Z [2024-06-19 02:26:01,140: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-19T02:26:01.198218294Z [2024-06-19 02:26:01,193: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T02:26:01.206028261Z [2024-06-19 02:26:01,202: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T02:26:01.213655934Z [2024-06-19 02:26:01,209: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T02:26:01.402901686Z [2024-06-19 02:26:01,402: INFO/ForkPoolWorker-2] Getting SDNC list 2024-06-19T02:26:01.407175874Z [2024-06-19 02:26:01,406: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:26:01.437915587Z [2024-06-19 02:26:01,437: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:26:01.448734356Z [2024-06-19 02:26:01,448: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T02:26:01.452612809Z [2024-06-19 02:26:01,452: INFO/ForkPoolWorker-2] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T02:26:01.452725659Z [2024-06-19 02:26:01,452: INFO/ForkPoolWorker-2] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T02:26:01.452838155Z [2024-06-19 02:26:01,452: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-06-19T02:26:01.453144239Z [2024-06-19 02:26:01,452: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T02:26:01.538378984Z [2024-06-19 02:26:01,538: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:26:02.069116103Z [2024-06-19 02:26:02,068: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9febee3e-2a4b-4493-958c-035652b9d8df] succeeded in 1.2387874690011813s: None 2024-06-19T02:26:02.142985865Z [2024-06-19 02:26:02,142: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[858c0cff-63d9-402e-b3ce-8f05639eb741] succeeded in 1.2981865640012984s: None 2024-06-19T02:26:02.580058833Z [2024-06-19 02:26:02,579: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T02:26:02.583274219Z [2024-06-19 02:26:02,582: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:26:02.609765462Z [2024-06-19 02:26:02,609: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T02:26:02.611256787Z [2024-06-19 02:26:02,611: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:26:02.611508863Z [2024-06-19 02:26:02,611: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:26:02.611822705Z [2024-06-19 02:26:02,611: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:26:02.612007903Z [2024-06-19 02:26:02,611: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T02:26:02.612545934Z [2024-06-19 02:26:02,612: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-19T02:26:02.612699528Z [2024-06-19 02:26:02,612: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:26:02.641797649Z [2024-06-19 02:26:02,641: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T02:26:02.654536310Z [2024-06-19 02:26:02,653: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:26:02.674887235Z [2024-06-19 02:26:02,674: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T02:26:02.676688020Z [2024-06-19 02:26:02,676: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:26:02.676866315Z [2024-06-19 02:26:02,676: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:26:02.677491315Z [2024-06-19 02:26:02,677: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:26:02.677691061Z [2024-06-19 02:26:02,677: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T02:26:02.678087360Z [2024-06-19 02:26:02,677: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T02:26:02.678717655Z [2024-06-19 02:26:02,678: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:26:02.689922401Z [2024-06-19 02:26:02,689: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:26:02.782099834Z [2024-06-19 02:26:02,781: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:26:04.987339782Z [2024-06-19 02:26:04,986: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[25d34af8-2c91-44b4-8a82-e892b0aed973] succeeded in 4.15336804800063s: None 2024-06-19T02:26:05.884517662Z [2024-06-19 02:26:05,883: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[65737ee1-9819-496c-ba6c-60bff886372b] succeeded in 5.0544202309993125s: None 2024-06-19T02:26:25.086758144Z [2024-06-19 02:26:25,086: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b5c975c7-5b64-4644-a036-29db452182c4] received 2024-06-19T02:26:25.117498399Z [2024-06-19 02:26:25,116: INFO/ForkPoolWorker-15] [b5c975c7-5b64-4644-a036-29db452182c4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_alarm', 'main_task', 'vdu_alarm_20240619022623_401756', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_alarm.py'] 2024-06-19T02:26:25.453560612Z [2024-06-19 02:26:25,446: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_alarm.py 2024-06-19T02:26:25.888783522Z [2024-06-19 02:26:25,888: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:26:26.555547405Z [2024-06-19 02:26:26,555: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b5c975c7-5b64-4644-a036-29db452182c4] succeeded in 1.462466086000859s: None 2024-06-19T02:27:01.147930657Z [2024-06-19 02:27:01,147: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f09a9f4c-7167-442d-9f86-a1f7c968e84b] received 2024-06-19T02:27:01.154169599Z [2024-06-19 02:27:01,153: INFO/ForkPoolWorker-15] [f09a9f4c-7167-442d-9f86-a1f7c968e84b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T02:27:01.154473884Z [2024-06-19 02:27:01,154: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[41c8f81c-047c-4c7e-8e24-a80eb7db0a90] received 2024-06-19T02:27:01.164601391Z [2024-06-19 02:27:01,164: INFO/ForkPoolWorker-16] [41c8f81c-047c-4c7e-8e24-a80eb7db0a90] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T02:27:01.168613501Z [2024-06-19 02:27:01,168: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2bf434c7-d7ef-4869-99f0-d0a14fbb8860] received 2024-06-19T02:27:01.175007632Z [2024-06-19 02:27:01,174: INFO/ForkPoolWorker-1] [2bf434c7-d7ef-4869-99f0-d0a14fbb8860] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T02:27:01.444269258Z [2024-06-19 02:27:01,440: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T02:27:01.449718015Z [2024-06-19 02:27:01,445: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T02:27:01.548863765Z [2024-06-19 02:27:01,544: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T02:27:01.750237483Z [2024-06-19 02:27:01,749: INFO/ForkPoolWorker-16] Getting SDNC list 2024-06-19T02:27:01.754882500Z [2024-06-19 02:27:01,754: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:27:01.782939206Z [2024-06-19 02:27:01,782: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T02:27:01.784289252Z [2024-06-19 02:27:01,783: INFO/ForkPoolWorker-16] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T02:27:01.784301576Z [2024-06-19 02:27:01,784: INFO/ForkPoolWorker-16] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T02:27:01.784493307Z [2024-06-19 02:27:01,784: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-06-19T02:27:01.784999242Z [2024-06-19 02:27:01,784: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T02:27:01.908408074Z [2024-06-19 02:27:01,908: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:27:02.565524331Z [2024-06-19 02:27:02,565: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[41c8f81c-047c-4c7e-8e24-a80eb7db0a90] succeeded in 1.4094841639998776s: None 2024-06-19T02:27:02.603680102Z [2024-06-19 02:27:02,603: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T02:27:02.606950097Z [2024-06-19 02:27:02,606: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:27:02.637227892Z [2024-06-19 02:27:02,637: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T02:27:02.638354605Z [2024-06-19 02:27:02,638: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:27:02.638669827Z [2024-06-19 02:27:02,638: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:27:02.638869479Z [2024-06-19 02:27:02,638: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:27:02.639016833Z [2024-06-19 02:27:02,638: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T02:27:02.639261907Z [2024-06-19 02:27:02,639: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T02:27:02.639412965Z [2024-06-19 02:27:02,639: INFO/ForkPoolWorker-15] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:27:02.657077289Z [2024-06-19 02:27:02,656: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T02:27:02.660176952Z [2024-06-19 02:27:02,659: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:27:02.677108553Z [2024-06-19 02:27:02,676: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T02:27:02.678226554Z [2024-06-19 02:27:02,678: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:27:02.678342397Z [2024-06-19 02:27:02,678: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:27:02.678516157Z [2024-06-19 02:27:02,678: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:27:02.678648795Z [2024-06-19 02:27:02,678: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T02:27:02.679032653Z [2024-06-19 02:27:02,678: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-06-19T02:27:02.679259663Z [2024-06-19 02:27:02,679: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:27:02.723090773Z [2024-06-19 02:27:02,722: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:27:02.748893744Z [2024-06-19 02:27:02,748: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:27:04.244009494Z [2024-06-19 02:27:04,243: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f09a9f4c-7167-442d-9f86-a1f7c968e84b] succeeded in 3.0945046120014013s: None 2024-06-19T02:27:04.564786874Z [2024-06-19 02:27:04,564: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2bf434c7-d7ef-4869-99f0-d0a14fbb8860] succeeded in 3.394059333999394s: None 2024-06-19T02:28:01.024667452Z [2024-06-19 02:28:01,020: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d316c169-4026-4eab-906e-f6fbfe586ad9] received 2024-06-19T02:28:01.024699965Z [2024-06-19 02:28:01,023: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[08e2a465-0775-4b31-ad49-597565f3015b] received 2024-06-19T02:28:01.029117082Z [2024-06-19 02:28:01,028: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dbc70993-b5bc-4afc-838d-16bb7094fcfd] received 2024-06-19T02:28:01.033854515Z [2024-06-19 02:28:01,030: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[87bebf99-dd0c-4059-933a-9d1d9f047248] received 2024-06-19T02:28:01.044283850Z [2024-06-19 02:28:01,037: INFO/ForkPoolWorker-15] [d316c169-4026-4eab-906e-f6fbfe586ad9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T02:28:01.044544957Z [2024-06-19 02:28:01,038: INFO/ForkPoolWorker-2] [87bebf99-dd0c-4059-933a-9d1d9f047248] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T02:28:01.070711294Z [2024-06-19 02:28:01,067: INFO/ForkPoolWorker-1] [dbc70993-b5bc-4afc-838d-16bb7094fcfd] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-19T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-19T02:28:01.073091685Z [2024-06-19 02:28:01,068: INFO/ForkPoolWorker-16] [08e2a465-0775-4b31-ad49-597565f3015b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T02:28:01.583848593Z [2024-06-19 02:28:01,580: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-19T02:28:01.619255444Z [2024-06-19 02:28:01,616: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T02:28:01.678524131Z [2024-06-19 02:28:01,675: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T02:28:01.735510597Z [2024-06-19 02:28:01,732: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T02:28:01.860864118Z [2024-06-19 02:28:01,860: INFO/ForkPoolWorker-16] Getting SDNC list 2024-06-19T02:28:01.865703433Z [2024-06-19 02:28:01,865: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:28:01.923120071Z [2024-06-19 02:28:01,922: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T02:28:01.931306854Z [2024-06-19 02:28:01,931: INFO/ForkPoolWorker-16] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T02:28:01.931590729Z [2024-06-19 02:28:01,931: INFO/ForkPoolWorker-16] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T02:28:01.931748285Z [2024-06-19 02:28:01,931: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-06-19T02:28:01.932012251Z [2024-06-19 02:28:01,931: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T02:28:01.954065890Z [2024-06-19 02:28:01,953: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:28:02.080002878Z [2024-06-19 02:28:02,079: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:28:02.851825388Z [2024-06-19 02:28:02,851: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[dbc70993-b5bc-4afc-838d-16bb7094fcfd] succeeded in 1.816565876999448s: None 2024-06-19T02:28:03.002401017Z [2024-06-19 02:28:03,000: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[08e2a465-0775-4b31-ad49-597565f3015b] succeeded in 1.9729727640005876s: None 2024-06-19T02:28:03.409793076Z [2024-06-19 02:28:03,409: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T02:28:03.413926451Z [2024-06-19 02:28:03,413: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:28:03.420681001Z [2024-06-19 02:28:03,420: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-19T02:28:03.424079651Z [2024-06-19 02:28:03,423: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:28:03.440298633Z [2024-06-19 02:28:03,440: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T02:28:03.442758404Z [2024-06-19 02:28:03,442: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:28:03.442852950Z [2024-06-19 02:28:03,442: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:28:03.442999667Z [2024-06-19 02:28:03,442: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:28:03.443065882Z [2024-06-19 02:28:03,442: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T02:28:03.443307283Z [2024-06-19 02:28:03,443: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T02:28:03.443481806Z [2024-06-19 02:28:03,443: INFO/ForkPoolWorker-15] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:28:03.452090600Z [2024-06-19 02:28:03,451: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T02:28:03.453527884Z [2024-06-19 02:28:03,453: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:28:03.453543386Z [2024-06-19 02:28:03,453: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:28:03.453681449Z [2024-06-19 02:28:03,453: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:28:03.453718969Z [2024-06-19 02:28:03,453: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-19T02:28:03.453939510Z [2024-06-19 02:28:03,453: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-06-19T02:28:03.453979509Z [2024-06-19 02:28:03,453: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:28:03.568264493Z [2024-06-19 02:28:03,567: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:28:03.610667818Z [2024-06-19 02:28:03,610: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:28:05.437990768Z [2024-06-19 02:28:05,437: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d316c169-4026-4eab-906e-f6fbfe586ad9] succeeded in 4.415387899000052s: None 2024-06-19T02:28:05.814914122Z [2024-06-19 02:28:05,814: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[87bebf99-dd0c-4059-933a-9d1d9f047248] succeeded in 4.783087564001107s: None 2024-06-19T02:29:00.586558969Z [2024-06-19 02:29:00,586: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a88552fc-abf2-4116-93bd-a18093e4db26] received 2024-06-19T02:29:00.600042502Z [2024-06-19 02:29:00,599: INFO/ForkPoolWorker-15] [a88552fc-abf2-4116-93bd-a18093e4db26] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T02:29:00.626579457Z [2024-06-19 02:29:00,626: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d0b142e7-81f9-4d04-9548-890bd3710590] received 2024-06-19T02:29:00.634637331Z [2024-06-19 02:29:00,634: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aee9b4d6-385a-48b4-90b8-352e15c6f85e] received 2024-06-19T02:29:00.654695354Z [2024-06-19 02:29:00,654: INFO/ForkPoolWorker-1] [aee9b4d6-385a-48b4-90b8-352e15c6f85e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T02:29:00.660658803Z [2024-06-19 02:29:00,660: INFO/ForkPoolWorker-16] [d0b142e7-81f9-4d04-9548-890bd3710590] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T02:29:01.022632469Z [2024-06-19 02:29:01,018: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T02:29:01.085527406Z [2024-06-19 02:29:01,077: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T02:29:01.138948372Z [2024-06-19 02:29:01,134: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T02:29:01.205686553Z [2024-06-19 02:29:01,205: INFO/ForkPoolWorker-1] Getting SDNC list 2024-06-19T02:29:01.209497867Z [2024-06-19 02:29:01,209: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:29:01.285668647Z [2024-06-19 02:29:01,285: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T02:29:01.292896940Z [2024-06-19 02:29:01,292: INFO/ForkPoolWorker-1] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T02:29:01.293075434Z [2024-06-19 02:29:01,292: INFO/ForkPoolWorker-1] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T02:29:01.293139632Z [2024-06-19 02:29:01,293: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-06-19T02:29:01.293355832Z [2024-06-19 02:29:01,293: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T02:29:01.384566534Z [2024-06-19 02:29:01,384: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:29:02.169870574Z [2024-06-19 02:29:02,169: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[aee9b4d6-385a-48b4-90b8-352e15c6f85e] succeeded in 1.5324038640010258s: None 2024-06-19T02:29:02.550978948Z [2024-06-19 02:29:02,550: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T02:29:02.554297157Z [2024-06-19 02:29:02,553: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:29:02.573831697Z [2024-06-19 02:29:02,573: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T02:29:02.575347219Z [2024-06-19 02:29:02,575: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:29:02.575598571Z [2024-06-19 02:29:02,575: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:29:02.575877696Z [2024-06-19 02:29:02,575: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:29:02.575961217Z [2024-06-19 02:29:02,575: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T02:29:02.576571341Z [2024-06-19 02:29:02,576: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-06-19T02:29:02.576740140Z [2024-06-19 02:29:02,576: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:29:02.682776789Z [2024-06-19 02:29:02,682: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:29:02.829787614Z [2024-06-19 02:29:02,829: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T02:29:02.832883033Z [2024-06-19 02:29:02,832: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:29:02.868287554Z [2024-06-19 02:29:02,868: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T02:29:02.869795098Z [2024-06-19 02:29:02,869: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:29:02.869950767Z [2024-06-19 02:29:02,869: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:29:02.870125811Z [2024-06-19 02:29:02,869: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:29:02.870247278Z [2024-06-19 02:29:02,870: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T02:29:02.870634011Z [2024-06-19 02:29:02,870: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T02:29:02.870684995Z [2024-06-19 02:29:02,870: INFO/ForkPoolWorker-16] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:29:03.030724274Z [2024-06-19 02:29:03,030: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:29:05.183031313Z [2024-06-19 02:29:05,182: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d0b142e7-81f9-4d04-9548-890bd3710590] succeeded in 4.548357792999013s: None 2024-06-19T02:29:06.356709786Z [2024-06-19 02:29:06,356: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a88552fc-abf2-4116-93bd-a18093e4db26] succeeded in 5.767233642000065s: None 2024-06-19T02:30:00.948532322Z [2024-06-19 02:30:00,948: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e276aec4-b9d8-4f6c-9d0b-d2a3ee0f6f7f] received 2024-06-19T02:30:00.951097314Z [2024-06-19 02:30:00,950: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c4f40e9b-d644-4ef7-a2a0-f18348394f28] received 2024-06-19T02:30:00.960864266Z [2024-06-19 02:30:00,960: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6ba19ed3-b06f-45d3-834f-07027fa62c73] received 2024-06-19T02:30:00.964589526Z [2024-06-19 02:30:00,964: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8d9946d9-7f9c-4bb0-9094-8b2c4400f6c4] received 2024-06-19T02:30:00.967716699Z [2024-06-19 02:30:00,967: INFO/ForkPoolWorker-15] [e276aec4-b9d8-4f6c-9d0b-d2a3ee0f6f7f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-19T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T02:30:00.969711851Z [2024-06-19 02:30:00,969: INFO/ForkPoolWorker-16] [c4f40e9b-d644-4ef7-a2a0-f18348394f28] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T02:30:00.973444277Z [2024-06-19 02:30:00,973: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7d7126b5-0e82-4f42-a550-2dd3c388f465] received 2024-06-19T02:30:00.977076252Z [2024-06-19 02:30:00,976: INFO/ForkPoolWorker-1] [6ba19ed3-b06f-45d3-834f-07027fa62c73] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-19T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-19T02:30:00.982319376Z [2024-06-19 02:30:00,982: INFO/ForkPoolWorker-2] [8d9946d9-7f9c-4bb0-9094-8b2c4400f6c4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T02:30:01.012565746Z [2024-06-19 02:30:01,012: INFO/ForkPoolWorker-3] [7d7126b5-0e82-4f42-a550-2dd3c388f465] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T02:30:01.374986542Z [2024-06-19 02:30:01,371: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T02:30:01.551267694Z [2024-06-19 02:30:01,546: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T02:30:01.665294182Z [2024-06-19 02:30:01,649: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-19T02:30:01.879777609Z [2024-06-19 02:30:01,867: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T02:30:01.930802239Z [2024-06-19 02:30:01,926: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T02:30:02.154415314Z [2024-06-19 02:30:02,154: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:30:02.554981255Z [2024-06-19 02:30:02,554: INFO/ForkPoolWorker-3] Getting SDNC list 2024-06-19T02:30:02.558961073Z [2024-06-19 02:30:02,558: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:30:02.585732582Z [2024-06-19 02:30:02,585: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-06-19T02:30:02.586549326Z [2024-06-19 02:30:02,586: INFO/ForkPoolWorker-3] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T02:30:02.586615144Z [2024-06-19 02:30:02,586: INFO/ForkPoolWorker-3] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T02:30:02.586663864Z [2024-06-19 02:30:02,586: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-06-19T02:30:02.586879613Z [2024-06-19 02:30:02,586: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T02:30:02.721818556Z [2024-06-19 02:30:02,721: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:30:02.878174741Z [2024-06-19 02:30:02,877: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6ba19ed3-b06f-45d3-834f-07027fa62c73] succeeded in 1.91502323199893s: None 2024-06-19T02:30:03.435554110Z [2024-06-19 02:30:03,435: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[7d7126b5-0e82-4f42-a550-2dd3c388f465] succeeded in 2.456409567999799s: None 2024-06-19T02:30:03.556423354Z [2024-06-19 02:30:03,556: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T02:30:03.559658169Z [2024-06-19 02:30:03,559: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:30:03.575324890Z [2024-06-19 02:30:03,575: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T02:30:03.576495198Z [2024-06-19 02:30:03,576: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:30:03.576631250Z [2024-06-19 02:30:03,576: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:30:03.576823518Z [2024-06-19 02:30:03,576: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:30:03.577158915Z [2024-06-19 02:30:03,576: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T02:30:03.577417328Z [2024-06-19 02:30:03,577: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T02:30:03.577584847Z [2024-06-19 02:30:03,577: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:30:03.670825714Z [2024-06-19 02:30:03,670: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:30:03.720084579Z [2024-06-19 02:30:03,719: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T02:30:03.723314808Z [2024-06-19 02:30:03,722: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:30:03.741088871Z [2024-06-19 02:30:03,740: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T02:30:03.742914411Z [2024-06-19 02:30:03,742: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:30:03.743084782Z [2024-06-19 02:30:03,742: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:30:03.743299481Z [2024-06-19 02:30:03,743: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:30:03.743491261Z [2024-06-19 02:30:03,743: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T02:30:03.744119757Z [2024-06-19 02:30:03,743: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-19T02:30:03.744567546Z [2024-06-19 02:30:03,744: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:30:03.761189741Z [2024-06-19 02:30:03,760: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-19T02:30:03.764550683Z [2024-06-19 02:30:03,764: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:30:03.789701560Z [2024-06-19 02:30:03,789: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T02:30:03.793471099Z [2024-06-19 02:30:03,793: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:30:03.793620164Z [2024-06-19 02:30:03,793: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:30:03.793797299Z [2024-06-19 02:30:03,793: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:30:03.793940638Z [2024-06-19 02:30:03,793: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-19T02:30:03.794257047Z [2024-06-19 02:30:03,794: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T02:30:03.794406160Z [2024-06-19 02:30:03,794: INFO/ForkPoolWorker-2] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:30:03.838130932Z [2024-06-19 02:30:03,837: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:30:03.893373412Z [2024-06-19 02:30:03,893: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:30:04.344722940Z [2024-06-19 02:30:04,344: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e276aec4-b9d8-4f6c-9d0b-d2a3ee0f6f7f] succeeded in 3.392405606000466s: None 2024-06-19T02:30:05.456324477Z [2024-06-19 02:30:05,455: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[16b6d7e3-1455-4455-aa83-762d82b8e1f9] received 2024-06-19T02:30:05.470471859Z [2024-06-19 02:30:05,468: INFO/ForkPoolWorker-15] [16b6d7e3-1455-4455-aa83-762d82b8e1f9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'split_metrics', 'scheduled__2024-06-19T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T02:30:05.757243562Z [2024-06-19 02:30:05,753: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T02:30:05.869974611Z [2024-06-19 02:30:05,869: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c4f40e9b-d644-4ef7-a2a0-f18348394f28] succeeded in 4.9136330139990605s: None 2024-06-19T02:30:06.345010575Z [2024-06-19 02:30:06,344: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[8d9946d9-7f9c-4bb0-9094-8b2c4400f6c4] succeeded in 5.37420147299963s: None 2024-06-19T02:30:06.846300406Z [2024-06-19 02:30:06,845: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T02:30:06.849441428Z [2024-06-19 02:30:06,848: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:30:06.876000489Z [2024-06-19 02:30:06,875: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T02:30:06.877669664Z [2024-06-19 02:30:06,877: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:30:06.877764065Z [2024-06-19 02:30:06,877: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:30:06.877974893Z [2024-06-19 02:30:06,877: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:30:06.878003192Z [2024-06-19 02:30:06,877: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T02:30:06.878369804Z [2024-06-19 02:30:06,878: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T02:30:06.878379945Z [2024-06-19 02:30:06,878: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:30:06.989340212Z [2024-06-19 02:30:06,988: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:30:07.596460193Z [2024-06-19 02:30:07,596: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[16b6d7e3-1455-4455-aa83-762d82b8e1f9] succeeded in 2.1376790790000086s: None 2024-06-19T02:30:08.145146458Z [2024-06-19 02:30:08,144: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[365cd827-9b8e-47f9-8fc0-5174887a3672] received 2024-06-19T02:30:08.179581328Z [2024-06-19 02:30:08,179: INFO/ForkPoolWorker-15] [365cd827-9b8e-47f9-8fc0-5174887a3672] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'collect_metrics', 'scheduled__2024-06-19T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-19T02:30:08.457569323Z [2024-06-19 02:30:08,454: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T02:30:09.517794248Z [2024-06-19 02:30:09,517: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T02:30:09.521128526Z [2024-06-19 02:30:09,520: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:30:09.548893105Z [2024-06-19 02:30:09,548: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T02:30:09.550906642Z [2024-06-19 02:30:09,550: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:30:09.551033499Z [2024-06-19 02:30:09,550: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:30:09.551303288Z [2024-06-19 02:30:09,551: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:30:09.551483451Z [2024-06-19 02:30:09,551: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T02:30:09.551957461Z [2024-06-19 02:30:09,551: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T02:30:09.552155303Z [2024-06-19 02:30:09,551: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:30:09.686311877Z [2024-06-19 02:30:09,685: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:30:10.267756758Z [2024-06-19 02:30:10,267: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[365cd827-9b8e-47f9-8fc0-5174887a3672] succeeded in 2.1208105090008758s: None 2024-06-19T02:30:10.577402296Z [2024-06-19 02:30:10,577: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3ebd2c04-166e-431b-9f3d-246a40a320fa] received 2024-06-19T02:30:10.583869308Z [2024-06-19 02:30:10,583: INFO/ForkPoolWorker-15] [3ebd2c04-166e-431b-9f3d-246a40a320fa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'send_prometheus', 'scheduled__2024-06-19T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T02:30:10.866382390Z [2024-06-19 02:30:10,863: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T02:30:11.991239371Z [2024-06-19 02:30:11,990: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T02:30:11.994340705Z [2024-06-19 02:30:11,993: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:30:12.027552220Z [2024-06-19 02:30:12,027: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T02:30:12.031537258Z [2024-06-19 02:30:12,031: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:30:12.031601867Z [2024-06-19 02:30:12,031: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:30:12.031960705Z [2024-06-19 02:30:12,031: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:30:12.032102078Z [2024-06-19 02:30:12,031: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T02:30:12.032566222Z [2024-06-19 02:30:12,032: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T02:30:12.033120528Z [2024-06-19 02:30:12,032: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:30:12.131628884Z [2024-06-19 02:30:12,131: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:30:12.730801681Z [2024-06-19 02:30:12,730: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3ebd2c04-166e-431b-9f3d-246a40a320fa] succeeded in 2.1509822490006627s: None 2024-06-19T02:30:24.377144776Z [2024-06-19 02:30:24,376: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d50353c8-4126-48f8-97ae-c46183929e34] received 2024-06-19T02:30:24.391017018Z [2024-06-19 02:30:24,390: INFO/ForkPoolWorker-15] [d50353c8-4126-48f8-97ae-c46183929e34] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_alarm', 'main_task', 'vdu_alarm_20240619023023_771433', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_alarm.py'] 2024-06-19T02:30:24.710364897Z [2024-06-19 02:30:24,705: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_alarm.py 2024-06-19T02:30:24.964717127Z [2024-06-19 02:30:24,964: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:30:25.646086710Z [2024-06-19 02:30:25,645: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d50353c8-4126-48f8-97ae-c46183929e34] succeeded in 1.264229565000278s: None 2024-06-19T02:31:01.175661625Z [2024-06-19 02:31:01,175: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b0d88e90-7a6d-47f6-b7e9-559fa0ecffbc] received 2024-06-19T02:31:01.183999111Z [2024-06-19 02:31:01,183: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4c42c049-3726-4d11-9ee5-5383b42f3dc6] received 2024-06-19T02:31:01.187632008Z [2024-06-19 02:31:01,187: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1114c98e-17c2-4db7-9ecd-17a3cebe3e6e] received 2024-06-19T02:31:01.194765575Z [2024-06-19 02:31:01,194: INFO/ForkPoolWorker-15] [b0d88e90-7a6d-47f6-b7e9-559fa0ecffbc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T02:31:01.195426653Z [2024-06-19 02:31:01,195: INFO/ForkPoolWorker-16] [4c42c049-3726-4d11-9ee5-5383b42f3dc6] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T02:31:01.198096579Z [2024-06-19 02:31:01,197: INFO/ForkPoolWorker-1] [1114c98e-17c2-4db7-9ecd-17a3cebe3e6e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T02:31:01.540372193Z [2024-06-19 02:31:01,537: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T02:31:01.606910486Z [2024-06-19 02:31:01,603: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T02:31:01.630509839Z [2024-06-19 02:31:01,626: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T02:31:01.756155808Z [2024-06-19 02:31:01,755: INFO/ForkPoolWorker-16] Getting SDNC list 2024-06-19T02:31:01.760151318Z [2024-06-19 02:31:01,759: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:31:01.791956908Z [2024-06-19 02:31:01,791: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T02:31:01.793482940Z [2024-06-19 02:31:01,793: INFO/ForkPoolWorker-16] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T02:31:01.793654508Z [2024-06-19 02:31:01,793: INFO/ForkPoolWorker-16] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T02:31:01.793774545Z [2024-06-19 02:31:01,793: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-06-19T02:31:01.794041265Z [2024-06-19 02:31:01,793: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T02:31:01.896100975Z [2024-06-19 02:31:01,895: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:31:02.528413853Z [2024-06-19 02:31:02,527: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4c42c049-3726-4d11-9ee5-5383b42f3dc6] succeeded in 1.3426710030016693s: None 2024-06-19T02:31:02.824292878Z [2024-06-19 02:31:02,823: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T02:31:02.828020846Z [2024-06-19 02:31:02,827: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:31:02.848638428Z [2024-06-19 02:31:02,848: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T02:31:02.850121636Z [2024-06-19 02:31:02,849: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:31:02.850219355Z [2024-06-19 02:31:02,850: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:31:02.850528448Z [2024-06-19 02:31:02,850: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:31:02.850695057Z [2024-06-19 02:31:02,850: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T02:31:02.851218946Z [2024-06-19 02:31:02,850: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-06-19T02:31:02.851373003Z [2024-06-19 02:31:02,851: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:31:02.939531803Z [2024-06-19 02:31:02,939: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:31:03.042162313Z [2024-06-19 02:31:03,041: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T02:31:03.045608106Z [2024-06-19 02:31:03,045: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:31:03.068227984Z [2024-06-19 02:31:03,068: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T02:31:03.070494999Z [2024-06-19 02:31:03,070: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:31:03.070680785Z [2024-06-19 02:31:03,070: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:31:03.070891591Z [2024-06-19 02:31:03,070: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:31:03.071029962Z [2024-06-19 02:31:03,070: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T02:31:03.071315207Z [2024-06-19 02:31:03,071: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T02:31:03.071463258Z [2024-06-19 02:31:03,071: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:31:03.160870616Z [2024-06-19 02:31:03,160: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:31:05.897340092Z [2024-06-19 02:31:05,896: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b0d88e90-7a6d-47f6-b7e9-559fa0ecffbc] succeeded in 4.718213811000169s: None 2024-06-19T02:31:06.806997127Z [2024-06-19 02:31:06,806: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1114c98e-17c2-4db7-9ecd-17a3cebe3e6e] succeeded in 5.6174334440001985s: None 2024-06-19T02:32:00.339893819Z [2024-06-19 02:32:00,339: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cf39c39f-7393-484e-8482-1c11f523e135] received 2024-06-19T02:32:00.342120470Z [2024-06-19 02:32:00,341: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d6ed6acd-31ac-4fa5-a46a-395eebfbc4da] received 2024-06-19T02:32:00.350823732Z [2024-06-19 02:32:00,350: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7b99fef5-0e64-4e0f-8ac5-8bc99a4e349b] received 2024-06-19T02:32:00.358239019Z [2024-06-19 02:32:00,357: INFO/ForkPoolWorker-16] [d6ed6acd-31ac-4fa5-a46a-395eebfbc4da] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T02:32:00.359502577Z [2024-06-19 02:32:00,359: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0b272aff-f228-49be-a4ef-eb655432ef86] received 2024-06-19T02:32:00.366111173Z [2024-06-19 02:32:00,365: INFO/ForkPoolWorker-1] [7b99fef5-0e64-4e0f-8ac5-8bc99a4e349b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T02:32:00.367291165Z [2024-06-19 02:32:00,366: INFO/ForkPoolWorker-15] [cf39c39f-7393-484e-8482-1c11f523e135] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-19T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-19T02:32:00.369349391Z [2024-06-19 02:32:00,368: INFO/ForkPoolWorker-2] [0b272aff-f228-49be-a4ef-eb655432ef86] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T02:32:00.657715420Z [2024-06-19 02:32:00,654: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T02:32:00.718650263Z [2024-06-19 02:32:00,715: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T02:32:00.728604316Z [2024-06-19 02:32:00,723: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T02:32:00.796186857Z [2024-06-19 02:32:00,791: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-19T02:32:00.817211928Z [2024-06-19 02:32:00,816: INFO/ForkPoolWorker-2] Getting SDNC list 2024-06-19T02:32:00.827087148Z [2024-06-19 02:32:00,826: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:32:00.863898807Z [2024-06-19 02:32:00,863: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T02:32:00.866869617Z [2024-06-19 02:32:00,866: INFO/ForkPoolWorker-2] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T02:32:00.867004955Z [2024-06-19 02:32:00,866: INFO/ForkPoolWorker-2] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T02:32:00.867088550Z [2024-06-19 02:32:00,866: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-06-19T02:32:00.867293342Z [2024-06-19 02:32:00,867: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T02:32:01.016500137Z [2024-06-19 02:32:01,016: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:32:01.129555796Z [2024-06-19 02:32:01,129: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:32:01.597202892Z [2024-06-19 02:32:01,596: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[0b272aff-f228-49be-a4ef-eb655432ef86] succeeded in 1.235764785998981s: None 2024-06-19T02:32:01.671333071Z [2024-06-19 02:32:01,670: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cf39c39f-7393-484e-8482-1c11f523e135] succeeded in 1.326295246999507s: None 2024-06-19T02:32:01.940489420Z [2024-06-19 02:32:01,940: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T02:32:01.945650028Z [2024-06-19 02:32:01,945: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:32:01.969855683Z [2024-06-19 02:32:01,969: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T02:32:01.971431003Z [2024-06-19 02:32:01,971: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:32:01.971552861Z [2024-06-19 02:32:01,971: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:32:01.971799283Z [2024-06-19 02:32:01,971: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:32:01.971929131Z [2024-06-19 02:32:01,971: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T02:32:01.972214156Z [2024-06-19 02:32:01,972: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T02:32:01.972320063Z [2024-06-19 02:32:01,972: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:32:02.009961786Z [2024-06-19 02:32:02,009: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T02:32:02.013099368Z [2024-06-19 02:32:02,012: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:32:02.042687972Z [2024-06-19 02:32:02,042: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T02:32:02.043882897Z [2024-06-19 02:32:02,043: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:32:02.043918379Z [2024-06-19 02:32:02,043: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:32:02.044074055Z [2024-06-19 02:32:02,043: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:32:02.044098938Z [2024-06-19 02:32:02,044: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T02:32:02.044386554Z [2024-06-19 02:32:02,044: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-19T02:32:02.044538989Z [2024-06-19 02:32:02,044: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:32:02.070107983Z [2024-06-19 02:32:02,069: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:32:02.155387534Z [2024-06-19 02:32:02,154: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:32:03.842422533Z [2024-06-19 02:32:03,841: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7b99fef5-0e64-4e0f-8ac5-8bc99a4e349b] succeeded in 3.48881813799926s: None 2024-06-19T02:32:04.085130804Z [2024-06-19 02:32:04,084: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d6ed6acd-31ac-4fa5-a46a-395eebfbc4da] succeeded in 3.7355830579999747s: None 2024-06-19T02:33:01.017459871Z [2024-06-19 02:33:01,017: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0118aefe-53e8-4daa-9253-338b4b34fda6] received 2024-06-19T02:33:01.019075800Z [2024-06-19 02:33:01,018: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d0f41365-c286-4414-985f-93b3d32b0c86] received 2024-06-19T02:33:01.022041787Z [2024-06-19 02:33:01,021: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2580a25b-b530-43f7-95f2-500414de33de] received 2024-06-19T02:33:01.031929823Z [2024-06-19 02:33:01,031: INFO/ForkPoolWorker-16] [d0f41365-c286-4414-985f-93b3d32b0c86] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T02:33:01.033175409Z [2024-06-19 02:33:01,032: INFO/ForkPoolWorker-1] [2580a25b-b530-43f7-95f2-500414de33de] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T02:33:01.035887663Z [2024-06-19 02:33:01,035: INFO/ForkPoolWorker-15] [0118aefe-53e8-4daa-9253-338b4b34fda6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T02:33:01.334419639Z [2024-06-19 02:33:01,331: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T02:33:01.335755300Z [2024-06-19 02:33:01,332: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T02:33:01.355805821Z [2024-06-19 02:33:01,352: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T02:33:01.501361496Z [2024-06-19 02:33:01,500: INFO/ForkPoolWorker-16] Getting SDNC list 2024-06-19T02:33:01.505155444Z [2024-06-19 02:33:01,504: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:33:01.526663121Z [2024-06-19 02:33:01,526: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T02:33:01.527567870Z [2024-06-19 02:33:01,527: INFO/ForkPoolWorker-16] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T02:33:01.527713184Z [2024-06-19 02:33:01,527: INFO/ForkPoolWorker-16] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T02:33:01.527802667Z [2024-06-19 02:33:01,527: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-06-19T02:33:01.528315150Z [2024-06-19 02:33:01,528: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T02:33:01.611861432Z [2024-06-19 02:33:01,611: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:33:02.289005472Z [2024-06-19 02:33:02,288: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d0f41365-c286-4414-985f-93b3d32b0c86] succeeded in 1.2679234530005488s: None 2024-06-19T02:33:02.621211690Z [2024-06-19 02:33:02,620: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T02:33:02.623817193Z [2024-06-19 02:33:02,623: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T02:33:02.624742231Z [2024-06-19 02:33:02,624: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:33:02.626963740Z [2024-06-19 02:33:02,626: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:33:02.654492072Z [2024-06-19 02:33:02,654: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T02:33:02.656236360Z [2024-06-19 02:33:02,655: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:33:02.656246560Z [2024-06-19 02:33:02,655: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:33:02.656252446Z [2024-06-19 02:33:02,655: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:33:02.656258432Z [2024-06-19 02:33:02,655: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T02:33:02.656264392Z [2024-06-19 02:33:02,655: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-06-19T02:33:02.656269383Z [2024-06-19 02:33:02,655: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:33:02.657964869Z [2024-06-19 02:33:02,657: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T02:33:02.660098692Z [2024-06-19 02:33:02,659: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:33:02.660403869Z [2024-06-19 02:33:02,660: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:33:02.660807565Z [2024-06-19 02:33:02,660: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:33:02.661171247Z [2024-06-19 02:33:02,660: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T02:33:02.661989599Z [2024-06-19 02:33:02,661: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T02:33:02.662472355Z [2024-06-19 02:33:02,662: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:33:02.734346367Z [2024-06-19 02:33:02,733: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:33:02.756062131Z [2024-06-19 02:33:02,755: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:33:04.520669277Z [2024-06-19 02:33:04,519: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2580a25b-b530-43f7-95f2-500414de33de] succeeded in 3.4953376569992542s: None 2024-06-19T02:33:05.144256495Z [2024-06-19 02:33:05,143: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0118aefe-53e8-4daa-9253-338b4b34fda6] succeeded in 4.122844815001372s: None 2024-06-19T02:34:00.712477580Z [2024-06-19 02:34:00,712: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ed1ea27b-4125-4f94-89c3-4a4eb246f16a] received 2024-06-19T02:34:00.715648038Z [2024-06-19 02:34:00,715: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e2d21b9d-6989-4ae8-8079-3f7370d9d860] received 2024-06-19T02:34:00.721154722Z [2024-06-19 02:34:00,720: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7bbacf75-4d3a-40df-b7e5-45898fe49799] received 2024-06-19T02:34:00.728365501Z [2024-06-19 02:34:00,728: INFO/ForkPoolWorker-15] [ed1ea27b-4125-4f94-89c3-4a4eb246f16a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T02:34:00.731655159Z [2024-06-19 02:34:00,731: INFO/ForkPoolWorker-16] [e2d21b9d-6989-4ae8-8079-3f7370d9d860] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-19T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-19T02:34:00.738378499Z [2024-06-19 02:34:00,738: INFO/ForkPoolWorker-1] [7bbacf75-4d3a-40df-b7e5-45898fe49799] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T02:34:00.740498477Z [2024-06-19 02:34:00,740: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[336eb920-85cd-4304-a3db-26646cbd6154] received 2024-06-19T02:34:00.752239304Z [2024-06-19 02:34:00,751: INFO/ForkPoolWorker-2] [336eb920-85cd-4304-a3db-26646cbd6154] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T02:34:01.054916076Z [2024-06-19 02:34:01,051: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T02:34:01.082232210Z [2024-06-19 02:34:01,079: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-19T02:34:01.128832954Z [2024-06-19 02:34:01,125: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T02:34:01.175733189Z [2024-06-19 02:34:01,172: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T02:34:01.289233574Z [2024-06-19 02:34:01,288: INFO/ForkPoolWorker-2] Getting SDNC list 2024-06-19T02:34:01.292914457Z [2024-06-19 02:34:01,292: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:34:01.318990514Z [2024-06-19 02:34:01,318: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T02:34:01.320415714Z [2024-06-19 02:34:01,320: INFO/ForkPoolWorker-2] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T02:34:01.320674672Z [2024-06-19 02:34:01,320: INFO/ForkPoolWorker-2] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T02:34:01.321080724Z [2024-06-19 02:34:01,320: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-06-19T02:34:01.321701167Z [2024-06-19 02:34:01,321: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T02:34:01.338531192Z [2024-06-19 02:34:01,338: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:34:01.396046495Z [2024-06-19 02:34:01,395: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:34:01.868175128Z [2024-06-19 02:34:01,867: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e2d21b9d-6989-4ae8-8079-3f7370d9d860] succeeded in 1.1490343899986328s: None 2024-06-19T02:34:01.987034351Z [2024-06-19 02:34:01,986: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[336eb920-85cd-4304-a3db-26646cbd6154] succeeded in 1.2425440569986677s: None 2024-06-19T02:34:02.379193004Z [2024-06-19 02:34:02,378: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T02:34:02.382398656Z [2024-06-19 02:34:02,382: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:34:02.400318708Z [2024-06-19 02:34:02,400: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T02:34:02.401494283Z [2024-06-19 02:34:02,401: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:34:02.401711013Z [2024-06-19 02:34:02,401: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:34:02.401857219Z [2024-06-19 02:34:02,401: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:34:02.401975158Z [2024-06-19 02:34:02,401: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T02:34:02.402256218Z [2024-06-19 02:34:02,402: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T02:34:02.402380409Z [2024-06-19 02:34:02,402: INFO/ForkPoolWorker-15] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:34:02.481050771Z [2024-06-19 02:34:02,480: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:34:02.549694250Z [2024-06-19 02:34:02,549: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T02:34:02.552726793Z [2024-06-19 02:34:02,552: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:34:02.588957136Z [2024-06-19 02:34:02,588: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T02:34:02.591291958Z [2024-06-19 02:34:02,591: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:34:02.591432390Z [2024-06-19 02:34:02,591: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:34:02.591648306Z [2024-06-19 02:34:02,591: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:34:02.591846304Z [2024-06-19 02:34:02,591: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T02:34:02.592419900Z [2024-06-19 02:34:02,592: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-06-19T02:34:02.592957984Z [2024-06-19 02:34:02,592: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:34:02.676076606Z [2024-06-19 02:34:02,675: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:34:03.976652180Z [2024-06-19 02:34:03,976: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ed1ea27b-4125-4f94-89c3-4a4eb246f16a] succeeded in 3.2594647869991604s: None 2024-06-19T02:34:04.946967247Z [2024-06-19 02:34:04,946: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7bbacf75-4d3a-40df-b7e5-45898fe49799] succeeded in 4.222356337000747s: None 2024-06-19T02:35:01.090761934Z [2024-06-19 02:35:01,090: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[28227fed-7acf-47c6-939a-f044653a91ca] received 2024-06-19T02:35:01.093918837Z [2024-06-19 02:35:01,093: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[147181d9-63d8-4dbe-909e-4f19a889a981] received 2024-06-19T02:35:01.102612312Z [2024-06-19 02:35:01,102: INFO/ForkPoolWorker-16] [147181d9-63d8-4dbe-909e-4f19a889a981] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T02:35:01.108035709Z [2024-06-19 02:35:01,107: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2b200ff5-a6c4-40e3-b347-205deca66ee6] received 2024-06-19T02:35:01.109578508Z [2024-06-19 02:35:01,109: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3f374212-aa4e-4a6b-9785-f4b77af70cf2] received 2024-06-19T02:35:01.110832239Z [2024-06-19 02:35:01,110: INFO/ForkPoolWorker-15] [28227fed-7acf-47c6-939a-f044653a91ca] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T02:35:01.117675190Z [2024-06-19 02:35:01,117: INFO/ForkPoolWorker-2] [3f374212-aa4e-4a6b-9785-f4b77af70cf2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T02:35:01.132943113Z [2024-06-19 02:35:01,132: INFO/ForkPoolWorker-1] [2b200ff5-a6c4-40e3-b347-205deca66ee6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-19T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T02:35:01.468127127Z [2024-06-19 02:35:01,464: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T02:35:01.468150617Z [2024-06-19 02:35:01,464: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T02:35:01.498575619Z [2024-06-19 02:35:01,494: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T02:35:01.518294631Z [2024-06-19 02:35:01,511: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T02:35:01.756692964Z [2024-06-19 02:35:01,756: INFO/ForkPoolWorker-16] Getting SDNC list 2024-06-19T02:35:01.762125052Z [2024-06-19 02:35:01,761: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:35:01.800570329Z [2024-06-19 02:35:01,800: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T02:35:01.803773369Z [2024-06-19 02:35:01,803: INFO/ForkPoolWorker-16] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T02:35:01.803900185Z [2024-06-19 02:35:01,803: INFO/ForkPoolWorker-16] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T02:35:01.804011758Z [2024-06-19 02:35:01,803: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-06-19T02:35:01.804612374Z [2024-06-19 02:35:01,804: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T02:35:01.914630089Z [2024-06-19 02:35:01,914: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:35:02.552026873Z [2024-06-19 02:35:02,551: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[147181d9-63d8-4dbe-909e-4f19a889a981] succeeded in 1.4568437559992162s: None 2024-06-19T02:35:02.791463837Z [2024-06-19 02:35:02,791: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T02:35:02.794899442Z [2024-06-19 02:35:02,794: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:35:02.816300440Z [2024-06-19 02:35:02,815: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-19T02:35:02.819936750Z [2024-06-19 02:35:02,819: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:35:02.829301708Z [2024-06-19 02:35:02,828: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T02:35:02.831404822Z [2024-06-19 02:35:02,831: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:35:02.831586913Z [2024-06-19 02:35:02,831: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:35:02.831915835Z [2024-06-19 02:35:02,831: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:35:02.832046497Z [2024-06-19 02:35:02,831: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T02:35:02.832453580Z [2024-06-19 02:35:02,832: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T02:35:02.832637858Z [2024-06-19 02:35:02,832: INFO/ForkPoolWorker-15] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:35:02.843374484Z [2024-06-19 02:35:02,843: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T02:35:02.844985303Z [2024-06-19 02:35:02,844: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:35:02.845232045Z [2024-06-19 02:35:02,845: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:35:02.845510063Z [2024-06-19 02:35:02,845: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:35:02.845757292Z [2024-06-19 02:35:02,845: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-19T02:35:02.846129313Z [2024-06-19 02:35:02,845: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-06-19T02:35:02.846419620Z [2024-06-19 02:35:02,846: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:35:02.909730998Z [2024-06-19 02:35:02,909: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:35:02.922640707Z [2024-06-19 02:35:02,922: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:35:03.044805373Z [2024-06-19 02:35:03,044: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T02:35:03.048085051Z [2024-06-19 02:35:03,047: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:35:03.077498540Z [2024-06-19 02:35:03,077: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T02:35:03.079395874Z [2024-06-19 02:35:03,078: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:35:03.079475971Z [2024-06-19 02:35:03,079: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:35:03.079634736Z [2024-06-19 02:35:03,079: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:35:03.079679214Z [2024-06-19 02:35:03,079: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T02:35:03.079949007Z [2024-06-19 02:35:03,079: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T02:35:03.079983595Z [2024-06-19 02:35:03,079: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:35:03.177817431Z [2024-06-19 02:35:03,177: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:35:03.860972807Z [2024-06-19 02:35:03,860: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2b200ff5-a6c4-40e3-b347-205deca66ee6] succeeded in 2.7494591119993856s: None 2024-06-19T02:35:04.368456656Z [2024-06-19 02:35:04,368: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[837cd560-4e79-4403-8f60-7e092a5ad08d] received 2024-06-19T02:35:04.375222448Z [2024-06-19 02:35:04,374: INFO/ForkPoolWorker-16] [837cd560-4e79-4403-8f60-7e092a5ad08d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'split_metrics', 'scheduled__2024-06-19T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T02:35:04.429800670Z [2024-06-19 02:35:04,429: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[28227fed-7acf-47c6-939a-f044653a91ca] succeeded in 3.3267495510008303s: None 2024-06-19T02:35:04.684885250Z [2024-06-19 02:35:04,681: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T02:35:05.764634934Z [2024-06-19 02:35:05,762: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T02:35:05.768957742Z [2024-06-19 02:35:05,766: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:35:05.785292692Z [2024-06-19 02:35:05,783: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T02:35:05.785310549Z [2024-06-19 02:35:05,784: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:35:05.785314948Z [2024-06-19 02:35:05,784: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:35:05.785318701Z [2024-06-19 02:35:05,784: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:35:05.785322534Z [2024-06-19 02:35:05,784: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T02:35:05.789445999Z [2024-06-19 02:35:05,784: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T02:35:05.789462894Z [2024-06-19 02:35:05,785: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:35:05.862252986Z [2024-06-19 02:35:05,861: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:35:06.325151391Z [2024-06-19 02:35:06,324: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[3f374212-aa4e-4a6b-9785-f4b77af70cf2] succeeded in 5.213755487999151s: None 2024-06-19T02:35:06.535386441Z [2024-06-19 02:35:06,534: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[837cd560-4e79-4403-8f60-7e092a5ad08d] succeeded in 2.164935943999808s: None 2024-06-19T02:35:06.735944405Z [2024-06-19 02:35:06,735: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f5e3183e-aca4-4eda-bea5-d6ae40dc3c1c] received 2024-06-19T02:35:06.743568111Z [2024-06-19 02:35:06,743: INFO/ForkPoolWorker-15] [f5e3183e-aca4-4eda-bea5-d6ae40dc3c1c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'collect_metrics', 'scheduled__2024-06-19T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-19T02:35:07.028020844Z [2024-06-19 02:35:07,014: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T02:35:08.222545042Z [2024-06-19 02:35:08,221: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T02:35:08.237878105Z [2024-06-19 02:35:08,237: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:35:08.266868009Z [2024-06-19 02:35:08,266: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T02:35:08.274624307Z [2024-06-19 02:35:08,274: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:35:08.274673250Z [2024-06-19 02:35:08,274: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:35:08.274823827Z [2024-06-19 02:35:08,274: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:35:08.274941581Z [2024-06-19 02:35:08,274: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T02:35:08.275375458Z [2024-06-19 02:35:08,275: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T02:35:08.275429515Z [2024-06-19 02:35:08,275: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:35:08.395676069Z [2024-06-19 02:35:08,395: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:35:09.121958612Z [2024-06-19 02:35:09,121: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f5e3183e-aca4-4eda-bea5-d6ae40dc3c1c] succeeded in 2.384498375000476s: None 2024-06-19T02:35:09.976325828Z [2024-06-19 02:35:09,976: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[625f5656-759b-4fb0-9d0a-0f23b24d1bad] received 2024-06-19T02:35:09.988665314Z [2024-06-19 02:35:09,988: INFO/ForkPoolWorker-15] [625f5656-759b-4fb0-9d0a-0f23b24d1bad] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'send_prometheus', 'scheduled__2024-06-19T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T02:35:10.276017768Z [2024-06-19 02:35:10,254: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T02:35:11.366377907Z [2024-06-19 02:35:11,365: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T02:35:11.370358627Z [2024-06-19 02:35:11,369: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:35:11.398387696Z [2024-06-19 02:35:11,398: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T02:35:11.400247863Z [2024-06-19 02:35:11,399: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:35:11.400291248Z [2024-06-19 02:35:11,400: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:35:11.400384692Z [2024-06-19 02:35:11,400: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:35:11.400607157Z [2024-06-19 02:35:11,400: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T02:35:11.400905796Z [2024-06-19 02:35:11,400: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T02:35:11.400915157Z [2024-06-19 02:35:11,400: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:35:11.500431709Z [2024-06-19 02:35:11,500: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:35:12.313027459Z [2024-06-19 02:35:12,312: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[625f5656-759b-4fb0-9d0a-0f23b24d1bad] succeeded in 2.334574000999055s: None 2024-06-19T02:36:00.505807945Z [2024-06-19 02:36:00,505: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c5a0094d-5163-4e26-8720-81c174386e3c] received 2024-06-19T02:36:00.514024276Z [2024-06-19 02:36:00,513: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[02080aca-c20e-4b70-ac13-c01c1466c6a1] received 2024-06-19T02:36:00.521955545Z [2024-06-19 02:36:00,521: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[230901be-b537-470e-b7b4-f9de3aa06118] received 2024-06-19T02:36:00.532451916Z [2024-06-19 02:36:00,532: INFO/ForkPoolWorker-1] [230901be-b537-470e-b7b4-f9de3aa06118] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T02:36:00.536877812Z [2024-06-19 02:36:00,536: INFO/ForkPoolWorker-15] [c5a0094d-5163-4e26-8720-81c174386e3c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T02:36:00.538469859Z [2024-06-19 02:36:00,538: INFO/ForkPoolWorker-16] [02080aca-c20e-4b70-ac13-c01c1466c6a1] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-19T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-19T02:36:00.543386506Z [2024-06-19 02:36:00,543: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3d60eaf3-2069-4286-9c0f-b00dc6e9cab3] received 2024-06-19T02:36:00.549262787Z [2024-06-19 02:36:00,549: INFO/ForkPoolWorker-2] [3d60eaf3-2069-4286-9c0f-b00dc6e9cab3] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T02:36:00.934034270Z [2024-06-19 02:36:00,930: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T02:36:00.982096476Z [2024-06-19 02:36:00,978: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-19T02:36:01.018315237Z [2024-06-19 02:36:01,012: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T02:36:01.096847325Z [2024-06-19 02:36:01,093: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T02:36:01.236960274Z [2024-06-19 02:36:01,236: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:36:01.316771903Z [2024-06-19 02:36:01,316: INFO/ForkPoolWorker-2] Getting SDNC list 2024-06-19T02:36:01.321701017Z [2024-06-19 02:36:01,321: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:36:01.396409328Z [2024-06-19 02:36:01,396: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T02:36:01.402397963Z [2024-06-19 02:36:01,402: INFO/ForkPoolWorker-2] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T02:36:01.407951230Z [2024-06-19 02:36:01,402: INFO/ForkPoolWorker-2] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T02:36:01.408017227Z [2024-06-19 02:36:01,407: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-06-19T02:36:01.408278797Z [2024-06-19 02:36:01,408: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T02:36:01.519755498Z [2024-06-19 02:36:01,519: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:36:02.023831481Z [2024-06-19 02:36:02,023: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[02080aca-c20e-4b70-ac13-c01c1466c6a1] succeeded in 1.5052048150009796s: None 2024-06-19T02:36:02.423081848Z [2024-06-19 02:36:02,422: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[3d60eaf3-2069-4286-9c0f-b00dc6e9cab3] succeeded in 1.878138444999422s: None 2024-06-19T02:36:02.459066024Z [2024-06-19 02:36:02,458: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T02:36:02.463023650Z [2024-06-19 02:36:02,462: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:36:02.485622279Z [2024-06-19 02:36:02,485: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T02:36:02.488746416Z [2024-06-19 02:36:02,488: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:36:02.488761825Z [2024-06-19 02:36:02,488: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:36:02.488983857Z [2024-06-19 02:36:02,488: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:36:02.489067264Z [2024-06-19 02:36:02,488: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T02:36:02.489503641Z [2024-06-19 02:36:02,489: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T02:36:02.489554751Z [2024-06-19 02:36:02,489: INFO/ForkPoolWorker-15] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:36:02.575598744Z [2024-06-19 02:36:02,575: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:36:02.786286318Z [2024-06-19 02:36:02,785: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T02:36:02.789530056Z [2024-06-19 02:36:02,788: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:36:02.817957983Z [2024-06-19 02:36:02,817: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T02:36:02.819145339Z [2024-06-19 02:36:02,818: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:36:02.819156626Z [2024-06-19 02:36:02,819: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:36:02.819303018Z [2024-06-19 02:36:02,819: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:36:02.819373440Z [2024-06-19 02:36:02,819: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T02:36:02.819753339Z [2024-06-19 02:36:02,819: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-06-19T02:36:02.819955664Z [2024-06-19 02:36:02,819: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:36:02.901549701Z [2024-06-19 02:36:02,901: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:36:04.126681977Z [2024-06-19 02:36:04,126: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c5a0094d-5163-4e26-8720-81c174386e3c] succeeded in 3.616518093000195s: None 2024-06-19T02:36:05.217021314Z [2024-06-19 02:36:05,216: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[230901be-b537-470e-b7b4-f9de3aa06118] succeeded in 4.691718101001243s: None 2024-06-19T02:37:00.382728748Z [2024-06-19 02:37:00,382: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9dde8d73-e976-48c9-ba29-01135c9b2a3b] received 2024-06-19T02:37:00.388807801Z [2024-06-19 02:37:00,388: INFO/ForkPoolWorker-15] [9dde8d73-e976-48c9-ba29-01135c9b2a3b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T02:37:00.397686962Z [2024-06-19 02:37:00,397: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5dac9631-c578-49cd-a108-50084c5945f3] received 2024-06-19T02:37:00.411302263Z [2024-06-19 02:37:00,410: INFO/ForkPoolWorker-16] [5dac9631-c578-49cd-a108-50084c5945f3] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T02:37:00.413623727Z [2024-06-19 02:37:00,413: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7eea182c-21ec-4549-b658-7ec9908c68f7] received 2024-06-19T02:37:00.423174564Z [2024-06-19 02:37:00,422: INFO/ForkPoolWorker-1] [7eea182c-21ec-4549-b658-7ec9908c68f7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T02:37:00.712144636Z [2024-06-19 02:37:00,708: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T02:37:00.751671236Z [2024-06-19 02:37:00,748: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T02:37:00.763881791Z [2024-06-19 02:37:00,760: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T02:37:00.906964135Z [2024-06-19 02:37:00,905: INFO/ForkPoolWorker-16] Getting SDNC list 2024-06-19T02:37:00.910092909Z [2024-06-19 02:37:00,909: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:37:00.939751203Z [2024-06-19 02:37:00,939: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T02:37:00.941789434Z [2024-06-19 02:37:00,941: INFO/ForkPoolWorker-16] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T02:37:00.941889315Z [2024-06-19 02:37:00,941: INFO/ForkPoolWorker-16] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T02:37:00.942089215Z [2024-06-19 02:37:00,941: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-06-19T02:37:00.942118392Z [2024-06-19 02:37:00,941: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T02:37:01.073289881Z [2024-06-19 02:37:01,072: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:37:01.800325195Z [2024-06-19 02:37:01,799: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5dac9631-c578-49cd-a108-50084c5945f3] succeeded in 1.4007759369997075s: None 2024-06-19T02:37:02.093371232Z [2024-06-19 02:37:02,092: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T02:37:02.096568046Z [2024-06-19 02:37:02,096: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:37:02.132806340Z [2024-06-19 02:37:02,132: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T02:37:02.134015012Z [2024-06-19 02:37:02,133: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:37:02.134031806Z [2024-06-19 02:37:02,133: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:37:02.134186848Z [2024-06-19 02:37:02,133: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:37:02.134201380Z [2024-06-19 02:37:02,134: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T02:37:02.134425565Z [2024-06-19 02:37:02,134: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-06-19T02:37:02.134434100Z [2024-06-19 02:37:02,134: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:37:02.137269729Z [2024-06-19 02:37:02,136: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T02:37:02.140723435Z [2024-06-19 02:37:02,140: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:37:02.186323564Z [2024-06-19 02:37:02,186: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T02:37:02.195517004Z [2024-06-19 02:37:02,195: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:37:02.195564485Z [2024-06-19 02:37:02,195: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:37:02.195801493Z [2024-06-19 02:37:02,195: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:37:02.195823456Z [2024-06-19 02:37:02,195: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T02:37:02.195943999Z [2024-06-19 02:37:02,195: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T02:37:02.195952531Z [2024-06-19 02:37:02,195: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:37:02.254415934Z [2024-06-19 02:37:02,252: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:37:02.423650665Z [2024-06-19 02:37:02,423: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:37:04.353896903Z [2024-06-19 02:37:04,353: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7eea182c-21ec-4549-b658-7ec9908c68f7] succeeded in 3.938651813999968s: None 2024-06-19T02:37:04.622776268Z [2024-06-19 02:37:04,622: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9dde8d73-e976-48c9-ba29-01135c9b2a3b] succeeded in 4.238685440001063s: None 2024-06-19T02:38:00.467370330Z [2024-06-19 02:38:00,466: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e6bb237e-2289-4e6d-84d6-2acaa87862f9] received 2024-06-19T02:38:00.481541694Z [2024-06-19 02:38:00,481: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[74ddd338-5c97-4a09-9683-cbd1fcf2f3e8] received 2024-06-19T02:38:00.486435106Z [2024-06-19 02:38:00,485: INFO/ForkPoolWorker-15] [e6bb237e-2289-4e6d-84d6-2acaa87862f9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T02:38:00.493698538Z [2024-06-19 02:38:00,493: INFO/ForkPoolWorker-16] [74ddd338-5c97-4a09-9683-cbd1fcf2f3e8] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-19T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-19T02:38:00.495869432Z [2024-06-19 02:38:00,493: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[66367720-f254-47e0-8f93-3fc6e3e75137] received 2024-06-19T02:38:00.507750422Z [2024-06-19 02:38:00,507: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1e527a04-1a90-4ce2-8c55-a0f1addbeeb9] received 2024-06-19T02:38:00.509135908Z [2024-06-19 02:38:00,508: INFO/ForkPoolWorker-1] [66367720-f254-47e0-8f93-3fc6e3e75137] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T02:38:00.521345899Z [2024-06-19 02:38:00,520: INFO/ForkPoolWorker-2] [1e527a04-1a90-4ce2-8c55-a0f1addbeeb9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T02:38:00.773874749Z [2024-06-19 02:38:00,770: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-19T02:38:00.820832134Z [2024-06-19 02:38:00,816: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T02:38:00.823890684Z [2024-06-19 02:38:00,820: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T02:38:00.886799469Z [2024-06-19 02:38:00,880: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T02:38:01.017900561Z [2024-06-19 02:38:01,017: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:38:01.096536258Z [2024-06-19 02:38:01,096: INFO/ForkPoolWorker-1] Getting SDNC list 2024-06-19T02:38:01.100814922Z [2024-06-19 02:38:01,100: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:38:01.152154790Z [2024-06-19 02:38:01,151: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T02:38:01.154594510Z [2024-06-19 02:38:01,154: INFO/ForkPoolWorker-1] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T02:38:01.154674693Z [2024-06-19 02:38:01,154: INFO/ForkPoolWorker-1] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T02:38:01.154755282Z [2024-06-19 02:38:01,154: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-06-19T02:38:01.155325995Z [2024-06-19 02:38:01,155: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T02:38:01.306480693Z [2024-06-19 02:38:01,306: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:38:01.652381411Z [2024-06-19 02:38:01,652: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[74ddd338-5c97-4a09-9683-cbd1fcf2f3e8] succeeded in 1.167387768999106s: None 2024-06-19T02:38:01.963798814Z [2024-06-19 02:38:01,963: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[66367720-f254-47e0-8f93-3fc6e3e75137] succeeded in 1.4655339370001457s: None 2024-06-19T02:38:02.106511984Z [2024-06-19 02:38:02,105: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-19T02:38:02.109824372Z [2024-06-19 02:38:02,109: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:38:02.125124104Z [2024-06-19 02:38:02,124: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T02:38:02.128525546Z [2024-06-19 02:38:02,128: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:38:02.161639460Z [2024-06-19 02:38:02,161: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T02:38:02.162314799Z [2024-06-19 02:38:02,162: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T02:38:02.163393448Z [2024-06-19 02:38:02,163: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:38:02.163561591Z [2024-06-19 02:38:02,163: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:38:02.163890202Z [2024-06-19 02:38:02,163: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:38:02.164033997Z [2024-06-19 02:38:02,163: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T02:38:02.164440588Z [2024-06-19 02:38:02,164: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T02:38:02.165132909Z [2024-06-19 02:38:02,164: INFO/ForkPoolWorker-15] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:38:02.167508851Z [2024-06-19 02:38:02,167: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:38:02.167698279Z [2024-06-19 02:38:02,167: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:38:02.167868550Z [2024-06-19 02:38:02,167: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:38:02.168057099Z [2024-06-19 02:38:02,167: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-19T02:38:02.168507208Z [2024-06-19 02:38:02,168: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-06-19T02:38:02.170277692Z [2024-06-19 02:38:02,170: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:38:02.344408446Z [2024-06-19 02:38:02,344: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:38:02.348095016Z [2024-06-19 02:38:02,341: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:38:03.988704808Z [2024-06-19 02:38:03,988: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e6bb237e-2289-4e6d-84d6-2acaa87862f9] succeeded in 3.516637072998492s: None 2024-06-19T02:38:04.374108970Z [2024-06-19 02:38:04,373: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[1e527a04-1a90-4ce2-8c55-a0f1addbeeb9] succeeded in 3.860645503998967s: None 2024-06-19T02:39:00.592414513Z [2024-06-19 02:39:00,592: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a42e559e-9512-4a05-b45f-1e14a00e33a6] received 2024-06-19T02:39:00.597791876Z [2024-06-19 02:39:00,597: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f62aacfb-3931-4880-b9f2-99e4db566f84] received 2024-06-19T02:39:00.606508044Z [2024-06-19 02:39:00,606: INFO/ForkPoolWorker-15] [a42e559e-9512-4a05-b45f-1e14a00e33a6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T02:39:00.607002641Z [2024-06-19 02:39:00,606: INFO/ForkPoolWorker-16] [f62aacfb-3931-4880-b9f2-99e4db566f84] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T02:39:00.611999943Z [2024-06-19 02:39:00,611: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[66fe4a9c-2ba2-4639-9cef-db3f80c3a8a7] received 2024-06-19T02:39:00.623521708Z [2024-06-19 02:39:00,623: INFO/ForkPoolWorker-1] [66fe4a9c-2ba2-4639-9cef-db3f80c3a8a7] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T02:39:00.929372006Z [2024-06-19 02:39:00,925: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T02:39:00.942098530Z [2024-06-19 02:39:00,938: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T02:39:00.946886330Z [2024-06-19 02:39:00,944: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T02:39:01.097405667Z [2024-06-19 02:39:01,096: INFO/ForkPoolWorker-1] Getting SDNC list 2024-06-19T02:39:01.101470523Z [2024-06-19 02:39:01,101: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:39:01.126261487Z [2024-06-19 02:39:01,126: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T02:39:01.127436440Z [2024-06-19 02:39:01,127: INFO/ForkPoolWorker-1] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T02:39:01.127741859Z [2024-06-19 02:39:01,127: INFO/ForkPoolWorker-1] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T02:39:01.127909964Z [2024-06-19 02:39:01,127: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-06-19T02:39:01.128247610Z [2024-06-19 02:39:01,128: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T02:39:01.238690657Z [2024-06-19 02:39:01,238: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:39:01.851941696Z [2024-06-19 02:39:01,851: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[66fe4a9c-2ba2-4639-9cef-db3f80c3a8a7] succeeded in 1.2385894729995925s: None 2024-06-19T02:39:02.080651820Z [2024-06-19 02:39:02,080: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T02:39:02.083951766Z [2024-06-19 02:39:02,083: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:39:02.125550596Z [2024-06-19 02:39:02,125: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T02:39:02.128687324Z [2024-06-19 02:39:02,128: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:39:02.132714671Z [2024-06-19 02:39:02,132: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T02:39:02.135196527Z [2024-06-19 02:39:02,134: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:39:02.135468608Z [2024-06-19 02:39:02,135: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:39:02.135882028Z [2024-06-19 02:39:02,135: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:39:02.136112735Z [2024-06-19 02:39:02,135: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T02:39:02.136648273Z [2024-06-19 02:39:02,136: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T02:39:02.136886601Z [2024-06-19 02:39:02,136: INFO/ForkPoolWorker-16] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:39:02.146773117Z [2024-06-19 02:39:02,146: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T02:39:02.148051929Z [2024-06-19 02:39:02,147: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:39:02.148155461Z [2024-06-19 02:39:02,147: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:39:02.148315145Z [2024-06-19 02:39:02,148: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:39:02.148337119Z [2024-06-19 02:39:02,148: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T02:39:02.148598667Z [2024-06-19 02:39:02,148: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-06-19T02:39:02.148640845Z [2024-06-19 02:39:02,148: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:39:02.257953539Z [2024-06-19 02:39:02,257: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:39:02.286602525Z [2024-06-19 02:39:02,286: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:39:03.914961807Z [2024-06-19 02:39:03,914: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f62aacfb-3931-4880-b9f2-99e4db566f84] succeeded in 3.3144888039987563s: None 2024-06-19T02:39:04.315509373Z [2024-06-19 02:39:04,314: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a42e559e-9512-4a05-b45f-1e14a00e33a6] succeeded in 3.720023890999073s: None 2024-06-19T02:40:01.157886769Z [2024-06-19 02:40:01,157: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[219e5fc7-7802-4ae8-886e-356f4739a4be] received 2024-06-19T02:40:01.163734865Z [2024-06-19 02:40:01,163: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[996b61cf-5e4e-45e4-b004-4f97d5dfffcf] received 2024-06-19T02:40:01.165773937Z [2024-06-19 02:40:01,165: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[64b08045-499a-41bb-9018-ef82d8003894] received 2024-06-19T02:40:01.167397579Z [2024-06-19 02:40:01,167: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1e35a31d-9c51-4283-b79b-787fcfadb67b] received 2024-06-19T02:40:01.175382438Z [2024-06-19 02:40:01,175: INFO/ForkPoolWorker-15] [219e5fc7-7802-4ae8-886e-356f4739a4be] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T02:40:01.176565289Z [2024-06-19 02:40:01,176: INFO/ForkPoolWorker-1] [64b08045-499a-41bb-9018-ef82d8003894] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-19T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T02:40:01.177432270Z [2024-06-19 02:40:01,177: INFO/ForkPoolWorker-2] [1e35a31d-9c51-4283-b79b-787fcfadb67b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-19T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-19T02:40:01.197761426Z [2024-06-19 02:40:01,195: INFO/ForkPoolWorker-16] [996b61cf-5e4e-45e4-b004-4f97d5dfffcf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T02:40:01.198531320Z [2024-06-19 02:40:01,198: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a4c82484-7293-43fd-9397-587f59cab04e] received 2024-06-19T02:40:01.225035195Z [2024-06-19 02:40:01,224: INFO/ForkPoolWorker-3] [a4c82484-7293-43fd-9397-587f59cab04e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T02:40:01.603521669Z [2024-06-19 02:40:01,600: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T02:40:01.616430941Z [2024-06-19 02:40:01,612: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T02:40:01.629646756Z [2024-06-19 02:40:01,621: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T02:40:01.712356803Z [2024-06-19 02:40:01,702: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-19T02:40:01.745521271Z [2024-06-19 02:40:01,741: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T02:40:01.787053266Z [2024-06-19 02:40:01,786: INFO/ForkPoolWorker-3] Getting SDNC list 2024-06-19T02:40:01.790953952Z [2024-06-19 02:40:01,790: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:40:01.808602493Z [2024-06-19 02:40:01,808: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-06-19T02:40:01.809592248Z [2024-06-19 02:40:01,809: INFO/ForkPoolWorker-3] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T02:40:01.809705063Z [2024-06-19 02:40:01,809: INFO/ForkPoolWorker-3] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T02:40:01.809798358Z [2024-06-19 02:40:01,809: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-06-19T02:40:01.809987252Z [2024-06-19 02:40:01,809: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T02:40:01.900918329Z [2024-06-19 02:40:01,900: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:40:02.048564975Z [2024-06-19 02:40:02,048: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:40:02.616260277Z [2024-06-19 02:40:02,615: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[a4c82484-7293-43fd-9397-587f59cab04e] succeeded in 1.4145362969993585s: None 2024-06-19T02:40:02.814321056Z [2024-06-19 02:40:02,813: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[1e35a31d-9c51-4283-b79b-787fcfadb67b] succeeded in 1.6453813459993398s: None 2024-06-19T02:40:03.069315551Z [2024-06-19 02:40:03,068: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T02:40:03.072707164Z [2024-06-19 02:40:03,072: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:40:03.099392889Z [2024-06-19 02:40:03,099: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T02:40:03.101179300Z [2024-06-19 02:40:03,100: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:40:03.101321825Z [2024-06-19 02:40:03,101: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:40:03.101552068Z [2024-06-19 02:40:03,101: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:40:03.101680168Z [2024-06-19 02:40:03,101: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T02:40:03.102073636Z [2024-06-19 02:40:03,101: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T02:40:03.102237996Z [2024-06-19 02:40:03,102: INFO/ForkPoolWorker-16] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:40:03.196490714Z [2024-06-19 02:40:03,196: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:40:03.257211897Z [2024-06-19 02:40:03,256: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T02:40:03.260799028Z [2024-06-19 02:40:03,260: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:40:03.291094471Z [2024-06-19 02:40:03,290: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T02:40:03.292574436Z [2024-06-19 02:40:03,292: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:40:03.292690018Z [2024-06-19 02:40:03,292: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:40:03.293026527Z [2024-06-19 02:40:03,292: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:40:03.293266835Z [2024-06-19 02:40:03,293: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T02:40:03.293599206Z [2024-06-19 02:40:03,293: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T02:40:03.293839752Z [2024-06-19 02:40:03,293: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:40:03.393360399Z [2024-06-19 02:40:03,393: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:40:03.442237349Z [2024-06-19 02:40:03,441: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T02:40:03.446206542Z [2024-06-19 02:40:03,445: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:40:03.470415255Z [2024-06-19 02:40:03,470: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T02:40:03.471584581Z [2024-06-19 02:40:03,471: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:40:03.471602388Z [2024-06-19 02:40:03,471: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:40:03.471745459Z [2024-06-19 02:40:03,471: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:40:03.471758694Z [2024-06-19 02:40:03,471: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T02:40:03.472000379Z [2024-06-19 02:40:03,471: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-06-19T02:40:03.472005890Z [2024-06-19 02:40:03,471: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:40:03.555988068Z [2024-06-19 02:40:03,555: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:40:04.024186516Z [2024-06-19 02:40:04,023: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[64b08045-499a-41bb-9018-ef82d8003894] succeeded in 2.856698221001352s: None 2024-06-19T02:40:04.662146527Z [2024-06-19 02:40:04,661: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[996b61cf-5e4e-45e4-b004-4f97d5dfffcf] succeeded in 3.493020321999211s: None 2024-06-19T02:40:04.999366765Z [2024-06-19 02:40:04,998: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6041e9fa-9be3-400d-ab20-9be980fa195c] received 2024-06-19T02:40:05.018655880Z [2024-06-19 02:40:05,018: INFO/ForkPoolWorker-16] [6041e9fa-9be3-400d-ab20-9be980fa195c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'split_metrics', 'scheduled__2024-06-19T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T02:40:05.312767007Z [2024-06-19 02:40:05,309: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T02:40:05.425491701Z [2024-06-19 02:40:05,424: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[219e5fc7-7802-4ae8-886e-356f4739a4be] succeeded in 4.26538439900105s: None 2024-06-19T02:40:06.458960726Z [2024-06-19 02:40:06,458: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T02:40:06.462215039Z [2024-06-19 02:40:06,461: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:40:06.480429509Z [2024-06-19 02:40:06,480: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T02:40:06.481897021Z [2024-06-19 02:40:06,481: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:40:06.481995416Z [2024-06-19 02:40:06,481: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:40:06.482010391Z [2024-06-19 02:40:06,481: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:40:06.482105737Z [2024-06-19 02:40:06,481: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T02:40:06.482324751Z [2024-06-19 02:40:06,482: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T02:40:06.482352323Z [2024-06-19 02:40:06,482: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:40:06.585647113Z [2024-06-19 02:40:06,585: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:40:07.278351478Z [2024-06-19 02:40:07,277: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6041e9fa-9be3-400d-ab20-9be980fa195c] succeeded in 2.2686586580002768s: None 2024-06-19T02:40:07.397162457Z [2024-06-19 02:40:07,396: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7912fa6a-3083-4a93-994c-12bd927ee8a4] received 2024-06-19T02:40:07.408571868Z [2024-06-19 02:40:07,408: INFO/ForkPoolWorker-15] [7912fa6a-3083-4a93-994c-12bd927ee8a4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'collect_metrics', 'scheduled__2024-06-19T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-19T02:40:07.690264358Z [2024-06-19 02:40:07,687: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T02:40:08.810026160Z [2024-06-19 02:40:08,809: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T02:40:08.813374143Z [2024-06-19 02:40:08,812: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:40:08.836912014Z [2024-06-19 02:40:08,836: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T02:40:08.838474517Z [2024-06-19 02:40:08,838: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:40:08.838572025Z [2024-06-19 02:40:08,838: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:40:08.838676516Z [2024-06-19 02:40:08,838: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:40:08.838732484Z [2024-06-19 02:40:08,838: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T02:40:08.839049385Z [2024-06-19 02:40:08,838: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T02:40:08.839148758Z [2024-06-19 02:40:08,838: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:40:08.956369655Z [2024-06-19 02:40:08,956: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:40:09.571753930Z [2024-06-19 02:40:09,570: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7912fa6a-3083-4a93-994c-12bd927ee8a4] succeeded in 2.1701406030006183s: None 2024-06-19T02:40:09.910578292Z [2024-06-19 02:40:09,909: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7eee1702-db8b-4d8e-b77b-efb0923a28f6] received 2024-06-19T02:40:09.921138611Z [2024-06-19 02:40:09,920: INFO/ForkPoolWorker-15] [7eee1702-db8b-4d8e-b77b-efb0923a28f6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'send_prometheus', 'scheduled__2024-06-19T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T02:40:10.219163963Z [2024-06-19 02:40:10,215: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T02:40:11.342089559Z [2024-06-19 02:40:11,341: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T02:40:11.345452004Z [2024-06-19 02:40:11,345: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:40:11.367319193Z [2024-06-19 02:40:11,367: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T02:40:11.368465732Z [2024-06-19 02:40:11,368: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:40:11.368485893Z [2024-06-19 02:40:11,368: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:40:11.368745963Z [2024-06-19 02:40:11,368: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:40:11.368794947Z [2024-06-19 02:40:11,368: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T02:40:11.369270656Z [2024-06-19 02:40:11,368: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T02:40:11.369308950Z [2024-06-19 02:40:11,369: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:40:11.466263950Z [2024-06-19 02:40:11,465: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:40:12.170538514Z [2024-06-19 02:40:12,169: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7eee1702-db8b-4d8e-b77b-efb0923a28f6] succeeded in 2.2553946749994793s: None 2024-06-19T02:41:00.435150397Z [2024-06-19 02:41:00,434: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3dc5843d-752c-45f4-b47f-dc78719be42b] received 2024-06-19T02:41:00.437017450Z [2024-06-19 02:41:00,436: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[95d3821a-e56a-4e1f-b23c-6ca095ed9e0e] received 2024-06-19T02:41:00.438350209Z [2024-06-19 02:41:00,438: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8c1b2a63-77e0-4d1c-a01d-91d59b597dcb] received 2024-06-19T02:41:00.446161690Z [2024-06-19 02:41:00,445: INFO/ForkPoolWorker-16] [95d3821a-e56a-4e1f-b23c-6ca095ed9e0e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T02:41:00.447270221Z [2024-06-19 02:41:00,446: INFO/ForkPoolWorker-1] [8c1b2a63-77e0-4d1c-a01d-91d59b597dcb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T02:41:00.452557975Z [2024-06-19 02:41:00,452: INFO/ForkPoolWorker-15] [3dc5843d-752c-45f4-b47f-dc78719be42b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T02:41:00.736002184Z [2024-06-19 02:41:00,730: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T02:41:00.743776342Z [2024-06-19 02:41:00,740: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T02:41:00.758834661Z [2024-06-19 02:41:00,755: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T02:41:00.896278647Z [2024-06-19 02:41:00,895: INFO/ForkPoolWorker-16] Getting SDNC list 2024-06-19T02:41:00.900333223Z [2024-06-19 02:41:00,899: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:41:00.927920724Z [2024-06-19 02:41:00,927: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T02:41:00.930843907Z [2024-06-19 02:41:00,930: INFO/ForkPoolWorker-16] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T02:41:00.931070659Z [2024-06-19 02:41:00,930: INFO/ForkPoolWorker-16] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T02:41:00.931248337Z [2024-06-19 02:41:00,931: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-06-19T02:41:00.931553885Z [2024-06-19 02:41:00,931: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T02:41:01.018432575Z [2024-06-19 02:41:01,018: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:41:01.633978958Z [2024-06-19 02:41:01,633: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[95d3821a-e56a-4e1f-b23c-6ca095ed9e0e] succeeded in 1.1953553069997724s: None 2024-06-19T02:41:01.852209562Z [2024-06-19 02:41:01,851: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T02:41:01.855525429Z [2024-06-19 02:41:01,854: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:41:01.875675117Z [2024-06-19 02:41:01,875: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T02:41:01.878987391Z [2024-06-19 02:41:01,878: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:41:01.882462386Z [2024-06-19 02:41:01,882: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T02:41:01.884368216Z [2024-06-19 02:41:01,884: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:41:01.884610587Z [2024-06-19 02:41:01,884: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:41:01.885012640Z [2024-06-19 02:41:01,884: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:41:01.885298476Z [2024-06-19 02:41:01,885: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T02:41:01.885739698Z [2024-06-19 02:41:01,885: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-06-19T02:41:01.888054706Z [2024-06-19 02:41:01,887: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:41:01.902958878Z [2024-06-19 02:41:01,902: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T02:41:01.904445818Z [2024-06-19 02:41:01,904: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:41:01.904673361Z [2024-06-19 02:41:01,904: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:41:01.905079464Z [2024-06-19 02:41:01,904: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:41:01.905354905Z [2024-06-19 02:41:01,905: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T02:41:01.905725522Z [2024-06-19 02:41:01,905: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T02:41:01.905877669Z [2024-06-19 02:41:01,905: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:41:01.998589430Z [2024-06-19 02:41:01,998: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:41:02.010861298Z [2024-06-19 02:41:02,010: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:41:03.653071089Z [2024-06-19 02:41:03,652: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8c1b2a63-77e0-4d1c-a01d-91d59b597dcb] succeeded in 3.2127936469987617s: None 2024-06-19T02:41:05.739314093Z [2024-06-19 02:41:05,738: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3dc5843d-752c-45f4-b47f-dc78719be42b] succeeded in 5.299172605000422s: None 2024-06-19T02:42:00.897228193Z [2024-06-19 02:42:00,896: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[de4d599f-03b9-417b-8d3d-451e2d054949] received 2024-06-19T02:42:00.908567371Z [2024-06-19 02:42:00,908: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8f21f160-79bf-4281-92bf-7ebb17df6ad2] received 2024-06-19T02:42:00.911479873Z [2024-06-19 02:42:00,911: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3f6a807e-18b4-4a2e-9d94-87011cd53189] received 2024-06-19T02:42:00.921390857Z [2024-06-19 02:42:00,921: INFO/ForkPoolWorker-1] [3f6a807e-18b4-4a2e-9d94-87011cd53189] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T02:42:00.925304354Z [2024-06-19 02:42:00,924: INFO/ForkPoolWorker-16] [8f21f160-79bf-4281-92bf-7ebb17df6ad2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T02:42:00.925917638Z [2024-06-19 02:42:00,925: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[97c10135-772f-4755-ab83-11a0c24a70b5] received 2024-06-19T02:42:00.929573595Z [2024-06-19 02:42:00,929: INFO/ForkPoolWorker-15] [de4d599f-03b9-417b-8d3d-451e2d054949] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-19T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-19T02:42:00.942086142Z [2024-06-19 02:42:00,941: INFO/ForkPoolWorker-2] [97c10135-772f-4755-ab83-11a0c24a70b5] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T02:42:01.281680256Z [2024-06-19 02:42:01,278: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T02:42:01.290911107Z [2024-06-19 02:42:01,287: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-19T02:42:01.297697175Z [2024-06-19 02:42:01,292: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T02:42:01.411324935Z [2024-06-19 02:42:01,407: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T02:42:01.554427075Z [2024-06-19 02:42:01,554: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:42:01.568825870Z [2024-06-19 02:42:01,568: INFO/ForkPoolWorker-2] Getting SDNC list 2024-06-19T02:42:01.572535370Z [2024-06-19 02:42:01,572: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:42:01.599132485Z [2024-06-19 02:42:01,598: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T02:42:01.602928882Z [2024-06-19 02:42:01,602: INFO/ForkPoolWorker-2] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T02:42:01.603040836Z [2024-06-19 02:42:01,602: INFO/ForkPoolWorker-2] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T02:42:01.603121617Z [2024-06-19 02:42:01,603: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-06-19T02:42:01.603352305Z [2024-06-19 02:42:01,603: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T02:42:01.706052648Z [2024-06-19 02:42:01,705: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:42:02.102953331Z [2024-06-19 02:42:02,102: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[de4d599f-03b9-417b-8d3d-451e2d054949] succeeded in 1.1823312369997439s: None 2024-06-19T02:42:02.364817007Z [2024-06-19 02:42:02,364: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[97c10135-772f-4755-ab83-11a0c24a70b5] succeeded in 1.4366752449986961s: None 2024-06-19T02:42:02.709423301Z [2024-06-19 02:42:02,709: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T02:42:02.713036636Z [2024-06-19 02:42:02,712: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:42:02.719867066Z [2024-06-19 02:42:02,719: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T02:42:02.723018064Z [2024-06-19 02:42:02,722: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:42:02.740710541Z [2024-06-19 02:42:02,740: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T02:42:02.743035410Z [2024-06-19 02:42:02,742: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:42:02.743164731Z [2024-06-19 02:42:02,742: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:42:02.743418210Z [2024-06-19 02:42:02,743: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:42:02.743500827Z [2024-06-19 02:42:02,743: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T02:42:02.743874881Z [2024-06-19 02:42:02,743: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-19T02:42:02.744025120Z [2024-06-19 02:42:02,743: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:42:02.756854458Z [2024-06-19 02:42:02,756: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T02:42:02.758794276Z [2024-06-19 02:42:02,758: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:42:02.758911213Z [2024-06-19 02:42:02,758: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:42:02.759170599Z [2024-06-19 02:42:02,758: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:42:02.759299180Z [2024-06-19 02:42:02,759: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T02:42:02.759907477Z [2024-06-19 02:42:02,759: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T02:42:02.760266810Z [2024-06-19 02:42:02,760: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:42:02.837758893Z [2024-06-19 02:42:02,837: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:42:02.867193920Z [2024-06-19 02:42:02,866: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:42:04.741713906Z [2024-06-19 02:42:04,741: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3f6a807e-18b4-4a2e-9d94-87011cd53189] succeeded in 3.827600896000149s: None 2024-06-19T02:42:04.933924692Z [2024-06-19 02:42:04,933: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8f21f160-79bf-4281-92bf-7ebb17df6ad2] succeeded in 4.017398324000169s: None 2024-06-19T02:43:00.716153942Z [2024-06-19 02:43:00,715: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b07273ee-f8fa-4598-aaee-531c5a027d77] received 2024-06-19T02:43:00.720039311Z [2024-06-19 02:43:00,719: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[481d1664-276e-46c3-9eaf-886d8bc02f04] received 2024-06-19T02:43:00.727756230Z [2024-06-19 02:43:00,727: INFO/ForkPoolWorker-16] [481d1664-276e-46c3-9eaf-886d8bc02f04] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T02:43:00.729799357Z [2024-06-19 02:43:00,729: INFO/ForkPoolWorker-15] [b07273ee-f8fa-4598-aaee-531c5a027d77] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T02:43:00.740304850Z [2024-06-19 02:43:00,740: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4b20c0e6-a654-4896-a696-b20384787738] received 2024-06-19T02:43:00.748332523Z [2024-06-19 02:43:00,748: INFO/ForkPoolWorker-1] [4b20c0e6-a654-4896-a696-b20384787738] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T02:43:01.038702869Z [2024-06-19 02:43:01,035: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T02:43:01.071443383Z [2024-06-19 02:43:01,068: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T02:43:01.083868737Z [2024-06-19 02:43:01,080: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T02:43:01.203183761Z [2024-06-19 02:43:01,202: INFO/ForkPoolWorker-1] Getting SDNC list 2024-06-19T02:43:01.207252871Z [2024-06-19 02:43:01,206: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:43:01.244501986Z [2024-06-19 02:43:01,244: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T02:43:01.245770815Z [2024-06-19 02:43:01,245: INFO/ForkPoolWorker-1] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T02:43:01.245818477Z [2024-06-19 02:43:01,245: INFO/ForkPoolWorker-1] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T02:43:01.245868880Z [2024-06-19 02:43:01,245: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-06-19T02:43:01.246047387Z [2024-06-19 02:43:01,245: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T02:43:01.331753982Z [2024-06-19 02:43:01,331: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:43:01.991327776Z [2024-06-19 02:43:01,990: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4b20c0e6-a654-4896-a696-b20384787738] succeeded in 1.249046320999696s: None 2024-06-19T02:43:02.286632131Z [2024-06-19 02:43:02,286: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T02:43:02.290538167Z [2024-06-19 02:43:02,290: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:43:02.339062138Z [2024-06-19 02:43:02,338: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T02:43:02.343468395Z [2024-06-19 02:43:02,342: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:43:02.359277457Z [2024-06-19 02:43:02,359: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T02:43:02.360620180Z [2024-06-19 02:43:02,360: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:43:02.360663492Z [2024-06-19 02:43:02,360: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:43:02.361776119Z [2024-06-19 02:43:02,361: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:43:02.361790291Z [2024-06-19 02:43:02,361: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T02:43:02.362030475Z [2024-06-19 02:43:02,361: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T02:43:02.362097300Z [2024-06-19 02:43:02,362: INFO/ForkPoolWorker-16] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:43:02.370266497Z [2024-06-19 02:43:02,370: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T02:43:02.371492514Z [2024-06-19 02:43:02,371: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:43:02.371502598Z [2024-06-19 02:43:02,371: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:43:02.371506699Z [2024-06-19 02:43:02,371: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:43:02.371510221Z [2024-06-19 02:43:02,371: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T02:43:02.371604150Z [2024-06-19 02:43:02,371: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-06-19T02:43:02.371612823Z [2024-06-19 02:43:02,371: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:43:02.443740538Z [2024-06-19 02:43:02,443: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:43:02.475390888Z [2024-06-19 02:43:02,475: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:43:04.495763575Z [2024-06-19 02:43:04,495: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[481d1664-276e-46c3-9eaf-886d8bc02f04] succeeded in 3.7741696310004045s: None 2024-06-19T02:43:04.781734564Z [2024-06-19 02:43:04,780: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b07273ee-f8fa-4598-aaee-531c5a027d77] succeeded in 4.061356833999525s: None 2024-06-19T02:44:01.198954726Z [2024-06-19 02:44:01,198: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[28e0e681-2001-4130-b24d-b12b248b5618] received 2024-06-19T02:44:01.205153075Z [2024-06-19 02:44:01,204: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dfcfd588-1fb5-4319-b2ad-a7b3f2189ce4] received 2024-06-19T02:44:01.213290991Z [2024-06-19 02:44:01,212: INFO/ForkPoolWorker-15] [28e0e681-2001-4130-b24d-b12b248b5618] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T02:44:01.216289724Z [2024-06-19 02:44:01,215: INFO/ForkPoolWorker-16] [dfcfd588-1fb5-4319-b2ad-a7b3f2189ce4] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T02:44:01.222940549Z [2024-06-19 02:44:01,222: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f6e8a6eb-ce3c-43c3-b08d-d8779c6f0bbe] received 2024-06-19T02:44:01.231642102Z [2024-06-19 02:44:01,231: INFO/ForkPoolWorker-1] [f6e8a6eb-ce3c-43c3-b08d-d8779c6f0bbe] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-19T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-19T02:44:01.236627708Z [2024-06-19 02:44:01,236: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[460507d8-4b8f-4629-8b99-9b487eb26799] received 2024-06-19T02:44:01.249194381Z [2024-06-19 02:44:01,248: INFO/ForkPoolWorker-2] [460507d8-4b8f-4629-8b99-9b487eb26799] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T02:44:01.506118758Z [2024-06-19 02:44:01,502: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T02:44:01.539233608Z [2024-06-19 02:44:01,535: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T02:44:01.580983785Z [2024-06-19 02:44:01,577: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-19T02:44:01.587971468Z [2024-06-19 02:44:01,584: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T02:44:01.685491690Z [2024-06-19 02:44:01,685: INFO/ForkPoolWorker-16] Getting SDNC list 2024-06-19T02:44:01.689815252Z [2024-06-19 02:44:01,689: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:44:01.718201118Z [2024-06-19 02:44:01,717: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T02:44:01.719262668Z [2024-06-19 02:44:01,719: INFO/ForkPoolWorker-16] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T02:44:01.719910156Z [2024-06-19 02:44:01,719: INFO/ForkPoolWorker-16] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T02:44:01.720094307Z [2024-06-19 02:44:01,719: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-06-19T02:44:01.720438979Z [2024-06-19 02:44:01,720: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T02:44:01.829305315Z [2024-06-19 02:44:01,829: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:44:01.918182034Z [2024-06-19 02:44:01,917: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:44:02.537268180Z [2024-06-19 02:44:02,535: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[dfcfd588-1fb5-4319-b2ad-a7b3f2189ce4] succeeded in 1.3286093289989367s: None 2024-06-19T02:44:02.584410070Z [2024-06-19 02:44:02,583: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f6e8a6eb-ce3c-43c3-b08d-d8779c6f0bbe] succeeded in 1.3590058350000618s: None 2024-06-19T02:44:02.906921825Z [2024-06-19 02:44:02,906: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T02:44:02.910958719Z [2024-06-19 02:44:02,910: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:44:02.936936034Z [2024-06-19 02:44:02,936: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T02:44:02.938229683Z [2024-06-19 02:44:02,938: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:44:02.938361046Z [2024-06-19 02:44:02,938: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:44:02.938572830Z [2024-06-19 02:44:02,938: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:44:02.938702076Z [2024-06-19 02:44:02,938: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T02:44:02.939095799Z [2024-06-19 02:44:02,938: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T02:44:02.939206863Z [2024-06-19 02:44:02,939: INFO/ForkPoolWorker-15] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:44:03.029211727Z [2024-06-19 02:44:03,028: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:44:03.035722622Z [2024-06-19 02:44:03,035: INFO/ForkPoolWorker-2] Getting VIM list 2024-06-19T02:44:03.039017851Z [2024-06-19 02:44:03,038: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:44:03.063399437Z [2024-06-19 02:44:03,063: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T02:44:03.064960708Z [2024-06-19 02:44:03,064: INFO/ForkPoolWorker-2] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:44:03.065072428Z [2024-06-19 02:44:03,064: INFO/ForkPoolWorker-2] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:44:03.065267737Z [2024-06-19 02:44:03,065: INFO/ForkPoolWorker-2] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:44:03.065379527Z [2024-06-19 02:44:03,065: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-06-19T02:44:03.065661219Z [2024-06-19 02:44:03,065: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-06-19T02:44:03.065777648Z [2024-06-19 02:44:03,065: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:44:03.149745493Z [2024-06-19 02:44:03,149: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:44:04.876248542Z [2024-06-19 02:44:04,875: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[28e0e681-2001-4130-b24d-b12b248b5618] succeeded in 3.6751523620005173s: None 2024-06-19T02:44:05.938888766Z [2024-06-19 02:44:05,938: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[460507d8-4b8f-4629-8b99-9b487eb26799] succeeded in 4.6993263570002455s: None 2024-06-19T02:45:01.174085667Z [2024-06-19 02:45:01,173: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bffb1c64-5f15-43f7-9f14-0e6561c2442b] received 2024-06-19T02:45:01.178505507Z [2024-06-19 02:45:01,178: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d1b22c70-6a9f-421a-97b5-ba20b4d34d4c] received 2024-06-19T02:45:01.193718969Z [2024-06-19 02:45:01,193: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cc323445-88b9-41c2-8cd9-606465c93a2b] received 2024-06-19T02:45:01.194243192Z [2024-06-19 02:45:01,194: INFO/ForkPoolWorker-16] [d1b22c70-6a9f-421a-97b5-ba20b4d34d4c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T02:45:01.197379822Z [2024-06-19 02:45:01,196: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3ceff22b-5db2-45f7-9566-9747fc3c2d4e] received 2024-06-19T02:45:01.198134926Z [2024-06-19 02:45:01,197: INFO/ForkPoolWorker-15] [bffb1c64-5f15-43f7-9f14-0e6561c2442b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'extract_metrics_from_vnfrs', 'scheduled__2024-06-19T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T02:45:01.201492899Z [2024-06-19 02:45:01,201: INFO/ForkPoolWorker-1] [cc323445-88b9-41c2-8cd9-606465c93a2b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T02:45:01.208076353Z [2024-06-19 02:45:01,207: INFO/ForkPoolWorker-2] [3ceff22b-5db2-45f7-9566-9747fc3c2d4e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T02:45:01.496088810Z [2024-06-19 02:45:01,492: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T02:45:01.515760528Z [2024-06-19 02:45:01,512: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T02:45:01.618208365Z [2024-06-19 02:45:01,614: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T02:45:01.625960245Z [2024-06-19 02:45:01,614: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T02:45:01.817785181Z [2024-06-19 02:45:01,817: INFO/ForkPoolWorker-2] Getting SDNC list 2024-06-19T02:45:01.821424355Z [2024-06-19 02:45:01,821: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:45:01.846113632Z [2024-06-19 02:45:01,845: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T02:45:01.848034807Z [2024-06-19 02:45:01,847: INFO/ForkPoolWorker-2] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T02:45:01.848240773Z [2024-06-19 02:45:01,847: INFO/ForkPoolWorker-2] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T02:45:01.848350893Z [2024-06-19 02:45:01,848: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-06-19T02:45:01.848539446Z [2024-06-19 02:45:01,848: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T02:45:01.952047511Z [2024-06-19 02:45:01,951: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:45:02.637869729Z [2024-06-19 02:45:02,637: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[3ceff22b-5db2-45f7-9566-9747fc3c2d4e] succeeded in 1.4368372989993077s: None 2024-06-19T02:45:02.949348744Z [2024-06-19 02:45:02,948: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T02:45:02.952637673Z [2024-06-19 02:45:02,952: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:45:02.988575739Z [2024-06-19 02:45:02,988: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T02:45:02.988866573Z [2024-06-19 02:45:02,988: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T02:45:02.992153600Z [2024-06-19 02:45:02,991: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:45:02.992907864Z [2024-06-19 02:45:02,992: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:45:02.993146026Z [2024-06-19 02:45:02,992: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:45:02.993388158Z [2024-06-19 02:45:02,993: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:45:02.993579675Z [2024-06-19 02:45:02,993: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T02:45:02.994020718Z [2024-06-19 02:45:02,993: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T02:45:02.994301185Z [2024-06-19 02:45:02,994: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:45:03.013501958Z [2024-06-19 02:45:03,013: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T02:45:03.021544759Z [2024-06-19 02:45:03,021: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:45:03.028676861Z [2024-06-19 02:45:03,028: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T02:45:03.030614323Z [2024-06-19 02:45:03,030: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:45:03.030645563Z [2024-06-19 02:45:03,030: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:45:03.030668855Z [2024-06-19 02:45:03,030: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:45:03.030779500Z [2024-06-19 02:45:03,030: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T02:45:03.031073810Z [2024-06-19 02:45:03,030: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-19T02:45:03.031143651Z [2024-06-19 02:45:03,031: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:45:03.054538166Z [2024-06-19 02:45:03,054: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T02:45:03.057924344Z [2024-06-19 02:45:03,057: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:45:03.058110891Z [2024-06-19 02:45:03,057: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:45:03.058296210Z [2024-06-19 02:45:03,058: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:45:03.058401472Z [2024-06-19 02:45:03,058: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T02:45:03.059122640Z [2024-06-19 02:45:03,058: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T02:45:03.059250690Z [2024-06-19 02:45:03,059: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:45:03.085105641Z [2024-06-19 02:45:03,084: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:45:03.145669211Z [2024-06-19 02:45:03,145: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:45:03.157580114Z [2024-06-19 02:45:03,157: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:45:03.760135704Z [2024-06-19 02:45:03,757: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bffb1c64-5f15-43f7-9f14-0e6561c2442b] succeeded in 2.572167211001215s: None 2024-06-19T02:45:03.977620699Z [2024-06-19 02:45:03,977: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1982a62d-69c1-44a7-b764-6716bc1ea2fa] received 2024-06-19T02:45:03.985953652Z [2024-06-19 02:45:03,985: INFO/ForkPoolWorker-15] [1982a62d-69c1-44a7-b764-6716bc1ea2fa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'split_metrics', 'scheduled__2024-06-19T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T02:45:04.371161875Z [2024-06-19 02:45:04,367: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T02:45:05.251624783Z [2024-06-19 02:45:05,251: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d1b22c70-6a9f-421a-97b5-ba20b4d34d4c] succeeded in 4.069360022000183s: None 2024-06-19T02:45:05.393698182Z [2024-06-19 02:45:05,393: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T02:45:05.396687842Z [2024-06-19 02:45:05,396: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:45:05.428987903Z [2024-06-19 02:45:05,428: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T02:45:05.430621402Z [2024-06-19 02:45:05,430: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:45:05.430709124Z [2024-06-19 02:45:05,430: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:45:05.430944207Z [2024-06-19 02:45:05,430: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:45:05.431055207Z [2024-06-19 02:45:05,430: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T02:45:05.431935899Z [2024-06-19 02:45:05,431: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T02:45:05.431954024Z [2024-06-19 02:45:05,431: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:45:05.511738890Z [2024-06-19 02:45:05,511: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:45:06.047345382Z [2024-06-19 02:45:06,046: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[cc323445-88b9-41c2-8cd9-606465c93a2b] succeeded in 4.851742109998668s: None 2024-06-19T02:45:06.090581683Z [2024-06-19 02:45:06,090: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1982a62d-69c1-44a7-b764-6716bc1ea2fa] succeeded in 2.1105274689998623s: None 2024-06-19T02:45:06.864520303Z [2024-06-19 02:45:06,864: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4b91190a-4861-46e2-8e88-8e7a235c3f8f] received 2024-06-19T02:45:06.875556216Z [2024-06-19 02:45:06,875: INFO/ForkPoolWorker-15] [4b91190a-4861-46e2-8e88-8e7a235c3f8f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'collect_metrics', 'scheduled__2024-06-19T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-06-19T02:45:07.180577076Z [2024-06-19 02:45:07,177: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T02:45:08.313954547Z [2024-06-19 02:45:08,313: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T02:45:08.317474541Z [2024-06-19 02:45:08,316: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:45:08.344017352Z [2024-06-19 02:45:08,343: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T02:45:08.346021017Z [2024-06-19 02:45:08,345: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:45:08.346040643Z [2024-06-19 02:45:08,345: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:45:08.346429518Z [2024-06-19 02:45:08,346: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:45:08.346448706Z [2024-06-19 02:45:08,346: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T02:45:08.346844783Z [2024-06-19 02:45:08,346: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T02:45:08.347112715Z [2024-06-19 02:45:08,346: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:45:08.456426375Z [2024-06-19 02:45:08,456: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:45:09.036295774Z [2024-06-19 02:45:09,036: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[94df1ace-321d-4ec7-a298-54fe32af0f51] received 2024-06-19T02:45:09.046095962Z [2024-06-19 02:45:09,045: INFO/ForkPoolWorker-16] [94df1ace-321d-4ec7-a298-54fe32af0f51] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'send_prometheus', 'scheduled__2024-06-19T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-06-19T02:45:09.090978299Z [2024-06-19 02:45:09,087: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4b91190a-4861-46e2-8e88-8e7a235c3f8f] succeeded in 2.2192305699991266s: None 2024-06-19T02:45:09.329012425Z [2024-06-19 02:45:09,321: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-06-19T02:45:10.363674812Z [2024-06-19 02:45:10,363: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T02:45:10.366685383Z [2024-06-19 02:45:10,366: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:45:10.390198875Z [2024-06-19 02:45:10,389: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T02:45:10.391475205Z [2024-06-19 02:45:10,391: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:45:10.391497147Z [2024-06-19 02:45:10,391: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:45:10.391659035Z [2024-06-19 02:45:10,391: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:45:10.391670679Z [2024-06-19 02:45:10,391: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T02:45:10.392154811Z [2024-06-19 02:45:10,391: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-06-19T02:45:10.392181284Z [2024-06-19 02:45:10,391: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:45:10.481142159Z [2024-06-19 02:45:10,480: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:45:11.156255891Z [2024-06-19 02:45:11,155: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[94df1ace-321d-4ec7-a298-54fe32af0f51] succeeded in 2.11805295799968s: None 2024-06-19T02:46:01.081706434Z [2024-06-19 02:46:01,081: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[20a32fb3-57da-480f-a841-4435102b6f63] received 2024-06-19T02:46:01.085301500Z [2024-06-19 02:46:01,085: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f256f2e9-2fdf-4c74-9eac-0c2ecb6a5a39] received 2024-06-19T02:46:01.096326305Z [2024-06-19 02:46:01,095: INFO/ForkPoolWorker-15] [20a32fb3-57da-480f-a841-4435102b6f63] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-19T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-19T02:46:01.105446045Z [2024-06-19 02:46:01,105: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[428625ff-c856-40c1-92d0-758b97fd5e13] received 2024-06-19T02:46:01.108086773Z [2024-06-19 02:46:01,107: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[abcb79af-24f3-47dd-bc6d-413573bfdea2] received 2024-06-19T02:46:01.110113126Z [2024-06-19 02:46:01,109: INFO/ForkPoolWorker-16] [f256f2e9-2fdf-4c74-9eac-0c2ecb6a5a39] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T02:46:01.122002622Z [2024-06-19 02:46:01,121: INFO/ForkPoolWorker-2] [abcb79af-24f3-47dd-bc6d-413573bfdea2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T02:46:01.128303955Z [2024-06-19 02:46:01,128: INFO/ForkPoolWorker-1] [428625ff-c856-40c1-92d0-758b97fd5e13] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T02:46:01.446322638Z [2024-06-19 02:46:01,440: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-19T02:46:01.461559864Z [2024-06-19 02:46:01,456: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T02:46:01.492899829Z [2024-06-19 02:46:01,489: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T02:46:01.713781410Z [2024-06-19 02:46:01,713: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:46:01.901522495Z [2024-06-19 02:46:01,898: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T02:46:02.090680363Z [2024-06-19 02:46:02,090: INFO/ForkPoolWorker-2] Getting SDNC list 2024-06-19T02:46:02.094698501Z [2024-06-19 02:46:02,094: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:46:02.120448508Z [2024-06-19 02:46:02,120: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T02:46:02.121766260Z [2024-06-19 02:46:02,121: INFO/ForkPoolWorker-2] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T02:46:02.121842846Z [2024-06-19 02:46:02,121: INFO/ForkPoolWorker-2] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T02:46:02.121915429Z [2024-06-19 02:46:02,121: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-06-19T02:46:02.122110850Z [2024-06-19 02:46:02,121: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T02:46:02.219397893Z [2024-06-19 02:46:02,219: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:46:02.396690189Z [2024-06-19 02:46:02,396: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[20a32fb3-57da-480f-a841-4435102b6f63] succeeded in 1.3130244179992587s: None 2024-06-19T02:46:02.790448347Z [2024-06-19 02:46:02,790: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T02:46:02.794013161Z [2024-06-19 02:46:02,793: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:46:02.824870987Z [2024-06-19 02:46:02,824: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T02:46:02.826189048Z [2024-06-19 02:46:02,825: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:46:02.826257995Z [2024-06-19 02:46:02,826: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:46:02.826320793Z [2024-06-19 02:46:02,826: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:46:02.826354980Z [2024-06-19 02:46:02,826: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T02:46:02.826554293Z [2024-06-19 02:46:02,826: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-19T02:46:02.826590805Z [2024-06-19 02:46:02,826: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:46:02.972889214Z [2024-06-19 02:46:02,972: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:46:03.207216475Z [2024-06-19 02:46:03,206: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[abcb79af-24f3-47dd-bc6d-413573bfdea2] succeeded in 2.0970500240000547s: None 2024-06-19T02:46:03.381219745Z [2024-06-19 02:46:03,380: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T02:46:03.384542748Z [2024-06-19 02:46:03,384: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:46:03.410657614Z [2024-06-19 02:46:03,410: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T02:46:03.415782547Z [2024-06-19 02:46:03,415: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:46:03.416125182Z [2024-06-19 02:46:03,415: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:46:03.416317468Z [2024-06-19 02:46:03,416: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:46:03.416412366Z [2024-06-19 02:46:03,416: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T02:46:03.416744676Z [2024-06-19 02:46:03,416: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T02:46:03.416914480Z [2024-06-19 02:46:03,416: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:46:03.528568140Z [2024-06-19 02:46:03,528: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:46:05.722393049Z [2024-06-19 02:46:05,721: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[428625ff-c856-40c1-92d0-758b97fd5e13] succeeded in 4.613686130000133s: None 2024-06-19T02:46:05.752502663Z [2024-06-19 02:46:05,752: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f256f2e9-2fdf-4c74-9eac-0c2ecb6a5a39] succeeded in 4.665048584998658s: None 2024-06-19T02:47:00.973859436Z [2024-06-19 02:47:00,973: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9d58472f-ef07-4fe5-981c-9991b1395daa] received 2024-06-19T02:47:00.976227128Z [2024-06-19 02:47:00,976: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4f5f05f4-7cc6-421e-a25c-c3b8d11a799e] received 2024-06-19T02:47:00.988064506Z [2024-06-19 02:47:00,987: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b90e9820-c5af-4b04-a9c5-08d3b3d2f204] received 2024-06-19T02:47:00.988983283Z [2024-06-19 02:47:00,988: INFO/ForkPoolWorker-15] [9d58472f-ef07-4fe5-981c-9991b1395daa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T02:47:00.992445465Z [2024-06-19 02:47:00,992: INFO/ForkPoolWorker-16] [4f5f05f4-7cc6-421e-a25c-c3b8d11a799e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T02:47:01.009788718Z [2024-06-19 02:47:01,008: INFO/ForkPoolWorker-1] [b90e9820-c5af-4b04-a9c5-08d3b3d2f204] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T02:47:01.307929001Z [2024-06-19 02:47:01,304: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T02:47:01.312235421Z [2024-06-19 02:47:01,309: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T02:47:01.328766832Z [2024-06-19 02:47:01,325: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T02:47:01.475762720Z [2024-06-19 02:47:01,475: INFO/ForkPoolWorker-1] Getting SDNC list 2024-06-19T02:47:01.479798528Z [2024-06-19 02:47:01,479: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:47:01.530219607Z [2024-06-19 02:47:01,529: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T02:47:01.531368180Z [2024-06-19 02:47:01,531: INFO/ForkPoolWorker-1] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T02:47:01.531555805Z [2024-06-19 02:47:01,531: INFO/ForkPoolWorker-1] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T02:47:01.531738536Z [2024-06-19 02:47:01,531: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-06-19T02:47:01.532095594Z [2024-06-19 02:47:01,531: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T02:47:01.621528064Z [2024-06-19 02:47:01,621: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:47:02.238911530Z [2024-06-19 02:47:02,238: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b90e9820-c5af-4b04-a9c5-08d3b3d2f204] succeeded in 1.2466891450021649s: None 2024-06-19T02:47:02.433461040Z [2024-06-19 02:47:02,432: INFO/ForkPoolWorker-15] Getting VIM list 2024-06-19T02:47:02.439083641Z [2024-06-19 02:47:02,438: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:47:02.473421103Z [2024-06-19 02:47:02,473: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-06-19T02:47:02.475003157Z [2024-06-19 02:47:02,474: INFO/ForkPoolWorker-15] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:47:02.475069911Z [2024-06-19 02:47:02,474: INFO/ForkPoolWorker-15] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:47:02.475370178Z [2024-06-19 02:47:02,475: INFO/ForkPoolWorker-15] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:47:02.475461782Z [2024-06-19 02:47:02,475: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-06-19T02:47:02.476073804Z [2024-06-19 02:47:02,475: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-06-19T02:47:02.476279433Z [2024-06-19 02:47:02,476: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:47:02.525445033Z [2024-06-19 02:47:02,525: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T02:47:02.528498759Z [2024-06-19 02:47:02,528: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:47:02.563833055Z [2024-06-19 02:47:02,563: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T02:47:02.565822988Z [2024-06-19 02:47:02,565: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:47:02.565848415Z [2024-06-19 02:47:02,565: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:47:02.565922110Z [2024-06-19 02:47:02,565: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:47:02.565978874Z [2024-06-19 02:47:02,565: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T02:47:02.566289826Z [2024-06-19 02:47:02,566: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T02:47:02.566304990Z [2024-06-19 02:47:02,566: INFO/ForkPoolWorker-16] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:47:02.616022641Z [2024-06-19 02:47:02,615: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:47:02.658746021Z [2024-06-19 02:47:02,658: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:47:04.473331658Z [2024-06-19 02:47:04,472: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4f5f05f4-7cc6-421e-a25c-c3b8d11a799e] succeeded in 3.4953659549973963s: None 2024-06-19T02:47:05.362433655Z [2024-06-19 02:47:05,361: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9d58472f-ef07-4fe5-981c-9991b1395daa] succeeded in 4.384483253998042s: None 2024-06-19T02:48:00.806759046Z [2024-06-19 02:48:00,806: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fb8792c0-4aa6-42ca-8502-fb9bae0b8988] received 2024-06-19T02:48:00.808258946Z [2024-06-19 02:48:00,808: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2a9589a7-c6f5-4921-ba3b-6c9034d04a7c] received 2024-06-19T02:48:00.823788544Z [2024-06-19 02:48:00,822: INFO/ForkPoolWorker-16] [2a9589a7-c6f5-4921-ba3b-6c9034d04a7c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-06-19T02:48:00.828183582Z [2024-06-19 02:48:00,827: INFO/ForkPoolWorker-15] [fb8792c0-4aa6-42ca-8502-fb9bae0b8988] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-06-19T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-06-19T02:48:00.834505593Z [2024-06-19 02:48:00,834: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[98d9b782-c01e-4bfe-b7eb-16d7ec56bfb8] received 2024-06-19T02:48:00.841025365Z [2024-06-19 02:48:00,840: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[82f02a5c-9de5-42fd-91ba-7f0b0b3ce07b] received 2024-06-19T02:48:00.854153181Z [2024-06-19 02:48:00,853: INFO/ForkPoolWorker-2] [82f02a5c-9de5-42fd-91ba-7f0b0b3ce07b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-06-19T02:48:00.860334224Z [2024-06-19 02:48:00,860: INFO/ForkPoolWorker-1] [98d9b782-c01e-4bfe-b7eb-16d7ec56bfb8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-06-19T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-06-19T02:48:01.231872893Z [2024-06-19 02:48:01,228: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-06-19T02:48:01.246436482Z [2024-06-19 02:48:01,243: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-06-19T02:48:01.342496111Z [2024-06-19 02:48:01,337: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-06-19T02:48:01.493962132Z [2024-06-19 02:48:01,493: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:48:01.526050180Z [2024-06-19 02:48:01,520: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-06-19T02:48:01.751913277Z [2024-06-19 02:48:01,751: INFO/ForkPoolWorker-2] Getting SDNC list 2024-06-19T02:48:01.756380263Z [2024-06-19 02:48:01,755: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:48:01.805203056Z [2024-06-19 02:48:01,804: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-06-19T02:48:01.812657674Z [2024-06-19 02:48:01,812: INFO/ForkPoolWorker-2] Read SDNC 9bd9c48d-bd30-4680-aaf2-034ba0b0b386 (sdnc-osm) 2024-06-19T02:48:01.812993972Z [2024-06-19 02:48:01,812: INFO/ForkPoolWorker-2] [{'_id': '9bd9c48d-bd30-4680-aaf2-034ba0b0b386', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-06-19T02:48:01.813186417Z [2024-06-19 02:48:01,813: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-06-19T02:48:01.813554550Z [2024-06-19 02:48:01,813: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_9bd9c48d-bd30-4680-aaf2-034ba0b0b386 2024-06-19T02:48:01.949646043Z [2024-06-19 02:48:01,949: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:48:02.074299435Z [2024-06-19 02:48:02,073: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fb8792c0-4aa6-42ca-8502-fb9bae0b8988] succeeded in 1.264382163000846s: None 2024-06-19T02:48:02.503387893Z [2024-06-19 02:48:02,503: INFO/ForkPoolWorker-16] Getting VIM list 2024-06-19T02:48:02.512417134Z [2024-06-19 02:48:02,511: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:48:02.564803741Z [2024-06-19 02:48:02,564: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-06-19T02:48:02.567137122Z [2024-06-19 02:48:02,566: INFO/ForkPoolWorker-16] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:48:02.567427449Z [2024-06-19 02:48:02,567: INFO/ForkPoolWorker-16] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:48:02.567679074Z [2024-06-19 02:48:02,567: INFO/ForkPoolWorker-16] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:48:02.567904361Z [2024-06-19 02:48:02,567: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-06-19T02:48:02.568555728Z [2024-06-19 02:48:02,568: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-06-19T02:48:02.568783050Z [2024-06-19 02:48:02,568: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:48:02.598957528Z [2024-06-19 02:48:02,598: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[82f02a5c-9de5-42fd-91ba-7f0b0b3ce07b] succeeded in 1.7558814920012082s: None 2024-06-19T02:48:02.649511005Z [2024-06-19 02:48:02,649: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:48:02.729772682Z [2024-06-19 02:48:02,729: INFO/ForkPoolWorker-1] Getting VIM list 2024-06-19T02:48:02.732880354Z [2024-06-19 02:48:02,732: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'hpNI5sYUhdiQYq9Ku5yyotY0IdttzlyX'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-06-19T02:48:02.759474034Z [2024-06-19 02:48:02,759: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-06-19T02:48:02.760946436Z [2024-06-19 02:48:02,760: INFO/ForkPoolWorker-1] Read VIM ce5082d1-9203-44a6-ac3f-4e02c74d44eb (_system-osm-vim) 2024-06-19T02:48:02.761112611Z [2024-06-19 02:48:02,760: INFO/ForkPoolWorker-1] Read VIM c1779040-8a5f-4394-a201-f69ca21c81b5 (osm) 2024-06-19T02:48:02.761282839Z [2024-06-19 02:48:02,761: INFO/ForkPoolWorker-1] [{'_id': 'ce5082d1-9203-44a6-ac3f-4e02c74d44eb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c1779040-8a5f-4394-a201-f69ca21c81b5', 'name': 'osm', 'vim_type': 'openstack'}] 2024-06-19T02:48:02.761396013Z [2024-06-19 02:48:02,761: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-06-19T02:48:02.761699249Z [2024-06-19 02:48:02,761: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-06-19T02:48:02.761848616Z [2024-06-19 02:48:02,761: INFO/ForkPoolWorker-1] Creating DAG vim_status_c1779040-8a5f-4394-a201-f69ca21c81b5 2024-06-19T02:48:02.836158477Z [2024-06-19 02:48:02,835: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-06-19T02:48:04.385995002Z [2024-06-19 02:48:04,385: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[98d9b782-c01e-4bfe-b7eb-16d7ec56bfb8] succeeded in 3.5441558310012624s: None 2024-06-19T02:48:04.602664543Z [2024-06-19 02:48:04,602: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2a9589a7-c6f5-4921-ba3b-6c9034d04a7c] succeeded in 3.79118487300002s: None