2024-04-05T22:30:59.453266077Z 2024-04-05T22:31:01.254466652Z /home/airflow/.local/lib/python3.10/site-packages/airflow/configuration.py:384 FutureWarning: The auth_backends setting in [api] has had airflow.api.auth.backend.session added in the running config, which is needed by the UI. Please update your config before Apache Airflow 3.0. 2024-04-05T22:31:03.393964359Z /home/airflow/.local/lib/python3.10/site-packages/airflow/models/base.py:49 MovedIn20Warning: Deprecated API features detected! These feature(s) are not compatible with SQLAlchemy 2.0. To prevent incompatible upgrades prior to updating applications, ensure requirements files are pinned to "sqlalchemy<2.0". Set environment variable SQLALCHEMY_WARN_20=1 to show all deprecation warnings. Set environment variable SQLALCHEMY_SILENCE_UBER_WARNING=1 to silence this message. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9) 2024-04-05T22:31:09.767576545Z [2024-04-05 22:31:09 +0000] [16] [INFO] Starting gunicorn 20.1.0 2024-04-05T22:31:09.774801048Z [2024-04-05 22:31:09 +0000] [16] [INFO] Listening at: http://[::]:8793 (16) 2024-04-05T22:31:09.774818074Z [2024-04-05 22:31:09 +0000] [16] [INFO] Using worker: sync 2024-04-05T22:31:09.799373552Z [2024-04-05 22:31:09 +0000] [17] [INFO] Booting worker with pid: 17 2024-04-05T22:31:09.887002990Z [2024-04-05 22:31:09 +0000] [18] [INFO] Booting worker with pid: 18 2024-04-05T22:31:12.055147623Z 2024-04-05T22:31:12.055180090Z -------------- celery@airflow-worker-0 v5.2.7 (dawn-chorus) 2024-04-05T22:31:12.055186383Z --- ***** ----- 2024-04-05T22:31:12.055191742Z -- ******* ---- Linux-5.15.0-47-generic-x86_64-with-glibc2.31 2024-04-05 22:31:12 2024-04-05T22:31:12.055196189Z - *** --- * --- 2024-04-05T22:31:12.055201538Z - ** ---------- [config] 2024-04-05T22:31:12.055207025Z - ** ---------- .> app: airflow.executors.celery_executor:0x7fd5840ac190 2024-04-05T22:31:12.055211694Z - ** ---------- .> transport: redis://:**@airflow-redis:6379/0 2024-04-05T22:31:12.055216314Z - ** ---------- .> results: postgresql://postgres:**@airflow-postgresql.osm:5432/postgres 2024-04-05T22:31:12.055227080Z - *** --- * --- .> concurrency: 16 (prefork) 2024-04-05T22:31:12.055231514Z -- ******* ---- .> task events: OFF (enable -E to monitor tasks in this worker) 2024-04-05T22:31:12.055235905Z --- ***** ----- 2024-04-05T22:31:12.055240031Z -------------- [queues] 2024-04-05T22:31:12.055244906Z .> default exchange=default(direct) key=default 2024-04-05T22:31:12.055286808Z 2024-04-05T22:31:12.055292501Z 2024-04-05T22:31:12.055297191Z [tasks] 2024-04-05T22:31:12.055302713Z . airflow.executors.celery_executor.execute_command 2024-04-05T22:31:12.055306732Z 2024-04-05T22:31:17.516994192Z [2024-04-05 22:31:17,512: INFO/MainProcess] Connected to redis://:**@airflow-redis:6379/0 2024-04-05T22:31:17.521792792Z [2024-04-05 22:31:17,521: INFO/MainProcess] mingle: searching for neighbors 2024-04-05T22:31:18.559376386Z [2024-04-05 22:31:18,552: INFO/MainProcess] mingle: all alone 2024-04-05T22:31:18.586311692Z [2024-04-05 22:31:18,586: INFO/MainProcess] celery@airflow-worker-0 ready. 2024-04-05T22:32:12.221858639Z [2024-04-05 22:32:12,221: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aa319721-d2b2-4b68-8059-3c26de7c1ad8] received 2024-04-05T22:32:12.342435055Z [2024-04-05 22:32:12,341: INFO/ForkPoolWorker-15] [aa319721-d2b2-4b68-8059-3c26de7c1ad8] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T22:32:12.800991742Z [2024-04-05 22:32:12,791: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-05T22:32:13.248419451Z [2024-04-05 22:32:13,248: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:32:43.991361810Z [2024-04-05 22:32:43,990: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[aa319721-d2b2-4b68-8059-3c26de7c1ad8] succeeded in 31.762500611000064s: None 2024-04-05T22:32:54.482623684Z [2024-04-05 22:32:54,482: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[13283eef-8668-4969-932b-a4de5e9fd318] received 2024-04-05T22:32:54.513962220Z [2024-04-05 22:32:54,513: INFO/ForkPoolWorker-15] [13283eef-8668-4969-932b-a4de5e9fd318] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T22:32:54.793023263Z [2024-04-05 22:32:54,789: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-05T22:32:55.029675646Z [2024-04-05 22:32:55,029: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:33:25.683816638Z [2024-04-05 22:33:25,682: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[13283eef-8668-4969-932b-a4de5e9fd318] succeeded in 31.19809934700004s: None 2024-04-05T22:34:01.171434240Z [2024-04-05 22:34:01,171: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[988210c6-119d-4bf9-86f6-73760cac67b3] received 2024-04-05T22:34:01.181274208Z [2024-04-05 22:34:01,180: INFO/ForkPoolWorker-15] [988210c6-119d-4bf9-86f6-73760cac67b3] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T22:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T22:34:01.550523168Z [2024-04-05 22:34:01,546: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-05T22:34:01.868672413Z [2024-04-05 22:34:01,868: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:34:02.426075060Z [2024-04-05 22:34:02,425: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[988210c6-119d-4bf9-86f6-73760cac67b3] succeeded in 1.2511473319999595s: None 2024-04-05T22:36:00.702829984Z [2024-04-05 22:36:00,702: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[06b9a06e-855e-4732-a897-3034f33b2b11] received 2024-04-05T22:36:00.729939118Z [2024-04-05 22:36:00,723: INFO/ForkPoolWorker-15] [06b9a06e-855e-4732-a897-3034f33b2b11] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T22:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T22:36:01.108537475Z [2024-04-05 22:36:01,104: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-05T22:36:01.424997174Z [2024-04-05 22:36:01,424: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:36:02.098925791Z [2024-04-05 22:36:02,098: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[06b9a06e-855e-4732-a897-3034f33b2b11] succeeded in 1.391711497000074s: None 2024-04-05T22:38:00.183542618Z [2024-04-05 22:38:00,182: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[89657d46-063d-4b25-ba9d-ba75a30418bf] received 2024-04-05T22:38:00.224194430Z [2024-04-05 22:38:00,223: INFO/ForkPoolWorker-15] [89657d46-063d-4b25-ba9d-ba75a30418bf] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T22:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T22:38:00.604904357Z [2024-04-05 22:38:00,601: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-05T22:38:00.940074450Z [2024-04-05 22:38:00,939: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:38:01.572113564Z [2024-04-05 22:38:01,571: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[89657d46-063d-4b25-ba9d-ba75a30418bf] succeeded in 1.374646822999921s: None 2024-04-05T22:38:25.044726604Z [2024-04-05 22:38:25,044: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3d2bc906-baf7-4f1a-b890-c9505439f177] received 2024-04-05T22:38:25.061296284Z [2024-04-05 22:38:25,061: INFO/ForkPoolWorker-15] [3d2bc906-baf7-4f1a-b890-c9505439f177] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T22:38:25.063794529Z [2024-04-05 22:38:25,063: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1c69efb8-9a49-4122-a685-02c152f86e7a] received 2024-04-05T22:38:25.132222054Z [2024-04-05 22:38:25,131: INFO/ForkPoolWorker-16] [1c69efb8-9a49-4122-a685-02c152f86e7a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T22:38:25.600714637Z [2024-04-05 22:38:25,596: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T22:38:25.647192066Z [2024-04-05 22:38:25,643: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T22:38:26.961092811Z [2024-04-05 22:38:26,960: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T22:38:26.964476922Z [2024-04-05 22:38:26,963: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:38:26.999476358Z [2024-04-05 22:38:26,999: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T22:38:27.000765857Z [2024-04-05 22:38:27,000: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:38:27.000781432Z [2024-04-05 22:38:27,000: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:38:27.000991070Z [2024-04-05 22:38:27,000: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T22:38:27.001036604Z [2024-04-05 22:38:27,000: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T22:38:27.001339430Z [2024-04-05 22:38:27,001: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-05T22:38:27.001387422Z [2024-04-05 22:38:27,001: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:38:27.005250769Z [2024-04-05 22:38:27,004: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-05T22:38:27.008805658Z [2024-04-05 22:38:27,008: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:38:27.044156229Z [2024-04-05 22:38:27,043: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T22:38:27.045094716Z [2024-04-05 22:38:27,044: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:38:27.045103930Z [2024-04-05 22:38:27,044: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:38:27.045190045Z [2024-04-05 22:38:27,045: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T22:38:27.045211170Z [2024-04-05 22:38:27,045: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-05T22:38:27.045440235Z [2024-04-05 22:38:27,045: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T22:38:27.045447878Z [2024-04-05 22:38:27,045: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:38:27.115227122Z [2024-04-05 22:38:27,114: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:38:27.126168833Z [2024-04-05 22:38:27,125: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:38:28.823216986Z [2024-04-05 22:38:28,822: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1c69efb8-9a49-4122-a685-02c152f86e7a] succeeded in 3.7566499310000836s: None 2024-04-05T22:38:29.070926721Z [2024-04-05 22:38:29,070: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3d2bc906-baf7-4f1a-b890-c9505439f177] succeeded in 4.021017335999886s: None 2024-04-05T22:38:35.040750039Z [2024-04-05 22:38:35,040: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[021dd6ff-5b0b-493b-9d1c-51620331f26d] received 2024-04-05T22:38:35.049311025Z [2024-04-05 22:38:35,049: INFO/ForkPoolWorker-15] [021dd6ff-5b0b-493b-9d1c-51620331f26d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T22:38:35.465764186Z [2024-04-05 22:38:35,462: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T22:38:36.968606757Z [2024-04-05 22:38:36,968: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T22:38:36.976107464Z [2024-04-05 22:38:36,971: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:38:37.049061818Z [2024-04-05 22:38:37,048: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T22:38:37.056187834Z [2024-04-05 22:38:37,055: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:38:37.056215091Z [2024-04-05 22:38:37,056: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:38:37.057177983Z [2024-04-05 22:38:37,056: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T22:38:37.057218954Z [2024-04-05 22:38:37,057: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T22:38:37.057494188Z [2024-04-05 22:38:37,057: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T22:38:37.057530205Z [2024-04-05 22:38:37,057: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:38:37.170528428Z [2024-04-05 22:38:37,169: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:38:37.861946229Z [2024-04-05 22:38:37,861: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[021dd6ff-5b0b-493b-9d1c-51620331f26d] succeeded in 2.8177880379998896s: None 2024-04-05T22:38:38.053071919Z [2024-04-05 22:38:38,052: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[caef3707-8142-4e48-9444-940910c8035f] received 2024-04-05T22:38:38.064269529Z [2024-04-05 22:38:38,064: INFO/ForkPoolWorker-15] [caef3707-8142-4e48-9444-940910c8035f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'split_metrics', 'scheduled__2024-04-05T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T22:38:38.360563743Z [2024-04-05 22:38:38,354: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T22:38:39.749452686Z [2024-04-05 22:38:39,748: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T22:38:39.759281849Z [2024-04-05 22:38:39,758: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:38:39.788729892Z [2024-04-05 22:38:39,788: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T22:38:39.790008676Z [2024-04-05 22:38:39,789: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:38:39.790141940Z [2024-04-05 22:38:39,789: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:38:39.790399096Z [2024-04-05 22:38:39,790: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T22:38:39.790515908Z [2024-04-05 22:38:39,790: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T22:38:39.790800144Z [2024-04-05 22:38:39,790: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T22:38:39.790912934Z [2024-04-05 22:38:39,790: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:38:39.868003402Z [2024-04-05 22:38:39,867: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:38:40.475208261Z [2024-04-05 22:38:40,474: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[caef3707-8142-4e48-9444-940910c8035f] succeeded in 2.4200162940001064s: None 2024-04-05T22:38:40.861519693Z [2024-04-05 22:38:40,861: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c186b461-b3d0-4cea-ae36-8da01ecdf845] received 2024-04-05T22:38:40.880059673Z [2024-04-05 22:38:40,879: INFO/ForkPoolWorker-15] [c186b461-b3d0-4cea-ae36-8da01ecdf845] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'collect_metrics', 'scheduled__2024-04-05T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T22:38:41.164221497Z [2024-04-05 22:38:41,159: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T22:38:42.362634392Z [2024-04-05 22:38:42,362: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T22:38:42.365920144Z [2024-04-05 22:38:42,365: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:38:42.390549161Z [2024-04-05 22:38:42,390: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T22:38:42.392089409Z [2024-04-05 22:38:42,391: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:38:42.392105876Z [2024-04-05 22:38:42,391: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:38:42.392290629Z [2024-04-05 22:38:42,392: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T22:38:42.392302888Z [2024-04-05 22:38:42,392: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T22:38:42.392543385Z [2024-04-05 22:38:42,392: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T22:38:42.392571101Z [2024-04-05 22:38:42,392: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:38:42.475052746Z [2024-04-05 22:38:42,474: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:38:43.066740599Z [2024-04-05 22:38:43,066: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c186b461-b3d0-4cea-ae36-8da01ecdf845] succeeded in 2.202097201000015s: None 2024-04-05T22:38:43.940009895Z [2024-04-05 22:38:43,939: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ee6ef4bf-9b89-4b46-b3d1-9d601b8654fe] received 2024-04-05T22:38:43.948442376Z [2024-04-05 22:38:43,948: INFO/ForkPoolWorker-15] [ee6ef4bf-9b89-4b46-b3d1-9d601b8654fe] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'send_prometheus', 'scheduled__2024-04-05T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T22:38:44.269559796Z [2024-04-05 22:38:44,266: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T22:38:45.519767126Z [2024-04-05 22:38:45,519: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T22:38:45.522682334Z [2024-04-05 22:38:45,522: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:38:45.539979487Z [2024-04-05 22:38:45,539: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T22:38:45.540890244Z [2024-04-05 22:38:45,540: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:38:45.540900576Z [2024-04-05 22:38:45,540: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:38:45.541010256Z [2024-04-05 22:38:45,540: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T22:38:45.541016664Z [2024-04-05 22:38:45,540: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T22:38:45.541237085Z [2024-04-05 22:38:45,541: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T22:38:45.541243730Z [2024-04-05 22:38:45,541: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:38:45.637869745Z [2024-04-05 22:38:45,637: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:38:46.180729182Z [2024-04-05 22:38:46,180: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ee6ef4bf-9b89-4b46-b3d1-9d601b8654fe] succeeded in 2.2384241949998795s: None 2024-04-05T22:38:58.462687710Z [2024-04-05 22:38:58,453: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aefacb27-51f0-49f5-980d-967777398c85] received 2024-04-05T22:38:58.475567674Z [2024-04-05 22:38:58,474: INFO/ForkPoolWorker-15] [aefacb27-51f0-49f5-980d-967777398c85] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T22:38:58.992743438Z [2024-04-05 22:38:58,986: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-05T22:38:59.275265277Z [2024-04-05 22:38:59,274: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-05T22:38:59.278973423Z [2024-04-05 22:38:59,278: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:38:59.328574173Z [2024-04-05 22:38:59,328: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T22:38:59.332110929Z [2024-04-05 22:38:59,331: INFO/ForkPoolWorker-15] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-05T22:38:59.335166945Z [2024-04-05 22:38:59,334: INFO/ForkPoolWorker-15] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-05T22:38:59.335382249Z [2024-04-05 22:38:59,335: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-05T22:38:59.335758836Z [2024-04-05 22:38:59,335: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-05T22:38:59.432479803Z [2024-04-05 22:38:59,432: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:39:00.509728789Z [2024-04-05 22:39:00,509: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[aefacb27-51f0-49f5-980d-967777398c85] succeeded in 2.0539130800000294s: None 2024-04-05T22:39:00.513422985Z [2024-04-05 22:39:00,513: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ab9b75c4-b4fa-4158-89d9-6f395de61e8a] received 2024-04-05T22:39:00.519002450Z [2024-04-05 22:39:00,518: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7993c35b-e715-474c-ae69-1af8c22aeb08] received 2024-04-05T22:39:00.523019912Z [2024-04-05 22:39:00,522: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[193f9afa-454b-4bd9-9ef6-98ef853bc301] received 2024-04-05T22:39:00.525867870Z [2024-04-05 22:39:00,525: INFO/ForkPoolWorker-15] [ab9b75c4-b4fa-4158-89d9-6f395de61e8a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T22:39:00.536282833Z [2024-04-05 22:39:00,536: INFO/ForkPoolWorker-16] [7993c35b-e715-474c-ae69-1af8c22aeb08] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T22:39:00.659101101Z [2024-04-05 22:39:00,658: INFO/ForkPoolWorker-1] [193f9afa-454b-4bd9-9ef6-98ef853bc301] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T22:39:01.022636319Z [2024-04-05 22:39:01,018: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T22:39:01.148910018Z [2024-04-05 22:39:01,145: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T22:39:01.731916157Z [2024-04-05 22:39:01,728: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-05T22:39:01.915775031Z [2024-04-05 22:39:01,915: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-05T22:39:01.935721649Z [2024-04-05 22:39:01,922: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:39:01.978945986Z [2024-04-05 22:39:01,978: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T22:39:01.987674448Z [2024-04-05 22:39:01,986: INFO/ForkPoolWorker-15] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-05T22:39:01.988011079Z [2024-04-05 22:39:01,987: INFO/ForkPoolWorker-15] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-05T22:39:01.988125346Z [2024-04-05 22:39:01,987: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-05T22:39:01.988453977Z [2024-04-05 22:39:01,988: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-05T22:39:02.260111836Z [2024-04-05 22:39:02,259: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:39:03.258007036Z [2024-04-05 22:39:03,257: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ab9b75c4-b4fa-4158-89d9-6f395de61e8a] succeeded in 2.742410128999836s: None 2024-04-05T22:39:03.629379823Z [2024-04-05 22:39:03,629: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-05T22:39:03.632849848Z [2024-04-05 22:39:03,632: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:39:03.653296984Z [2024-04-05 22:39:03,653: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-05T22:39:03.654487098Z [2024-04-05 22:39:03,654: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:39:03.654648419Z [2024-04-05 22:39:03,654: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:39:03.654844964Z [2024-04-05 22:39:03,654: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T22:39:03.654982542Z [2024-04-05 22:39:03,654: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-05T22:39:03.655327834Z [2024-04-05 22:39:03,655: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-05T22:39:03.655479534Z [2024-04-05 22:39:03,655: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:39:03.878008730Z [2024-04-05 22:39:03,877: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:39:03.946069076Z [2024-04-05 22:39:03,945: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-05T22:39:03.952607851Z [2024-04-05 22:39:03,952: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:39:04.028103839Z [2024-04-05 22:39:04,027: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T22:39:04.030534857Z [2024-04-05 22:39:04,030: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:39:04.030594489Z [2024-04-05 22:39:04,030: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:39:04.030754612Z [2024-04-05 22:39:04,030: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T22:39:04.030806283Z [2024-04-05 22:39:04,030: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-05T22:39:04.031070240Z [2024-04-05 22:39:04,030: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T22:39:04.031118460Z [2024-04-05 22:39:04,031: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:39:04.137248942Z [2024-04-05 22:39:04,137: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:39:06.490943973Z [2024-04-05 22:39:06,490: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7993c35b-e715-474c-ae69-1af8c22aeb08] succeeded in 5.966649963000009s: None 2024-04-05T22:39:06.532657745Z [2024-04-05 22:39:06,532: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[193f9afa-454b-4bd9-9ef6-98ef853bc301] succeeded in 5.9571734250000645s: None 2024-04-05T22:39:29.209488611Z [2024-04-05 22:39:29,209: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ac7399ca-6d0b-4e05-ab1a-2817bfc3d001] received 2024-04-05T22:39:29.221931137Z [2024-04-05 22:39:29,221: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fb7ba81e-ddac-44c7-83f1-ec63680d7e2b] received 2024-04-05T22:39:29.221964987Z [2024-04-05 22:39:29,221: INFO/ForkPoolWorker-15] [ac7399ca-6d0b-4e05-ab1a-2817bfc3d001] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_731a3fa9-cb91-432b-ada3-b20941b99dab', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T22:39:29.250376291Z [2024-04-05 22:39:29,243: INFO/ForkPoolWorker-16] [fb7ba81e-ddac-44c7-83f1-ec63680d7e2b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_731a3fa9-cb91-432b-ada3-b20941b99dab', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T22:39:29.564783885Z [2024-04-05 22:39:29,561: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T22:39:29.752657110Z [2024-04-05 22:39:29,747: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T22:39:31.116844216Z [2024-04-05 22:39:31,116: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T22:39:31.120417657Z [2024-04-05 22:39:31,120: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:39:31.138947544Z [2024-04-05 22:39:31,138: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T22:39:31.140567136Z [2024-04-05 22:39:31,140: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:39:31.140925060Z [2024-04-05 22:39:31,140: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:39:31.140975575Z [2024-04-05 22:39:31,140: INFO/ForkPoolWorker-15] Read VIM 731a3fa9-cb91-432b-ada3-b20941b99dab (basic01_977501) 2024-04-05T22:39:31.141144342Z [2024-04-05 22:39:31,140: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '731a3fa9-cb91-432b-ada3-b20941b99dab', 'name': 'basic01_977501', 'vim_type': 'openstack'}] 2024-04-05T22:39:31.141240418Z [2024-04-05 22:39:31,141: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T22:39:31.141753091Z [2024-04-05 22:39:31,141: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-05T22:39:31.141791525Z [2024-04-05 22:39:31,141: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:39:31.146246405Z [2024-04-05 22:39:31,146: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_731a3fa9-cb91-432b-ada3-b20941b99dab 2024-04-05T22:39:31.214623006Z [2024-04-05 22:39:31,214: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:39:31.375977365Z [2024-04-05 22:39:31,375: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-05T22:39:31.379972552Z [2024-04-05 22:39:31,378: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:39:31.409976158Z [2024-04-05 22:39:31,409: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T22:39:31.411781321Z [2024-04-05 22:39:31,411: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:39:31.411956500Z [2024-04-05 22:39:31,411: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:39:31.412084418Z [2024-04-05 22:39:31,411: INFO/ForkPoolWorker-16] Read VIM 731a3fa9-cb91-432b-ada3-b20941b99dab (basic01_977501) 2024-04-05T22:39:31.412317302Z [2024-04-05 22:39:31,412: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '731a3fa9-cb91-432b-ada3-b20941b99dab', 'name': 'basic01_977501', 'vim_type': 'openstack'}] 2024-04-05T22:39:31.412441033Z [2024-04-05 22:39:31,412: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-05T22:39:31.412765861Z [2024-04-05 22:39:31,412: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T22:39:31.413239193Z [2024-04-05 22:39:31,413: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:39:31.419448585Z [2024-04-05 22:39:31,419: INFO/ForkPoolWorker-16] Creating DAG vim_status_731a3fa9-cb91-432b-ada3-b20941b99dab 2024-04-05T22:39:31.513358623Z [2024-04-05 22:39:31,513: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:39:33.020553568Z [2024-04-05 22:39:33,020: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ac7399ca-6d0b-4e05-ab1a-2817bfc3d001] succeeded in 3.807039222999947s: None 2024-04-05T22:39:33.140347075Z [2024-04-05 22:39:33,139: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[fb7ba81e-ddac-44c7-83f1-ec63680d7e2b] succeeded in 3.9159444819999862s: None 2024-04-05T22:39:39.213587018Z [2024-04-05 22:39:39,213: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[45546287-6c23-40d4-8468-68c347e905e9] received 2024-04-05T22:39:39.230790491Z [2024-04-05 22:39:39,230: INFO/ForkPoolWorker-15] [45546287-6c23-40d4-8468-68c347e905e9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_731a3fa9-cb91-432b-ada3-b20941b99dab', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T22:39:39.606868593Z [2024-04-05 22:39:39,603: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T22:39:40.866051166Z [2024-04-05 22:39:40,865: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T22:39:40.870126095Z [2024-04-05 22:39:40,869: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:39:40.901822637Z [2024-04-05 22:39:40,901: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T22:39:40.903214378Z [2024-04-05 22:39:40,903: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:39:40.903466252Z [2024-04-05 22:39:40,903: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:39:40.903689714Z [2024-04-05 22:39:40,903: INFO/ForkPoolWorker-15] Read VIM 731a3fa9-cb91-432b-ada3-b20941b99dab (basic01_977501) 2024-04-05T22:39:40.903865632Z [2024-04-05 22:39:40,903: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '731a3fa9-cb91-432b-ada3-b20941b99dab', 'name': 'basic01_977501', 'vim_type': 'openstack'}] 2024-04-05T22:39:40.903929274Z [2024-04-05 22:39:40,903: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T22:39:40.904239121Z [2024-04-05 22:39:40,904: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T22:39:40.904307913Z [2024-04-05 22:39:40,904: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:39:40.910009869Z [2024-04-05 22:39:40,909: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_731a3fa9-cb91-432b-ada3-b20941b99dab 2024-04-05T22:39:40.993172723Z [2024-04-05 22:39:40,992: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:39:41.583852091Z [2024-04-05 22:39:41,583: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[45546287-6c23-40d4-8468-68c347e905e9] succeeded in 2.3628887709999162s: None 2024-04-05T22:39:42.159165954Z [2024-04-05 22:39:42,158: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7ac2bf05-281a-409a-b69e-2ce1ba1749ab] received 2024-04-05T22:39:42.169506559Z [2024-04-05 22:39:42,169: INFO/ForkPoolWorker-15] [7ac2bf05-281a-409a-b69e-2ce1ba1749ab] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_731a3fa9-cb91-432b-ada3-b20941b99dab', 'split_metrics', 'scheduled__2024-04-05T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T22:39:42.450613044Z [2024-04-05 22:39:42,447: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T22:39:43.622625068Z [2024-04-05 22:39:43,621: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T22:39:43.626018995Z [2024-04-05 22:39:43,625: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:39:43.653223174Z [2024-04-05 22:39:43,653: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T22:39:43.656507810Z [2024-04-05 22:39:43,656: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:39:43.657356521Z [2024-04-05 22:39:43,657: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:39:43.659511655Z [2024-04-05 22:39:43,659: INFO/ForkPoolWorker-15] Read VIM 731a3fa9-cb91-432b-ada3-b20941b99dab (basic01_977501) 2024-04-05T22:39:43.659745183Z [2024-04-05 22:39:43,659: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '731a3fa9-cb91-432b-ada3-b20941b99dab', 'name': 'basic01_977501', 'vim_type': 'openstack'}] 2024-04-05T22:39:43.659846097Z [2024-04-05 22:39:43,659: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T22:39:43.660378103Z [2024-04-05 22:39:43,660: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T22:39:43.660487322Z [2024-04-05 22:39:43,660: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:39:43.667798775Z [2024-04-05 22:39:43,667: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_731a3fa9-cb91-432b-ada3-b20941b99dab 2024-04-05T22:39:43.804369338Z [2024-04-05 22:39:43,802: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:39:44.579190816Z [2024-04-05 22:39:44,578: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7ac2bf05-281a-409a-b69e-2ce1ba1749ab] succeeded in 2.417826894999962s: None 2024-04-05T22:39:44.656742203Z [2024-04-05 22:39:44,656: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8e1f2137-4690-47c6-b77e-937b81baa512] received 2024-04-05T22:39:44.671210054Z [2024-04-05 22:39:44,670: INFO/ForkPoolWorker-15] [8e1f2137-4690-47c6-b77e-937b81baa512] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_731a3fa9-cb91-432b-ada3-b20941b99dab', 'collect_metrics', 'scheduled__2024-04-05T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T22:39:44.958858111Z [2024-04-05 22:39:44,955: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T22:39:46.113693837Z [2024-04-05 22:39:46,113: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T22:39:46.117239066Z [2024-04-05 22:39:46,116: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:39:46.141939751Z [2024-04-05 22:39:46,141: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T22:39:46.143684856Z [2024-04-05 22:39:46,143: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:39:46.143853668Z [2024-04-05 22:39:46,143: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:39:46.144005923Z [2024-04-05 22:39:46,143: INFO/ForkPoolWorker-15] Read VIM 731a3fa9-cb91-432b-ada3-b20941b99dab (basic01_977501) 2024-04-05T22:39:46.144236796Z [2024-04-05 22:39:46,144: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '731a3fa9-cb91-432b-ada3-b20941b99dab', 'name': 'basic01_977501', 'vim_type': 'openstack'}] 2024-04-05T22:39:46.144385844Z [2024-04-05 22:39:46,144: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T22:39:46.144780965Z [2024-04-05 22:39:46,144: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T22:39:46.144939183Z [2024-04-05 22:39:46,144: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:39:46.150399704Z [2024-04-05 22:39:46,150: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_731a3fa9-cb91-432b-ada3-b20941b99dab 2024-04-05T22:39:46.215556048Z [2024-04-05 22:39:46,215: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:39:46.813137284Z [2024-04-05 22:39:46,812: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8e1f2137-4690-47c6-b77e-937b81baa512] succeeded in 2.1525485450001725s: None 2024-04-05T22:39:47.035745809Z [2024-04-05 22:39:47,035: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fe0a1f01-1077-4d3c-8d7c-f2286c240b22] received 2024-04-05T22:39:47.047785192Z [2024-04-05 22:39:47,047: INFO/ForkPoolWorker-15] [fe0a1f01-1077-4d3c-8d7c-f2286c240b22] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_731a3fa9-cb91-432b-ada3-b20941b99dab', 'send_prometheus', 'scheduled__2024-04-05T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T22:39:47.352023611Z [2024-04-05 22:39:47,349: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T22:39:48.492402116Z [2024-04-05 22:39:48,492: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T22:39:48.495749204Z [2024-04-05 22:39:48,495: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:39:48.519125600Z [2024-04-05 22:39:48,518: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T22:39:48.520899254Z [2024-04-05 22:39:48,520: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:39:48.520935609Z [2024-04-05 22:39:48,520: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:39:48.521091822Z [2024-04-05 22:39:48,520: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T22:39:48.521376515Z [2024-04-05 22:39:48,521: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T22:39:48.521788786Z [2024-04-05 22:39:48,521: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T22:39:48.521844733Z [2024-04-05 22:39:48,521: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:39:48.533544415Z [2024-04-05 22:39:48,533: WARNING/ForkPoolWorker-15] Dag 'vm_metrics_vim_731a3fa9-cb91-432b-ada3-b20941b99dab' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T22:39:48.534237786Z [2024-04-05 22:39:48,533: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T22:39:48.535170353Z [2024-04-05 22:39:48,535: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T22:39:48.537786129Z [2024-04-05 22:39:48,537: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:39:48.577285564Z [2024-04-05 22:39:48,577: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T22:39:48.588038760Z [2024-04-05 22:39:48,587: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:39:48.594151563Z [2024-04-05 22:39:48,587: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:39:48.594432255Z [2024-04-05 22:39:48,594: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T22:39:48.594557124Z [2024-04-05 22:39:48,594: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T22:39:48.595540976Z [2024-04-05 22:39:48,594: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T22:39:48.595696600Z [2024-04-05 22:39:48,595: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:39:48.603873151Z [2024-04-05 22:39:48,602: ERROR/ForkPoolWorker-15] [fe0a1f01-1077-4d3c-8d7c-f2286c240b22] Failed to execute task Dag 'vm_metrics_vim_731a3fa9-cb91-432b-ada3-b20941b99dab' could not be found; either it does not exist or it failed to parse.. 2024-04-05T22:39:48.603884602Z Traceback (most recent call last): 2024-04-05T22:39:48.603888610Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-05T22:39:48.603892457Z args.func(args) 2024-04-05T22:39:48.603896237Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-05T22:39:48.603900352Z return func(*args, **kwargs) 2024-04-05T22:39:48.603912786Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-05T22:39:48.603916365Z return f(*args, **kwargs) 2024-04-05T22:39:48.603919543Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-05T22:39:48.603922621Z dag = get_dag(args.subdir, args.dag_id) 2024-04-05T22:39:48.603925887Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-05T22:39:48.603929380Z raise AirflowException( 2024-04-05T22:39:48.603933207Z airflow.exceptions.AirflowException: Dag 'vm_metrics_vim_731a3fa9-cb91-432b-ada3-b20941b99dab' could not be found; either it does not exist or it failed to parse. 2024-04-05T22:39:48.643322873Z [2024-04-05 22:39:48,642: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fe0a1f01-1077-4d3c-8d7c-f2286c240b22] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id fe0a1f01-1077-4d3c-8d7c-f2286c240b22') 2024-04-05T22:39:48.643343115Z Traceback (most recent call last): 2024-04-05T22:39:48.643349752Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-05T22:39:48.643355455Z R = retval = fun(*args, **kwargs) 2024-04-05T22:39:48.643361163Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-05T22:39:48.643372889Z return self.run(*args, **kwargs) 2024-04-05T22:39:48.643379462Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-05T22:39:48.643386254Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-05T22:39:48.643391914Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-05T22:39:48.643404573Z raise AirflowException(msg) 2024-04-05T22:39:48.643411199Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id fe0a1f01-1077-4d3c-8d7c-f2286c240b22 2024-04-05T22:39:59.592131032Z [2024-04-05 22:39:59,591: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[55d27399-59bb-402e-be93-f6b899e2e3d0] received 2024-04-05T22:39:59.610778056Z [2024-04-05 22:39:59,610: INFO/ForkPoolWorker-15] [55d27399-59bb-402e-be93-f6b899e2e3d0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_731a3fa9-cb91-432b-ada3-b20941b99dab', 'send_prometheus', 'scheduled__2024-04-05T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T22:39:59.968771909Z [2024-04-05 22:39:59,965: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T22:40:01.212574110Z [2024-04-05 22:40:01,212: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eaf38502-d693-477e-b3d0-618d59a731db] received 2024-04-05T22:40:01.216454728Z [2024-04-05 22:40:01,216: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1f185e02-5803-4ced-89e7-3e2ddb61ab09] received 2024-04-05T22:40:01.226649600Z [2024-04-05 22:40:01,226: INFO/ForkPoolWorker-16] [eaf38502-d693-477e-b3d0-618d59a731db] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_731a3fa9-cb91-432b-ada3-b20941b99dab', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T22:40:01.234342201Z [2024-04-05 22:40:01,234: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[37709908-2ffd-4217-a710-a605395a4545] received 2024-04-05T22:40:01.242291327Z [2024-04-05 22:40:01,242: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d1b9e78d-14aa-44e3-a261-829ca0a47b5a] received 2024-04-05T22:40:01.249732120Z [2024-04-05 22:40:01,249: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3bbab3db-6fb8-443b-9092-204c26ad256d] received 2024-04-05T22:40:01.264078846Z [2024-04-05 22:40:01,263: INFO/ForkPoolWorker-1] [1f185e02-5803-4ced-89e7-3e2ddb61ab09] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T22:40:01.296736795Z [2024-04-05 22:40:01,296: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ce56213c-1ec6-4ad1-a9a8-1fe2ad0fc1f4] received 2024-04-05T22:40:01.308893720Z [2024-04-05 22:40:01,308: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[72ba8892-bf07-4003-be29-a85390e5a459] received 2024-04-05T22:40:01.311548631Z [2024-04-05 22:40:01,311: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e895b3e1-3be5-4cc8-b277-3bfde6699fb4] received 2024-04-05T22:40:01.321015422Z [2024-04-05 22:40:01,320: INFO/ForkPoolWorker-2] [37709908-2ffd-4217-a710-a605395a4545] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_731a3fa9-cb91-432b-ada3-b20941b99dab', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T22:40:01.349590853Z [2024-04-05 22:40:01,349: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6a0d026b-abe5-47a0-82be-2c3364b0ca87] received 2024-04-05T22:40:01.377522320Z [2024-04-05 22:40:01,377: INFO/ForkPoolWorker-3] [d1b9e78d-14aa-44e3-a261-829ca0a47b5a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T22:40:01.404153170Z [2024-04-05 22:40:01,403: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[621b1066-e887-4453-8a53-e63b1b88cf30] received 2024-04-05T22:40:01.434631896Z [2024-04-05 22:40:01,434: INFO/ForkPoolWorker-5] [ce56213c-1ec6-4ad1-a9a8-1fe2ad0fc1f4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_794b19d9-5bf5-4602-8775-af4c7438009c', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T22:40:01.451759985Z [2024-04-05 22:40:01,440: INFO/ForkPoolWorker-7] [e895b3e1-3be5-4cc8-b277-3bfde6699fb4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T22:40:01.481754273Z [2024-04-05 22:40:01,481: INFO/ForkPoolWorker-6] [72ba8892-bf07-4003-be29-a85390e5a459] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_731a3fa9-cb91-432b-ada3-b20941b99dab', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T22:40:01.576928410Z [2024-04-05 22:40:01,576: INFO/ForkPoolWorker-4] [3bbab3db-6fb8-443b-9092-204c26ad256d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T22:40:01.611354673Z [2024-04-05 22:40:01,610: INFO/ForkPoolWorker-8] [6a0d026b-abe5-47a0-82be-2c3364b0ca87] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T22:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T22:40:01.685298667Z [2024-04-05 22:40:01,684: INFO/ForkPoolWorker-9] [621b1066-e887-4453-8a53-e63b1b88cf30] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_794b19d9-5bf5-4602-8775-af4c7438009c', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T22:40:02.318710585Z [2024-04-05 22:40:02,315: INFO/ForkPoolWorker-8] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-05T22:40:02.725172238Z [2024-04-05 22:40:02,721: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-05T22:40:02.828466725Z [2024-04-05 22:40:02,824: INFO/ForkPoolWorker-5] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T22:40:02.969791773Z [2024-04-05 22:40:02,969: INFO/ForkPoolWorker-3] Getting SDNC list 2024-04-05T22:40:02.975655430Z [2024-04-05 22:40:02,975: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:40:03.090310690Z [2024-04-05 22:40:03,089: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T22:40:03.093926185Z [2024-04-05 22:40:03,093: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:40:03.098688313Z [2024-04-05 22:40:03,098: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-05T22:40:03.114174993Z [2024-04-05 22:40:03,113: INFO/ForkPoolWorker-3] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-05T22:40:03.114609929Z [2024-04-05 22:40:03,114: INFO/ForkPoolWorker-3] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-05T22:40:03.114756417Z [2024-04-05 22:40:03,114: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-04-05T22:40:03.116668985Z [2024-04-05 22:40:03,116: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-05T22:40:03.285375032Z [2024-04-05 22:40:03,285: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T22:40:03.293110152Z [2024-04-05 22:40:03,292: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:40:03.294385377Z [2024-04-05 22:40:03,294: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:40:03.295614163Z [2024-04-05 22:40:03,295: INFO/ForkPoolWorker-15] Read VIM 794b19d9-5bf5-4602-8775-af4c7438009c (basic01_753257) 2024-04-05T22:40:03.295951330Z [2024-04-05 22:40:03,295: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '794b19d9-5bf5-4602-8775-af4c7438009c', 'name': 'basic01_753257', 'vim_type': 'openstack'}] 2024-04-05T22:40:03.296603374Z [2024-04-05 22:40:03,296: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T22:40:03.297021845Z [2024-04-05 22:40:03,296: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T22:40:03.298086389Z [2024-04-05 22:40:03,297: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:40:03.310482526Z [2024-04-05 22:40:03,310: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:40:03.330438145Z [2024-04-05 22:40:03,330: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_794b19d9-5bf5-4602-8775-af4c7438009c 2024-04-05T22:40:03.417493222Z [2024-04-05 22:40:03,417: WARNING/ForkPoolWorker-15] Dag 'vm_metrics_vim_731a3fa9-cb91-432b-ada3-b20941b99dab' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T22:40:03.429661598Z [2024-04-05 22:40:03,417: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T22:40:03.430750779Z [2024-04-05 22:40:03,430: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T22:40:03.433752946Z [2024-04-05 22:40:03,433: INFO/ForkPoolWorker-8] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:40:03.434729652Z [2024-04-05 22:40:03,428: INFO/ForkPoolWorker-9] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T22:40:03.471574349Z [2024-04-05 22:40:03,450: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:40:03.508693743Z [2024-04-05 22:40:03,480: INFO/ForkPoolWorker-6] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T22:40:03.576029039Z [2024-04-05 22:40:03,575: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T22:40:03.580618206Z [2024-04-05 22:40:03,580: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:40:03.580669158Z [2024-04-05 22:40:03,580: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:40:03.580686482Z [2024-04-05 22:40:03,580: INFO/ForkPoolWorker-15] Read VIM 794b19d9-5bf5-4602-8775-af4c7438009c (basic01_753257) 2024-04-05T22:40:03.580791281Z [2024-04-05 22:40:03,580: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '794b19d9-5bf5-4602-8775-af4c7438009c', 'name': 'basic01_753257', 'vim_type': 'openstack'}] 2024-04-05T22:40:03.580824557Z [2024-04-05 22:40:03,580: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T22:40:03.581058281Z [2024-04-05 22:40:03,580: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T22:40:03.581067343Z [2024-04-05 22:40:03,580: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:40:03.587016111Z [2024-04-05 22:40:03,586: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_794b19d9-5bf5-4602-8775-af4c7438009c 2024-04-05T22:40:03.634720173Z [2024-04-05 22:40:03,627: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T22:40:03.643407606Z [2024-04-05 22:40:03,642: ERROR/ForkPoolWorker-15] [55d27399-59bb-402e-be93-f6b899e2e3d0] Failed to execute task Dag 'vm_metrics_vim_731a3fa9-cb91-432b-ada3-b20941b99dab' could not be found; either it does not exist or it failed to parse.. 2024-04-05T22:40:03.643433813Z Traceback (most recent call last): 2024-04-05T22:40:03.643438529Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-05T22:40:03.643442655Z args.func(args) 2024-04-05T22:40:03.643446825Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-05T22:40:03.643450771Z return func(*args, **kwargs) 2024-04-05T22:40:03.643453900Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-05T22:40:03.643457753Z return f(*args, **kwargs) 2024-04-05T22:40:03.643460801Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-05T22:40:03.643464065Z dag = get_dag(args.subdir, args.dag_id) 2024-04-05T22:40:03.643467533Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-05T22:40:03.643470844Z raise AirflowException( 2024-04-05T22:40:03.643474710Z airflow.exceptions.AirflowException: Dag 'vm_metrics_vim_731a3fa9-cb91-432b-ada3-b20941b99dab' could not be found; either it does not exist or it failed to parse. 2024-04-05T22:40:03.731570623Z [2024-04-05 22:40:03,674: INFO/ForkPoolWorker-7] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T22:40:03.732782086Z [2024-04-05 22:40:03,732: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[55d27399-59bb-402e-be93-f6b899e2e3d0] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 55d27399-59bb-402e-be93-f6b899e2e3d0') 2024-04-05T22:40:03.732796037Z Traceback (most recent call last): 2024-04-05T22:40:03.732800397Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-05T22:40:03.732803951Z R = retval = fun(*args, **kwargs) 2024-04-05T22:40:03.732807002Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-05T22:40:03.732826461Z return self.run(*args, **kwargs) 2024-04-05T22:40:03.732835420Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-05T22:40:03.732839644Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-05T22:40:03.732842689Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-05T22:40:03.732846441Z raise AirflowException(msg) 2024-04-05T22:40:03.732850342Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 55d27399-59bb-402e-be93-f6b899e2e3d0 2024-04-05T22:40:03.821480511Z [2024-04-05 22:40:03,769: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T22:40:03.885745351Z [2024-04-05 22:40:03,881: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T22:40:04.587932248Z [2024-04-05 22:40:04,434: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T22:40:05.241405014Z [2024-04-05 22:40:05,240: INFO/ForkPoolWorker-8] Task airflow.executors.celery_executor.execute_command[6a0d026b-abe5-47a0-82be-2c3364b0ca87] succeeded in 3.8797331819998817s: None 2024-04-05T22:40:05.288948113Z [2024-04-05 22:40:05,288: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[d1b9e78d-14aa-44e3-a261-829ca0a47b5a] succeeded in 4.04174333900005s: None 2024-04-05T22:40:06.473595252Z [2024-04-05 22:40:06,473: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-05T22:40:06.476969144Z [2024-04-05 22:40:06,476: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:40:06.568345123Z [2024-04-05 22:40:06,568: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-05T22:40:06.570019669Z [2024-04-05 22:40:06,569: INFO/ForkPoolWorker-2] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:40:06.570060782Z [2024-04-05 22:40:06,569: INFO/ForkPoolWorker-2] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:40:06.570152870Z [2024-04-05 22:40:06,570: INFO/ForkPoolWorker-2] Read VIM 794b19d9-5bf5-4602-8775-af4c7438009c (basic01_753257) 2024-04-05T22:40:06.570338207Z [2024-04-05 22:40:06,570: INFO/ForkPoolWorker-2] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '794b19d9-5bf5-4602-8775-af4c7438009c', 'name': 'basic01_753257', 'vim_type': 'openstack'}] 2024-04-05T22:40:06.570363321Z [2024-04-05 22:40:06,570: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-05T22:40:06.570632003Z [2024-04-05 22:40:06,570: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-05T22:40:06.570728618Z [2024-04-05 22:40:06,570: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:40:06.577056461Z [2024-04-05 22:40:06,576: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_794b19d9-5bf5-4602-8775-af4c7438009c 2024-04-05T22:40:06.581675828Z [2024-04-05 22:40:06,581: WARNING/ForkPoolWorker-2] Dag 'vm_status_vim_731a3fa9-cb91-432b-ada3-b20941b99dab' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T22:40:06.585826504Z [2024-04-05 22:40:06,583: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T22:40:06.586741385Z [2024-04-05 22:40:06,586: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-05T22:40:06.594433208Z [2024-04-05 22:40:06,594: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:40:06.650221772Z [2024-04-05 22:40:06,650: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-05T22:40:06.656651099Z [2024-04-05 22:40:06,656: INFO/ForkPoolWorker-2] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:40:06.656697834Z [2024-04-05 22:40:06,656: INFO/ForkPoolWorker-2] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:40:06.656868532Z [2024-04-05 22:40:06,656: INFO/ForkPoolWorker-2] Read VIM 794b19d9-5bf5-4602-8775-af4c7438009c (basic01_753257) 2024-04-05T22:40:06.657270044Z [2024-04-05 22:40:06,656: INFO/ForkPoolWorker-2] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '794b19d9-5bf5-4602-8775-af4c7438009c', 'name': 'basic01_753257', 'vim_type': 'openstack'}] 2024-04-05T22:40:06.657435529Z [2024-04-05 22:40:06,657: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-05T22:40:06.657732228Z [2024-04-05 22:40:06,657: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-05T22:40:06.657862746Z [2024-04-05 22:40:06,657: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:40:06.660007402Z [2024-04-05 22:40:06,659: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_794b19d9-5bf5-4602-8775-af4c7438009c 2024-04-05T22:40:06.663740436Z [2024-04-05 22:40:06,663: ERROR/ForkPoolWorker-2] [37709908-2ffd-4217-a710-a605395a4545] Failed to execute task Dag 'vm_status_vim_731a3fa9-cb91-432b-ada3-b20941b99dab' could not be found; either it does not exist or it failed to parse.. 2024-04-05T22:40:06.663761025Z Traceback (most recent call last): 2024-04-05T22:40:06.663765621Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-05T22:40:06.663770521Z args.func(args) 2024-04-05T22:40:06.663774384Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-05T22:40:06.663778495Z return func(*args, **kwargs) 2024-04-05T22:40:06.663781638Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-05T22:40:06.663784836Z return f(*args, **kwargs) 2024-04-05T22:40:06.663787967Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-05T22:40:06.663790944Z dag = get_dag(args.subdir, args.dag_id) 2024-04-05T22:40:06.663794483Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-05T22:40:06.663797584Z raise AirflowException( 2024-04-05T22:40:06.663801577Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_731a3fa9-cb91-432b-ada3-b20941b99dab' could not be found; either it does not exist or it failed to parse. 2024-04-05T22:40:06.732525098Z [2024-04-05 22:40:06,731: ERROR/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[37709908-2ffd-4217-a710-a605395a4545] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 37709908-2ffd-4217-a710-a605395a4545') 2024-04-05T22:40:06.732561142Z Traceback (most recent call last): 2024-04-05T22:40:06.732565586Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-05T22:40:06.732568888Z R = retval = fun(*args, **kwargs) 2024-04-05T22:40:06.732572170Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-05T22:40:06.732575139Z return self.run(*args, **kwargs) 2024-04-05T22:40:06.732578836Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-05T22:40:06.732582465Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-05T22:40:06.732585650Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-05T22:40:06.732589347Z raise AirflowException(msg) 2024-04-05T22:40:06.732593070Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 37709908-2ffd-4217-a710-a605395a4545 2024-04-05T22:40:07.101755876Z [2024-04-05 22:40:07,101: INFO/ForkPoolWorker-7] Getting VIM list 2024-04-05T22:40:07.104908383Z [2024-04-05 22:40:07,104: INFO/ForkPoolWorker-7] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:40:07.130476920Z [2024-04-05 22:40:07,130: INFO/ForkPoolWorker-7] Connected to database osm version 1.2 2024-04-05T22:40:07.155152440Z [2024-04-05 22:40:07,154: INFO/ForkPoolWorker-7] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:40:07.156348760Z [2024-04-05 22:40:07,155: INFO/ForkPoolWorker-7] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:40:07.156485432Z [2024-04-05 22:40:07,156: INFO/ForkPoolWorker-7] Read VIM 794b19d9-5bf5-4602-8775-af4c7438009c (basic01_753257) 2024-04-05T22:40:07.156705806Z [2024-04-05 22:40:07,156: INFO/ForkPoolWorker-7] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '794b19d9-5bf5-4602-8775-af4c7438009c', 'name': 'basic01_753257', 'vim_type': 'openstack'}] 2024-04-05T22:40:07.156835357Z [2024-04-05 22:40:07,156: INFO/ForkPoolWorker-7] Getting VIM list OK 2024-04-05T22:40:07.157177593Z [2024-04-05 22:40:07,157: INFO/ForkPoolWorker-7] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T22:40:07.157275524Z [2024-04-05 22:40:07,157: INFO/ForkPoolWorker-7] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:40:07.165589889Z [2024-04-05 22:40:07,165: INFO/ForkPoolWorker-7] Creating DAG vm_metrics_vim_794b19d9-5bf5-4602-8775-af4c7438009c 2024-04-05T22:40:07.275191289Z [2024-04-05 22:40:07,274: INFO/ForkPoolWorker-5] Getting VIM list 2024-04-05T22:40:07.278782489Z [2024-04-05 22:40:07,278: INFO/ForkPoolWorker-5] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:40:07.279242481Z [2024-04-05 22:40:07,278: INFO/ForkPoolWorker-9] Getting VIM list 2024-04-05T22:40:07.283421605Z [2024-04-05 22:40:07,282: INFO/ForkPoolWorker-9] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:40:07.320062209Z [2024-04-05 22:40:07,319: INFO/ForkPoolWorker-9] Connected to database osm version 1.2 2024-04-05T22:40:07.322110263Z [2024-04-05 22:40:07,321: INFO/ForkPoolWorker-9] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:40:07.322121535Z [2024-04-05 22:40:07,322: INFO/ForkPoolWorker-9] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:40:07.322417326Z [2024-04-05 22:40:07,322: INFO/ForkPoolWorker-9] Read VIM 794b19d9-5bf5-4602-8775-af4c7438009c (basic01_753257) 2024-04-05T22:40:07.322633544Z [2024-04-05 22:40:07,322: INFO/ForkPoolWorker-9] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '794b19d9-5bf5-4602-8775-af4c7438009c', 'name': 'basic01_753257', 'vim_type': 'openstack'}] 2024-04-05T22:40:07.322670102Z [2024-04-05 22:40:07,322: INFO/ForkPoolWorker-9] Getting VIM list OK 2024-04-05T22:40:07.323241145Z [2024-04-05 22:40:07,323: INFO/ForkPoolWorker-9] VIM type 'dummy' not supported for collecting VM status 2024-04-05T22:40:07.336167351Z [2024-04-05 22:40:07,335: INFO/ForkPoolWorker-5] Connected to database osm version 1.2 2024-04-05T22:40:07.339472183Z [2024-04-05 22:40:07,323: INFO/ForkPoolWorker-9] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:40:07.340413222Z [2024-04-05 22:40:07,340: INFO/ForkPoolWorker-5] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:40:07.340475319Z [2024-04-05 22:40:07,340: INFO/ForkPoolWorker-5] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:40:07.340543549Z [2024-04-05 22:40:07,340: INFO/ForkPoolWorker-5] Read VIM 794b19d9-5bf5-4602-8775-af4c7438009c (basic01_753257) 2024-04-05T22:40:07.340685202Z [2024-04-05 22:40:07,340: INFO/ForkPoolWorker-5] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '794b19d9-5bf5-4602-8775-af4c7438009c', 'name': 'basic01_753257', 'vim_type': 'openstack'}] 2024-04-05T22:40:07.340742503Z [2024-04-05 22:40:07,340: INFO/ForkPoolWorker-5] Getting VIM list OK 2024-04-05T22:40:07.341001968Z [2024-04-05 22:40:07,340: INFO/ForkPoolWorker-5] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T22:40:07.341058898Z [2024-04-05 22:40:07,340: INFO/ForkPoolWorker-5] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:40:07.345838792Z [2024-04-05 22:40:07,345: INFO/ForkPoolWorker-5] Creating DAG vim_status_794b19d9-5bf5-4602-8775-af4c7438009c 2024-04-05T22:40:07.350334349Z [2024-04-05 22:40:07,349: INFO/ForkPoolWorker-9] Creating DAG vm_status_vim_794b19d9-5bf5-4602-8775-af4c7438009c 2024-04-05T22:40:07.356545729Z [2024-04-05 22:40:07,356: INFO/ForkPoolWorker-7] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:40:07.470090991Z [2024-04-05 22:40:07,469: INFO/ForkPoolWorker-9] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:40:07.470674281Z [2024-04-05 22:40:07,470: INFO/ForkPoolWorker-5] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:40:07.522214056Z [2024-04-05 22:40:07,521: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-05T22:40:07.525931298Z [2024-04-05 22:40:07,525: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:40:07.573484266Z [2024-04-05 22:40:07,572: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-05T22:40:07.576286837Z [2024-04-05 22:40:07,576: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:40:07.576511714Z [2024-04-05 22:40:07,576: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:40:07.576824323Z [2024-04-05 22:40:07,576: INFO/ForkPoolWorker-1] Read VIM 794b19d9-5bf5-4602-8775-af4c7438009c (basic01_753257) 2024-04-05T22:40:07.576991249Z [2024-04-05 22:40:07,576: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '794b19d9-5bf5-4602-8775-af4c7438009c', 'name': 'basic01_753257', 'vim_type': 'openstack'}] 2024-04-05T22:40:07.577052889Z [2024-04-05 22:40:07,576: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-05T22:40:07.577319927Z [2024-04-05 22:40:07,577: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T22:40:07.577394920Z [2024-04-05 22:40:07,577: INFO/ForkPoolWorker-1] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:40:07.582129125Z [2024-04-05 22:40:07,581: INFO/ForkPoolWorker-1] Creating DAG vim_status_794b19d9-5bf5-4602-8775-af4c7438009c 2024-04-05T22:40:07.765761749Z [2024-04-05 22:40:07,765: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:40:07.928367969Z [2024-04-05 22:40:07,924: INFO/ForkPoolWorker-4] Getting VIM list 2024-04-05T22:40:07.935604744Z [2024-04-05 22:40:07,931: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:40:07.978453422Z [2024-04-05 22:40:07,976: INFO/ForkPoolWorker-4] Connected to database osm version 1.2 2024-04-05T22:40:07.980888209Z [2024-04-05 22:40:07,980: INFO/ForkPoolWorker-4] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:40:07.980993562Z [2024-04-05 22:40:07,980: INFO/ForkPoolWorker-4] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:40:07.981066071Z [2024-04-05 22:40:07,980: INFO/ForkPoolWorker-4] Read VIM 794b19d9-5bf5-4602-8775-af4c7438009c (basic01_753257) 2024-04-05T22:40:07.981231944Z [2024-04-05 22:40:07,981: INFO/ForkPoolWorker-4] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '794b19d9-5bf5-4602-8775-af4c7438009c', 'name': 'basic01_753257', 'vim_type': 'openstack'}] 2024-04-05T22:40:07.981292502Z [2024-04-05 22:40:07,981: INFO/ForkPoolWorker-4] Getting VIM list OK 2024-04-05T22:40:07.981556999Z [2024-04-05 22:40:07,981: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for collecting VM status 2024-04-05T22:40:07.981852614Z [2024-04-05 22:40:07,981: INFO/ForkPoolWorker-4] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:40:07.986615606Z [2024-04-05 22:40:07,986: INFO/ForkPoolWorker-4] Creating DAG vm_status_vim_794b19d9-5bf5-4602-8775-af4c7438009c 2024-04-05T22:40:08.003441566Z [2024-04-05 22:40:07,999: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-05T22:40:08.024202712Z [2024-04-05 22:40:08,023: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:40:08.163722368Z [2024-04-05 22:40:08,163: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T22:40:08.164911415Z [2024-04-05 22:40:08,164: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:40:08.164922952Z [2024-04-05 22:40:08,164: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:40:08.165005392Z [2024-04-05 22:40:08,164: INFO/ForkPoolWorker-16] Read VIM 794b19d9-5bf5-4602-8775-af4c7438009c (basic01_753257) 2024-04-05T22:40:08.165166539Z [2024-04-05 22:40:08,164: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '794b19d9-5bf5-4602-8775-af4c7438009c', 'name': 'basic01_753257', 'vim_type': 'openstack'}] 2024-04-05T22:40:08.165225170Z [2024-04-05 22:40:08,165: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-05T22:40:08.165465738Z [2024-04-05 22:40:08,165: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T22:40:08.165514012Z [2024-04-05 22:40:08,165: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:40:08.174536234Z [2024-04-05 22:40:08,174: INFO/ForkPoolWorker-16] Creating DAG vim_status_794b19d9-5bf5-4602-8775-af4c7438009c 2024-04-05T22:40:08.178691087Z [2024-04-05 22:40:08,178: WARNING/ForkPoolWorker-16] Dag 'vim_status_731a3fa9-cb91-432b-ada3-b20941b99dab' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T22:40:08.182430963Z [2024-04-05 22:40:08,181: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T22:40:08.184337739Z [2024-04-05 22:40:08,183: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-05T22:40:08.187020304Z [2024-04-05 22:40:08,186: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:40:08.188555692Z [2024-04-05 22:40:08,188: INFO/ForkPoolWorker-4] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:40:08.235058960Z [2024-04-05 22:40:08,234: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T22:40:08.237999745Z [2024-04-05 22:40:08,237: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:40:08.238050204Z [2024-04-05 22:40:08,237: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:40:08.238297793Z [2024-04-05 22:40:08,238: INFO/ForkPoolWorker-16] Read VIM 794b19d9-5bf5-4602-8775-af4c7438009c (basic01_753257) 2024-04-05T22:40:08.238568962Z [2024-04-05 22:40:08,238: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '794b19d9-5bf5-4602-8775-af4c7438009c', 'name': 'basic01_753257', 'vim_type': 'openstack'}] 2024-04-05T22:40:08.238601526Z [2024-04-05 22:40:08,238: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-05T22:40:08.242863942Z [2024-04-05 22:40:08,239: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T22:40:08.242877443Z [2024-04-05 22:40:08,239: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:40:08.244799123Z [2024-04-05 22:40:08,244: INFO/ForkPoolWorker-16] Creating DAG vim_status_794b19d9-5bf5-4602-8775-af4c7438009c 2024-04-05T22:40:08.249063376Z [2024-04-05 22:40:08,248: ERROR/ForkPoolWorker-16] [eaf38502-d693-477e-b3d0-618d59a731db] Failed to execute task Dag 'vim_status_731a3fa9-cb91-432b-ada3-b20941b99dab' could not be found; either it does not exist or it failed to parse.. 2024-04-05T22:40:08.249086513Z Traceback (most recent call last): 2024-04-05T22:40:08.249091605Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-05T22:40:08.249095906Z args.func(args) 2024-04-05T22:40:08.249100127Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-05T22:40:08.249104210Z return func(*args, **kwargs) 2024-04-05T22:40:08.249112666Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-05T22:40:08.249116132Z return f(*args, **kwargs) 2024-04-05T22:40:08.249119268Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-05T22:40:08.249122418Z dag = get_dag(args.subdir, args.dag_id) 2024-04-05T22:40:08.249126066Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-05T22:40:08.249130548Z raise AirflowException( 2024-04-05T22:40:08.249136683Z airflow.exceptions.AirflowException: Dag 'vim_status_731a3fa9-cb91-432b-ada3-b20941b99dab' could not be found; either it does not exist or it failed to parse. 2024-04-05T22:40:08.437031846Z [2024-04-05 22:40:08,355: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[eaf38502-d693-477e-b3d0-618d59a731db] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id eaf38502-d693-477e-b3d0-618d59a731db') 2024-04-05T22:40:08.437051045Z Traceback (most recent call last): 2024-04-05T22:40:08.437055618Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-05T22:40:08.437059084Z R = retval = fun(*args, **kwargs) 2024-04-05T22:40:08.437062708Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-05T22:40:08.437065968Z return self.run(*args, **kwargs) 2024-04-05T22:40:08.437069942Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-05T22:40:08.437073705Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-05T22:40:08.437077040Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-05T22:40:08.437081055Z raise AirflowException(msg) 2024-04-05T22:40:08.437085102Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id eaf38502-d693-477e-b3d0-618d59a731db 2024-04-05T22:40:08.677372158Z [2024-04-05 22:40:08,676: INFO/ForkPoolWorker-7] Task airflow.executors.celery_executor.execute_command[e895b3e1-3be5-4cc8-b277-3bfde6699fb4] succeeded in 7.359065949999831s: None 2024-04-05T22:40:09.016898332Z [2024-04-05 22:40:09,016: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6e005246-72ec-4bad-a7ed-0119204d7776] received 2024-04-05T22:40:09.032533310Z [2024-04-05 22:40:09,032: INFO/ForkPoolWorker-15] [6e005246-72ec-4bad-a7ed-0119204d7776] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'split_metrics', 'scheduled__2024-04-05T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T22:40:09.065577377Z [2024-04-05 22:40:09,065: INFO/ForkPoolWorker-6] Getting VIM list 2024-04-05T22:40:09.069587854Z [2024-04-05 22:40:09,069: INFO/ForkPoolWorker-6] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:40:09.094127590Z [2024-04-05 22:40:09,093: INFO/ForkPoolWorker-6] Connected to database osm version 1.2 2024-04-05T22:40:09.095355570Z [2024-04-05 22:40:09,095: INFO/ForkPoolWorker-6] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:40:09.095473201Z [2024-04-05 22:40:09,095: INFO/ForkPoolWorker-6] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:40:09.095565964Z [2024-04-05 22:40:09,095: INFO/ForkPoolWorker-6] Read VIM 794b19d9-5bf5-4602-8775-af4c7438009c (basic01_753257) 2024-04-05T22:40:09.095751174Z [2024-04-05 22:40:09,095: INFO/ForkPoolWorker-6] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '794b19d9-5bf5-4602-8775-af4c7438009c', 'name': 'basic01_753257', 'vim_type': 'openstack'}] 2024-04-05T22:40:09.095773211Z [2024-04-05 22:40:09,095: INFO/ForkPoolWorker-6] Getting VIM list OK 2024-04-05T22:40:09.096054344Z [2024-04-05 22:40:09,095: INFO/ForkPoolWorker-6] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T22:40:09.096218578Z [2024-04-05 22:40:09,096: INFO/ForkPoolWorker-6] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:40:09.102889111Z [2024-04-05 22:40:09,102: INFO/ForkPoolWorker-6] Creating DAG vm_metrics_vim_794b19d9-5bf5-4602-8775-af4c7438009c 2024-04-05T22:40:09.107082641Z [2024-04-05 22:40:09,106: WARNING/ForkPoolWorker-6] Dag 'vm_metrics_vim_731a3fa9-cb91-432b-ada3-b20941b99dab' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T22:40:09.108082619Z [2024-04-05 22:40:09,107: INFO/ForkPoolWorker-6] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T22:40:09.109767682Z [2024-04-05 22:40:09,109: INFO/ForkPoolWorker-6] Getting VIM list 2024-04-05T22:40:09.113799730Z [2024-04-05 22:40:09,113: INFO/ForkPoolWorker-6] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:40:09.147580287Z [2024-04-05 22:40:09,147: INFO/ForkPoolWorker-6] Connected to database osm version 1.2 2024-04-05T22:40:09.149151989Z [2024-04-05 22:40:09,148: INFO/ForkPoolWorker-6] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:40:09.149164234Z [2024-04-05 22:40:09,149: INFO/ForkPoolWorker-6] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:40:09.149172999Z [2024-04-05 22:40:09,149: INFO/ForkPoolWorker-6] Read VIM 794b19d9-5bf5-4602-8775-af4c7438009c (basic01_753257) 2024-04-05T22:40:09.149304826Z [2024-04-05 22:40:09,149: INFO/ForkPoolWorker-6] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '794b19d9-5bf5-4602-8775-af4c7438009c', 'name': 'basic01_753257', 'vim_type': 'openstack'}] 2024-04-05T22:40:09.149318306Z [2024-04-05 22:40:09,149: INFO/ForkPoolWorker-6] Getting VIM list OK 2024-04-05T22:40:09.149562273Z [2024-04-05 22:40:09,149: INFO/ForkPoolWorker-6] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T22:40:09.149609303Z [2024-04-05 22:40:09,149: INFO/ForkPoolWorker-6] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:40:09.165043608Z [2024-04-05 22:40:09,164: INFO/ForkPoolWorker-6] Creating DAG vm_metrics_vim_794b19d9-5bf5-4602-8775-af4c7438009c 2024-04-05T22:40:09.168572662Z [2024-04-05 22:40:09,167: ERROR/ForkPoolWorker-6] [72ba8892-bf07-4003-be29-a85390e5a459] Failed to execute task Dag 'vm_metrics_vim_731a3fa9-cb91-432b-ada3-b20941b99dab' could not be found; either it does not exist or it failed to parse.. 2024-04-05T22:40:09.168595285Z Traceback (most recent call last): 2024-04-05T22:40:09.168600844Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-05T22:40:09.168624169Z args.func(args) 2024-04-05T22:40:09.168630233Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-05T22:40:09.168636312Z return func(*args, **kwargs) 2024-04-05T22:40:09.168640550Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-05T22:40:09.168644792Z return f(*args, **kwargs) 2024-04-05T22:40:09.168648964Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-05T22:40:09.168653378Z dag = get_dag(args.subdir, args.dag_id) 2024-04-05T22:40:09.168657853Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-05T22:40:09.168661993Z raise AirflowException( 2024-04-05T22:40:09.168668410Z airflow.exceptions.AirflowException: Dag 'vm_metrics_vim_731a3fa9-cb91-432b-ada3-b20941b99dab' could not be found; either it does not exist or it failed to parse. 2024-04-05T22:40:09.227848600Z [2024-04-05 22:40:09,226: ERROR/ForkPoolWorker-6] Task airflow.executors.celery_executor.execute_command[72ba8892-bf07-4003-be29-a85390e5a459] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 72ba8892-bf07-4003-be29-a85390e5a459') 2024-04-05T22:40:09.227879140Z Traceback (most recent call last): 2024-04-05T22:40:09.227884995Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-05T22:40:09.227889388Z R = retval = fun(*args, **kwargs) 2024-04-05T22:40:09.227893570Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-05T22:40:09.227898118Z return self.run(*args, **kwargs) 2024-04-05T22:40:09.227904082Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-05T22:40:09.227924868Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-05T22:40:09.227929451Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-05T22:40:09.227934873Z raise AirflowException(msg) 2024-04-05T22:40:09.227947791Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 72ba8892-bf07-4003-be29-a85390e5a459 2024-04-05T22:40:09.395242980Z [2024-04-05 22:40:09,392: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T22:40:09.872334888Z [2024-04-05 22:40:09,871: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1f185e02-5803-4ced-89e7-3e2ddb61ab09] succeeded in 8.65137188299991s: None 2024-04-05T22:40:09.878606107Z [2024-04-05 22:40:09,878: INFO/ForkPoolWorker-5] Task airflow.executors.celery_executor.execute_command[ce56213c-1ec6-4ad1-a9a8-1fe2ad0fc1f4] succeeded in 8.572909084999992s: None 2024-04-05T22:40:10.445138110Z [2024-04-05 22:40:10,444: INFO/ForkPoolWorker-9] Task airflow.executors.celery_executor.execute_command[621b1066-e887-4453-8a53-e63b1b88cf30] succeeded in 9.026670495999952s: None 2024-04-05T22:40:10.468611612Z [2024-04-05 22:40:10,468: INFO/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[3bbab3db-6fb8-443b-9092-204c26ad256d] succeeded in 9.214803971000038s: None 2024-04-05T22:40:10.907435242Z [2024-04-05 22:40:10,907: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T22:40:10.911417951Z [2024-04-05 22:40:10,910: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:40:10.960837129Z [2024-04-05 22:40:10,960: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T22:40:10.962473850Z [2024-04-05 22:40:10,962: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:40:10.962485420Z [2024-04-05 22:40:10,962: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:40:10.962496973Z [2024-04-05 22:40:10,962: INFO/ForkPoolWorker-15] Read VIM 794b19d9-5bf5-4602-8775-af4c7438009c (basic01_753257) 2024-04-05T22:40:10.963360759Z [2024-04-05 22:40:10,962: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '794b19d9-5bf5-4602-8775-af4c7438009c', 'name': 'basic01_753257', 'vim_type': 'openstack'}] 2024-04-05T22:40:10.963455840Z [2024-04-05 22:40:10,963: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T22:40:10.963711956Z [2024-04-05 22:40:10,963: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T22:40:10.963737899Z [2024-04-05 22:40:10,963: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:40:10.977029412Z [2024-04-05 22:40:10,975: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_794b19d9-5bf5-4602-8775-af4c7438009c 2024-04-05T22:40:11.061564455Z [2024-04-05 22:40:11,061: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:40:11.667740884Z [2024-04-05 22:40:11,667: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6e005246-72ec-4bad-a7ed-0119204d7776] succeeded in 2.6490299060001234s: None 2024-04-05T22:40:11.756958336Z [2024-04-05 22:40:11,756: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e138aec4-407a-43cc-a317-831bdca58d45] received 2024-04-05T22:40:11.759310097Z [2024-04-05 22:40:11,759: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e2b12810-7edb-4083-8318-89f6a9e3a6ed] received 2024-04-05T22:40:11.763762339Z [2024-04-05 22:40:11,763: INFO/ForkPoolWorker-15] [e138aec4-407a-43cc-a317-831bdca58d45] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_794b19d9-5bf5-4602-8775-af4c7438009c', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T22:40:11.767823080Z [2024-04-05 22:40:11,767: INFO/ForkPoolWorker-16] [e2b12810-7edb-4083-8318-89f6a9e3a6ed] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'collect_metrics', 'scheduled__2024-04-05T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T22:40:12.077155922Z [2024-04-05 22:40:12,072: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T22:40:12.127016139Z [2024-04-05 22:40:12,124: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T22:40:13.683025850Z [2024-04-05 22:40:13,682: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-05T22:40:13.719423126Z [2024-04-05 22:40:13,698: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:40:13.771185119Z [2024-04-05 22:40:13,770: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T22:40:13.776472138Z [2024-04-05 22:40:13,776: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:40:13.776483883Z [2024-04-05 22:40:13,776: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:40:13.776495163Z [2024-04-05 22:40:13,776: INFO/ForkPoolWorker-16] Read VIM 794b19d9-5bf5-4602-8775-af4c7438009c (basic01_753257) 2024-04-05T22:40:13.776638601Z [2024-04-05 22:40:13,776: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '794b19d9-5bf5-4602-8775-af4c7438009c', 'name': 'basic01_753257', 'vim_type': 'openstack'}] 2024-04-05T22:40:13.776654078Z [2024-04-05 22:40:13,776: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-05T22:40:13.776975206Z [2024-04-05 22:40:13,776: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T22:40:13.777001190Z [2024-04-05 22:40:13,776: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:40:13.786166650Z [2024-04-05 22:40:13,785: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_794b19d9-5bf5-4602-8775-af4c7438009c 2024-04-05T22:40:13.788284450Z [2024-04-05 22:40:13,787: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T22:40:13.792231035Z [2024-04-05 22:40:13,791: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:40:13.838994318Z [2024-04-05 22:40:13,838: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T22:40:13.844358270Z [2024-04-05 22:40:13,844: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:40:13.859555507Z [2024-04-05 22:40:13,844: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:40:13.859721978Z [2024-04-05 22:40:13,859: INFO/ForkPoolWorker-15] Read VIM 794b19d9-5bf5-4602-8775-af4c7438009c (basic01_753257) 2024-04-05T22:40:13.859849955Z [2024-04-05 22:40:13,859: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '794b19d9-5bf5-4602-8775-af4c7438009c', 'name': 'basic01_753257', 'vim_type': 'openstack'}] 2024-04-05T22:40:13.859903379Z [2024-04-05 22:40:13,859: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T22:40:13.860195204Z [2024-04-05 22:40:13,860: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T22:40:13.860247173Z [2024-04-05 22:40:13,860: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:40:13.867907304Z [2024-04-05 22:40:13,867: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_794b19d9-5bf5-4602-8775-af4c7438009c 2024-04-05T22:40:13.880513947Z [2024-04-05 22:40:13,880: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:40:13.959118117Z [2024-04-05 22:40:13,958: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:40:14.625413193Z [2024-04-05 22:40:14,624: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e138aec4-407a-43cc-a317-831bdca58d45] succeeded in 2.8666728030000286s: None 2024-04-05T22:40:14.694647023Z [2024-04-05 22:40:14,694: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e2b12810-7edb-4083-8318-89f6a9e3a6ed] succeeded in 2.9334549870000046s: None 2024-04-05T22:40:15.311918361Z [2024-04-05 22:40:15,311: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c647ed13-cdb3-4b54-a42c-ac8517f221b2] received 2024-04-05T22:40:15.327187310Z [2024-04-05 22:40:15,326: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e4c00631-43a2-4552-8366-d249b4197872] received 2024-04-05T22:40:15.332413565Z [2024-04-05 22:40:15,329: INFO/ForkPoolWorker-15] [c647ed13-cdb3-4b54-a42c-ac8517f221b2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_794b19d9-5bf5-4602-8775-af4c7438009c', 'split_metrics', 'scheduled__2024-04-05T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T22:40:15.336640101Z [2024-04-05 22:40:15,336: INFO/ForkPoolWorker-16] [e4c00631-43a2-4552-8366-d249b4197872] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'send_prometheus', 'scheduled__2024-04-05T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T22:40:15.687423144Z [2024-04-05 22:40:15,682: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T22:40:15.697392767Z [2024-04-05 22:40:15,694: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T22:40:17.031984704Z [2024-04-05 22:40:17,030: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-05T22:40:17.035577891Z [2024-04-05 22:40:17,035: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:40:17.056108115Z [2024-04-05 22:40:17,055: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T22:40:17.057348418Z [2024-04-05 22:40:17,057: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:40:17.057359252Z [2024-04-05 22:40:17,057: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:40:17.057416291Z [2024-04-05 22:40:17,057: INFO/ForkPoolWorker-16] Read VIM 794b19d9-5bf5-4602-8775-af4c7438009c (basic01_753257) 2024-04-05T22:40:17.057557650Z [2024-04-05 22:40:17,057: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '794b19d9-5bf5-4602-8775-af4c7438009c', 'name': 'basic01_753257', 'vim_type': 'openstack'}] 2024-04-05T22:40:17.057569006Z [2024-04-05 22:40:17,057: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-05T22:40:17.057808247Z [2024-04-05 22:40:17,057: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T22:40:17.057820302Z [2024-04-05 22:40:17,057: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:40:17.064475746Z [2024-04-05 22:40:17,064: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_794b19d9-5bf5-4602-8775-af4c7438009c 2024-04-05T22:40:17.141056128Z [2024-04-05 22:40:17,140: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:40:17.145419677Z [2024-04-05 22:40:17,145: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T22:40:17.149079274Z [2024-04-05 22:40:17,148: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:40:17.173081478Z [2024-04-05 22:40:17,172: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T22:40:17.174437402Z [2024-04-05 22:40:17,174: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:40:17.174595664Z [2024-04-05 22:40:17,174: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:40:17.174781613Z [2024-04-05 22:40:17,174: INFO/ForkPoolWorker-15] Read VIM 794b19d9-5bf5-4602-8775-af4c7438009c (basic01_753257) 2024-04-05T22:40:17.175071062Z [2024-04-05 22:40:17,174: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '794b19d9-5bf5-4602-8775-af4c7438009c', 'name': 'basic01_753257', 'vim_type': 'openstack'}] 2024-04-05T22:40:17.175231159Z [2024-04-05 22:40:17,175: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T22:40:17.175686078Z [2024-04-05 22:40:17,175: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T22:40:17.176260052Z [2024-04-05 22:40:17,176: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:40:17.183362132Z [2024-04-05 22:40:17,183: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_794b19d9-5bf5-4602-8775-af4c7438009c 2024-04-05T22:40:17.262950635Z [2024-04-05 22:40:17,262: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:40:17.690449083Z [2024-04-05 22:40:17,690: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e4c00631-43a2-4552-8366-d249b4197872] succeeded in 2.360221077999995s: None 2024-04-05T22:40:17.880277131Z [2024-04-05 22:40:17,879: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c647ed13-cdb3-4b54-a42c-ac8517f221b2] succeeded in 2.561636572999987s: None 2024-04-05T22:40:17.970642930Z [2024-04-05 22:40:17,970: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[618e22f1-d49f-435a-8dea-caa4af22c80c] received 2024-04-05T22:40:17.984782708Z [2024-04-05 22:40:17,984: INFO/ForkPoolWorker-15] [618e22f1-d49f-435a-8dea-caa4af22c80c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_731a3fa9-cb91-432b-ada3-b20941b99dab', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T22:40:17.987983644Z [2024-04-05 22:40:17,987: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[01c1db01-6c47-4049-a414-03f2a10c5a94] received 2024-04-05T22:40:17.995678905Z [2024-04-05 22:40:17,995: INFO/ForkPoolWorker-16] [01c1db01-6c47-4049-a414-03f2a10c5a94] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_794b19d9-5bf5-4602-8775-af4c7438009c', 'collect_metrics', 'scheduled__2024-04-05T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T22:40:18.300330444Z [2024-04-05 22:40:18,297: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T22:40:18.376652311Z [2024-04-05 22:40:18,373: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T22:40:19.464953830Z [2024-04-05 22:40:19,464: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3c8662b9-bdd5-46f9-aa85-928c49f11806] received 2024-04-05T22:40:19.477473947Z [2024-04-05 22:40:19,477: INFO/ForkPoolWorker-1] [3c8662b9-bdd5-46f9-aa85-928c49f11806] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_731a3fa9-cb91-432b-ada3-b20941b99dab', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T22:40:19.521501198Z [2024-04-05 22:40:19,521: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[93507d63-8c8f-4e52-b66a-1736d6b7c4fc] received 2024-04-05T22:40:19.535649704Z [2024-04-05 22:40:19,535: INFO/ForkPoolWorker-2] [93507d63-8c8f-4e52-b66a-1736d6b7c4fc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_731a3fa9-cb91-432b-ada3-b20941b99dab', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T22:40:19.549517832Z [2024-04-05 22:40:19,549: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T22:40:19.553217229Z [2024-04-05 22:40:19,552: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:40:19.593862236Z [2024-04-05 22:40:19,593: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T22:40:19.595800089Z [2024-04-05 22:40:19,595: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:40:19.596214715Z [2024-04-05 22:40:19,595: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:40:19.596549349Z [2024-04-05 22:40:19,596: INFO/ForkPoolWorker-15] Read VIM 794b19d9-5bf5-4602-8775-af4c7438009c (basic01_753257) 2024-04-05T22:40:19.596986968Z [2024-04-05 22:40:19,596: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '794b19d9-5bf5-4602-8775-af4c7438009c', 'name': 'basic01_753257', 'vim_type': 'openstack'}] 2024-04-05T22:40:19.598825229Z [2024-04-05 22:40:19,597: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T22:40:19.600196282Z [2024-04-05 22:40:19,600: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-05T22:40:19.600332316Z [2024-04-05 22:40:19,600: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:40:19.608941731Z [2024-04-05 22:40:19,608: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_794b19d9-5bf5-4602-8775-af4c7438009c 2024-04-05T22:40:19.614636120Z [2024-04-05 22:40:19,614: WARNING/ForkPoolWorker-15] Dag 'vm_status_vim_731a3fa9-cb91-432b-ada3-b20941b99dab' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T22:40:19.615859693Z [2024-04-05 22:40:19,614: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T22:40:19.616819331Z [2024-04-05 22:40:19,616: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T22:40:19.619600084Z [2024-04-05 22:40:19,619: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:40:19.641489701Z [2024-04-05 22:40:19,641: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T22:40:19.643552779Z [2024-04-05 22:40:19,643: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:40:19.643565915Z [2024-04-05 22:40:19,643: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:40:19.645817790Z [2024-04-05 22:40:19,645: INFO/ForkPoolWorker-15] Read VIM 794b19d9-5bf5-4602-8775-af4c7438009c (basic01_753257) 2024-04-05T22:40:19.646053325Z [2024-04-05 22:40:19,645: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '794b19d9-5bf5-4602-8775-af4c7438009c', 'name': 'basic01_753257', 'vim_type': 'openstack'}] 2024-04-05T22:40:19.646128536Z [2024-04-05 22:40:19,646: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T22:40:19.646441295Z [2024-04-05 22:40:19,646: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-05T22:40:19.646690632Z [2024-04-05 22:40:19,646: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:40:19.660883542Z [2024-04-05 22:40:19,660: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_794b19d9-5bf5-4602-8775-af4c7438009c 2024-04-05T22:40:19.670504186Z [2024-04-05 22:40:19,669: ERROR/ForkPoolWorker-15] [618e22f1-d49f-435a-8dea-caa4af22c80c] Failed to execute task Dag 'vm_status_vim_731a3fa9-cb91-432b-ada3-b20941b99dab' could not be found; either it does not exist or it failed to parse.. 2024-04-05T22:40:19.670540929Z Traceback (most recent call last): 2024-04-05T22:40:19.670546699Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-05T22:40:19.670551697Z args.func(args) 2024-04-05T22:40:19.670557295Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-05T22:40:19.670563153Z return func(*args, **kwargs) 2024-04-05T22:40:19.670567469Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-05T22:40:19.670571809Z return f(*args, **kwargs) 2024-04-05T22:40:19.670576144Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-05T22:40:19.670580449Z dag = get_dag(args.subdir, args.dag_id) 2024-04-05T22:40:19.670584733Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-05T22:40:19.670589027Z raise AirflowException( 2024-04-05T22:40:19.670594182Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_731a3fa9-cb91-432b-ada3-b20941b99dab' could not be found; either it does not exist or it failed to parse. 2024-04-05T22:40:19.750830311Z [2024-04-05 22:40:19,750: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[618e22f1-d49f-435a-8dea-caa4af22c80c] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 618e22f1-d49f-435a-8dea-caa4af22c80c') 2024-04-05T22:40:19.750846183Z Traceback (most recent call last): 2024-04-05T22:40:19.750850330Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-05T22:40:19.750865293Z R = retval = fun(*args, **kwargs) 2024-04-05T22:40:19.750868449Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-05T22:40:19.750871672Z return self.run(*args, **kwargs) 2024-04-05T22:40:19.750875038Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-05T22:40:19.750879265Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-05T22:40:19.750882705Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-05T22:40:19.750886341Z raise AirflowException(msg) 2024-04-05T22:40:19.750889937Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 618e22f1-d49f-435a-8dea-caa4af22c80c 2024-04-05T22:40:19.837573526Z [2024-04-05 22:40:19,833: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T22:40:19.876668639Z [2024-04-05 22:40:19,876: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-05T22:40:19.880350672Z [2024-04-05 22:40:19,879: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:40:19.937254546Z [2024-04-05 22:40:19,937: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T22:40:19.938510701Z [2024-04-05 22:40:19,938: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:40:19.938550263Z [2024-04-05 22:40:19,938: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:40:19.938677179Z [2024-04-05 22:40:19,938: INFO/ForkPoolWorker-16] Read VIM 794b19d9-5bf5-4602-8775-af4c7438009c (basic01_753257) 2024-04-05T22:40:19.938885748Z [2024-04-05 22:40:19,938: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '794b19d9-5bf5-4602-8775-af4c7438009c', 'name': 'basic01_753257', 'vim_type': 'openstack'}] 2024-04-05T22:40:19.938893195Z [2024-04-05 22:40:19,938: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-05T22:40:19.939162080Z [2024-04-05 22:40:19,939: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T22:40:19.939169167Z [2024-04-05 22:40:19,939: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:40:19.945886955Z [2024-04-05 22:40:19,945: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_794b19d9-5bf5-4602-8775-af4c7438009c 2024-04-05T22:40:20.046137198Z [2024-04-05 22:40:20,042: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T22:40:20.077567269Z [2024-04-05 22:40:20,077: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:40:20.772378761Z [2024-04-05 22:40:20,771: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[01c1db01-6c47-4049-a414-03f2a10c5a94] succeeded in 2.782192376000012s: None 2024-04-05T22:40:21.199889211Z [2024-04-05 22:40:21,199: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c101fe34-12e3-4c64-8702-934e5931bed5] received 2024-04-05T22:40:21.209046073Z [2024-04-05 22:40:21,208: INFO/ForkPoolWorker-15] [c101fe34-12e3-4c64-8702-934e5931bed5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_794b19d9-5bf5-4602-8775-af4c7438009c', 'send_prometheus', 'scheduled__2024-04-05T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T22:40:21.397501111Z [2024-04-05 22:40:21,397: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-05T22:40:21.401136772Z [2024-04-05 22:40:21,400: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:40:21.431702826Z [2024-04-05 22:40:21,431: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-05T22:40:21.432901775Z [2024-04-05 22:40:21,432: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:40:21.432910842Z [2024-04-05 22:40:21,432: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:40:21.432976687Z [2024-04-05 22:40:21,432: INFO/ForkPoolWorker-1] Read VIM 794b19d9-5bf5-4602-8775-af4c7438009c (basic01_753257) 2024-04-05T22:40:21.433107316Z [2024-04-05 22:40:21,432: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '794b19d9-5bf5-4602-8775-af4c7438009c', 'name': 'basic01_753257', 'vim_type': 'openstack'}] 2024-04-05T22:40:21.433136636Z [2024-04-05 22:40:21,433: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-05T22:40:21.433365645Z [2024-04-05 22:40:21,433: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T22:40:21.433408190Z [2024-04-05 22:40:21,433: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:40:21.440394885Z [2024-04-05 22:40:21,440: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_794b19d9-5bf5-4602-8775-af4c7438009c 2024-04-05T22:40:21.444541910Z [2024-04-05 22:40:21,444: WARNING/ForkPoolWorker-1] Dag 'vm_metrics_vim_731a3fa9-cb91-432b-ada3-b20941b99dab' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T22:40:21.445313698Z [2024-04-05 22:40:21,444: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T22:40:21.446521194Z [2024-04-05 22:40:21,446: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-05T22:40:21.449396018Z [2024-04-05 22:40:21,449: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:40:21.500390899Z [2024-04-05 22:40:21,500: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-05T22:40:21.504529441Z [2024-04-05 22:40:21,504: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:40:21.504545245Z [2024-04-05 22:40:21,504: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:40:21.504566385Z [2024-04-05 22:40:21,504: INFO/ForkPoolWorker-1] Read VIM 794b19d9-5bf5-4602-8775-af4c7438009c (basic01_753257) 2024-04-05T22:40:21.504736787Z [2024-04-05 22:40:21,504: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '794b19d9-5bf5-4602-8775-af4c7438009c', 'name': 'basic01_753257', 'vim_type': 'openstack'}] 2024-04-05T22:40:21.504755826Z [2024-04-05 22:40:21,504: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-05T22:40:21.505021256Z [2024-04-05 22:40:21,504: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T22:40:21.505029080Z [2024-04-05 22:40:21,504: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:40:21.507884298Z [2024-04-05 22:40:21,507: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_794b19d9-5bf5-4602-8775-af4c7438009c 2024-04-05T22:40:21.508041914Z [2024-04-05 22:40:21,504: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T22:40:21.511843125Z [2024-04-05 22:40:21,511: ERROR/ForkPoolWorker-1] [3c8662b9-bdd5-46f9-aa85-928c49f11806] Failed to execute task Dag 'vm_metrics_vim_731a3fa9-cb91-432b-ada3-b20941b99dab' could not be found; either it does not exist or it failed to parse.. 2024-04-05T22:40:21.511877683Z Traceback (most recent call last): 2024-04-05T22:40:21.511882668Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-05T22:40:21.511886655Z args.func(args) 2024-04-05T22:40:21.511890048Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-05T22:40:21.511893839Z return func(*args, **kwargs) 2024-04-05T22:40:21.511897176Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-05T22:40:21.511900248Z return f(*args, **kwargs) 2024-04-05T22:40:21.511920321Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-05T22:40:21.511923772Z dag = get_dag(args.subdir, args.dag_id) 2024-04-05T22:40:21.511927021Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-05T22:40:21.511929911Z raise AirflowException( 2024-04-05T22:40:21.511933968Z airflow.exceptions.AirflowException: Dag 'vm_metrics_vim_731a3fa9-cb91-432b-ada3-b20941b99dab' could not be found; either it does not exist or it failed to parse. 2024-04-05T22:40:21.526373048Z [2024-04-05 22:40:21,525: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-05T22:40:21.529706428Z [2024-04-05 22:40:21,529: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:40:21.566827002Z [2024-04-05 22:40:21,566: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-05T22:40:21.571047291Z [2024-04-05 22:40:21,570: INFO/ForkPoolWorker-2] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:40:21.571104033Z [2024-04-05 22:40:21,570: INFO/ForkPoolWorker-2] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:40:21.571114333Z [2024-04-05 22:40:21,571: INFO/ForkPoolWorker-2] Read VIM 794b19d9-5bf5-4602-8775-af4c7438009c (basic01_753257) 2024-04-05T22:40:21.571237205Z [2024-04-05 22:40:21,571: INFO/ForkPoolWorker-2] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '794b19d9-5bf5-4602-8775-af4c7438009c', 'name': 'basic01_753257', 'vim_type': 'openstack'}] 2024-04-05T22:40:21.571273300Z [2024-04-05 22:40:21,571: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-05T22:40:21.571596173Z [2024-04-05 22:40:21,571: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T22:40:21.571665275Z [2024-04-05 22:40:21,571: INFO/ForkPoolWorker-2] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:40:21.576908129Z [2024-04-05 22:40:21,576: INFO/ForkPoolWorker-2] Creating DAG vim_status_794b19d9-5bf5-4602-8775-af4c7438009c 2024-04-05T22:40:21.583105092Z [2024-04-05 22:40:21,582: WARNING/ForkPoolWorker-2] Dag 'vim_status_731a3fa9-cb91-432b-ada3-b20941b99dab' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T22:40:21.584091567Z [2024-04-05 22:40:21,583: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T22:40:21.584567105Z [2024-04-05 22:40:21,583: ERROR/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3c8662b9-bdd5-46f9-aa85-928c49f11806] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 3c8662b9-bdd5-46f9-aa85-928c49f11806') 2024-04-05T22:40:21.584578034Z Traceback (most recent call last): 2024-04-05T22:40:21.584582305Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-05T22:40:21.584585576Z R = retval = fun(*args, **kwargs) 2024-04-05T22:40:21.584588825Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-05T22:40:21.584592105Z return self.run(*args, **kwargs) 2024-04-05T22:40:21.584595956Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-05T22:40:21.584614682Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-05T22:40:21.584618591Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-05T22:40:21.584623268Z raise AirflowException(msg) 2024-04-05T22:40:21.584628280Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 3c8662b9-bdd5-46f9-aa85-928c49f11806 2024-04-05T22:40:21.584954993Z [2024-04-05 22:40:21,584: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-05T22:40:21.587492153Z [2024-04-05 22:40:21,587: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:40:21.603964811Z [2024-04-05 22:40:21,603: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-05T22:40:21.605134993Z [2024-04-05 22:40:21,604: INFO/ForkPoolWorker-2] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:40:21.605151976Z [2024-04-05 22:40:21,605: INFO/ForkPoolWorker-2] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:40:21.605165825Z [2024-04-05 22:40:21,605: INFO/ForkPoolWorker-2] Read VIM 794b19d9-5bf5-4602-8775-af4c7438009c (basic01_753257) 2024-04-05T22:40:21.605320613Z [2024-04-05 22:40:21,605: INFO/ForkPoolWorker-2] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '794b19d9-5bf5-4602-8775-af4c7438009c', 'name': 'basic01_753257', 'vim_type': 'openstack'}] 2024-04-05T22:40:21.605357058Z [2024-04-05 22:40:21,605: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-05T22:40:21.605647825Z [2024-04-05 22:40:21,605: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T22:40:21.605660746Z [2024-04-05 22:40:21,605: INFO/ForkPoolWorker-2] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:40:21.608130924Z [2024-04-05 22:40:21,607: INFO/ForkPoolWorker-2] Creating DAG vim_status_794b19d9-5bf5-4602-8775-af4c7438009c 2024-04-05T22:40:21.611660583Z [2024-04-05 22:40:21,610: ERROR/ForkPoolWorker-2] [93507d63-8c8f-4e52-b66a-1736d6b7c4fc] Failed to execute task Dag 'vim_status_731a3fa9-cb91-432b-ada3-b20941b99dab' could not be found; either it does not exist or it failed to parse.. 2024-04-05T22:40:21.611676173Z Traceback (most recent call last): 2024-04-05T22:40:21.611681218Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-05T22:40:21.611685319Z args.func(args) 2024-04-05T22:40:21.611689864Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-05T22:40:21.611694382Z return func(*args, **kwargs) 2024-04-05T22:40:21.611697944Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-05T22:40:21.611701743Z return f(*args, **kwargs) 2024-04-05T22:40:21.611705874Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-05T22:40:21.611709550Z dag = get_dag(args.subdir, args.dag_id) 2024-04-05T22:40:21.611717027Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-05T22:40:21.611720619Z raise AirflowException( 2024-04-05T22:40:21.611741608Z airflow.exceptions.AirflowException: Dag 'vim_status_731a3fa9-cb91-432b-ada3-b20941b99dab' could not be found; either it does not exist or it failed to parse. 2024-04-05T22:40:21.657446516Z [2024-04-05 22:40:21,656: ERROR/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[93507d63-8c8f-4e52-b66a-1736d6b7c4fc] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 93507d63-8c8f-4e52-b66a-1736d6b7c4fc') 2024-04-05T22:40:21.657466482Z Traceback (most recent call last): 2024-04-05T22:40:21.657470717Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-05T22:40:21.657473888Z R = retval = fun(*args, **kwargs) 2024-04-05T22:40:21.657477032Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-05T22:40:21.657480536Z return self.run(*args, **kwargs) 2024-04-05T22:40:21.657485119Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-05T22:40:21.657489787Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-05T22:40:21.657493049Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-05T22:40:21.657497992Z raise AirflowException(msg) 2024-04-05T22:40:21.657502016Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 93507d63-8c8f-4e52-b66a-1736d6b7c4fc 2024-04-05T22:40:22.814312071Z [2024-04-05 22:40:22,813: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T22:40:22.817922811Z [2024-04-05 22:40:22,817: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:40:22.836727747Z [2024-04-05 22:40:22,836: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T22:40:22.837813109Z [2024-04-05 22:40:22,837: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:40:22.837825318Z [2024-04-05 22:40:22,837: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:40:22.837838344Z [2024-04-05 22:40:22,837: INFO/ForkPoolWorker-15] Read VIM 794b19d9-5bf5-4602-8775-af4c7438009c (basic01_753257) 2024-04-05T22:40:22.837977535Z [2024-04-05 22:40:22,837: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '794b19d9-5bf5-4602-8775-af4c7438009c', 'name': 'basic01_753257', 'vim_type': 'openstack'}] 2024-04-05T22:40:22.837986628Z [2024-04-05 22:40:22,837: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T22:40:22.838267454Z [2024-04-05 22:40:22,838: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T22:40:22.838294351Z [2024-04-05 22:40:22,838: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:40:22.844896946Z [2024-04-05 22:40:22,844: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_794b19d9-5bf5-4602-8775-af4c7438009c 2024-04-05T22:40:22.920772538Z [2024-04-05 22:40:22,920: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:40:23.595913072Z [2024-04-05 22:40:23,595: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c101fe34-12e3-4c64-8702-934e5931bed5] succeeded in 2.394358615000101s: None 2024-04-05T22:41:01.204378018Z [2024-04-05 22:41:01,203: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c665e9b1-2e7d-4d4a-8048-6b5cf90fb29d] received 2024-04-05T22:41:01.207786657Z [2024-04-05 22:41:01,207: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6674ec70-14b8-40f5-a112-a93ceda95d62] received 2024-04-05T22:41:01.215898230Z [2024-04-05 22:41:01,215: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bda6b19f-46de-4217-8499-bd4b02ce2f1f] received 2024-04-05T22:41:01.216683835Z [2024-04-05 22:41:01,216: INFO/ForkPoolWorker-16] [6674ec70-14b8-40f5-a112-a93ceda95d62] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T22:41:01.218479374Z [2024-04-05 22:41:01,218: INFO/ForkPoolWorker-15] [c665e9b1-2e7d-4d4a-8048-6b5cf90fb29d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_794b19d9-5bf5-4602-8775-af4c7438009c', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T22:41:01.224209452Z [2024-04-05 22:41:01,223: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[67765104-96be-4107-89ea-0bccb565ed9a] received 2024-04-05T22:41:01.230173040Z [2024-04-05 22:41:01,229: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[049aa924-8064-4e20-bbd6-7c9426ec2df0] received 2024-04-05T22:41:01.231144601Z [2024-04-05 22:41:01,230: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f93a4fc6-e497-4aa2-a973-a0ba32df9e3f] received 2024-04-05T22:41:01.232653692Z [2024-04-05 22:41:01,232: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[132f9fb8-e19d-4101-b592-b9d3fd41ee59] received 2024-04-05T22:41:01.242947599Z [2024-04-05 22:41:01,242: INFO/ForkPoolWorker-4] [f93a4fc6-e497-4aa2-a973-a0ba32df9e3f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_731a3fa9-cb91-432b-ada3-b20941b99dab', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T22:41:01.244800809Z [2024-04-05 22:41:01,244: INFO/ForkPoolWorker-5] [132f9fb8-e19d-4101-b592-b9d3fd41ee59] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_731a3fa9-cb91-432b-ada3-b20941b99dab', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T22:41:01.248678723Z [2024-04-05 22:41:01,248: INFO/ForkPoolWorker-3] [049aa924-8064-4e20-bbd6-7c9426ec2df0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_794b19d9-5bf5-4602-8775-af4c7438009c', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T22:41:01.250555452Z [2024-04-05 22:41:01,250: INFO/ForkPoolWorker-2] [67765104-96be-4107-89ea-0bccb565ed9a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T22:41:01.256485286Z [2024-04-05 22:41:01,256: INFO/ForkPoolWorker-1] [bda6b19f-46de-4217-8499-bd4b02ce2f1f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T22:41:01.614886959Z [2024-04-05 22:41:01,611: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T22:41:01.638004034Z [2024-04-05 22:41:01,634: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T22:41:01.683120117Z [2024-04-05 22:41:01,678: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T22:41:02.000425653Z [2024-04-05 22:41:01,996: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-05T22:41:02.176051316Z [2024-04-05 22:41:02,175: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-05T22:41:02.180343484Z [2024-04-05 22:41:02,179: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:41:02.183002814Z [2024-04-05 22:41:02,169: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T22:41:02.184030832Z [2024-04-05 22:41:02,175: INFO/ForkPoolWorker-5] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T22:41:02.208427599Z [2024-04-05 22:41:02,208: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-05T22:41:02.221215612Z [2024-04-05 22:41:02,220: INFO/ForkPoolWorker-2] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-05T22:41:02.221422248Z [2024-04-05 22:41:02,221: INFO/ForkPoolWorker-2] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-05T22:41:02.221623874Z [2024-04-05 22:41:02,221: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-05T22:41:02.222102086Z [2024-04-05 22:41:02,221: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-05T22:41:02.330017696Z [2024-04-05 22:41:02,329: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:41:02.577574426Z [2024-04-05 22:41:02,570: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T22:41:03.088066934Z [2024-04-05 22:41:03,087: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[67765104-96be-4107-89ea-0bccb565ed9a] succeeded in 1.8551939300000413s: None 2024-04-05T22:41:03.130844303Z [2024-04-05 22:41:03,130: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-05T22:41:03.134187901Z [2024-04-05 22:41:03,133: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:41:03.212335944Z [2024-04-05 22:41:03,212: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T22:41:03.238663126Z [2024-04-05 22:41:03,220: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:41:03.239529521Z [2024-04-05 22:41:03,238: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:41:03.239723620Z [2024-04-05 22:41:03,239: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T22:41:03.239745497Z [2024-04-05 22:41:03,239: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-05T22:41:03.240076405Z [2024-04-05 22:41:03,239: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T22:41:03.240096579Z [2024-04-05 22:41:03,240: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:41:03.385284208Z [2024-04-05 22:41:03,384: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T22:41:03.389104973Z [2024-04-05 22:41:03,388: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:41:03.431349448Z [2024-04-05 22:41:03,431: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:41:03.472954032Z [2024-04-05 22:41:03,472: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T22:41:03.483133789Z [2024-04-05 22:41:03,482: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:41:03.483152480Z [2024-04-05 22:41:03,483: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:41:03.483891402Z [2024-04-05 22:41:03,483: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T22:41:03.484042010Z [2024-04-05 22:41:03,483: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T22:41:03.484365600Z [2024-04-05 22:41:03,484: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-05T22:41:03.486086560Z [2024-04-05 22:41:03,484: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:41:03.501390702Z [2024-04-05 22:41:03,501: WARNING/ForkPoolWorker-15] Dag 'vm_status_vim_794b19d9-5bf5-4602-8775-af4c7438009c' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T22:41:03.502438295Z [2024-04-05 22:41:03,501: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T22:41:03.512499691Z [2024-04-05 22:41:03,512: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T22:41:03.521008419Z [2024-04-05 22:41:03,520: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:41:03.578163938Z [2024-04-05 22:41:03,577: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T22:41:03.587199478Z [2024-04-05 22:41:03,586: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:41:03.587214515Z [2024-04-05 22:41:03,587: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:41:03.587494289Z [2024-04-05 22:41:03,587: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T22:41:03.587639992Z [2024-04-05 22:41:03,587: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T22:41:03.587988447Z [2024-04-05 22:41:03,587: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-05T22:41:03.588115500Z [2024-04-05 22:41:03,587: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:41:03.592513882Z [2024-04-05 22:41:03,591: ERROR/ForkPoolWorker-15] [c665e9b1-2e7d-4d4a-8048-6b5cf90fb29d] Failed to execute task Dag 'vm_status_vim_794b19d9-5bf5-4602-8775-af4c7438009c' could not be found; either it does not exist or it failed to parse.. 2024-04-05T22:41:03.592527828Z Traceback (most recent call last): 2024-04-05T22:41:03.592531903Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-05T22:41:03.592535853Z args.func(args) 2024-04-05T22:41:03.592539493Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-05T22:41:03.592543723Z return func(*args, **kwargs) 2024-04-05T22:41:03.592546869Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-05T22:41:03.592550074Z return f(*args, **kwargs) 2024-04-05T22:41:03.592553272Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-05T22:41:03.592556280Z dag = get_dag(args.subdir, args.dag_id) 2024-04-05T22:41:03.592559434Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-05T22:41:03.592562466Z raise AirflowException( 2024-04-05T22:41:03.592566411Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_794b19d9-5bf5-4602-8775-af4c7438009c' could not be found; either it does not exist or it failed to parse. 2024-04-05T22:41:03.656535203Z [2024-04-05 22:41:03,655: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c665e9b1-2e7d-4d4a-8048-6b5cf90fb29d] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id c665e9b1-2e7d-4d4a-8048-6b5cf90fb29d') 2024-04-05T22:41:03.656562656Z Traceback (most recent call last): 2024-04-05T22:41:03.656567353Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-05T22:41:03.656571305Z R = retval = fun(*args, **kwargs) 2024-04-05T22:41:03.656574484Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-05T22:41:03.656577649Z return self.run(*args, **kwargs) 2024-04-05T22:41:03.656581596Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-05T22:41:03.656585367Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-05T22:41:03.656588497Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-05T22:41:03.656592421Z raise AirflowException(msg) 2024-04-05T22:41:03.656596515Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id c665e9b1-2e7d-4d4a-8048-6b5cf90fb29d 2024-04-05T22:41:03.938932776Z [2024-04-05 22:41:03,938: INFO/ForkPoolWorker-3] Getting VIM list 2024-04-05T22:41:03.942347785Z [2024-04-05 22:41:03,941: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:41:03.968100557Z [2024-04-05 22:41:03,967: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-05T22:41:03.969394664Z [2024-04-05 22:41:03,969: INFO/ForkPoolWorker-3] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:41:03.969432196Z [2024-04-05 22:41:03,969: INFO/ForkPoolWorker-3] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:41:03.969607524Z [2024-04-05 22:41:03,969: INFO/ForkPoolWorker-3] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T22:41:03.969663511Z [2024-04-05 22:41:03,969: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-04-05T22:41:03.969901395Z [2024-04-05 22:41:03,969: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T22:41:03.970264300Z [2024-04-05 22:41:03,969: INFO/ForkPoolWorker-3] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:41:03.978605614Z [2024-04-05 22:41:03,978: WARNING/ForkPoolWorker-3] Dag 'vim_status_794b19d9-5bf5-4602-8775-af4c7438009c' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T22:41:03.980097480Z [2024-04-05 22:41:03,978: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T22:41:03.981033237Z [2024-04-05 22:41:03,980: INFO/ForkPoolWorker-3] Getting VIM list 2024-04-05T22:41:03.984567718Z [2024-04-05 22:41:03,984: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:41:04.026433509Z [2024-04-05 22:41:04,026: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-05T22:41:04.032403855Z [2024-04-05 22:41:04,031: INFO/ForkPoolWorker-3] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:41:04.033433423Z [2024-04-05 22:41:04,032: INFO/ForkPoolWorker-3] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:41:04.033446119Z [2024-04-05 22:41:04,032: INFO/ForkPoolWorker-3] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T22:41:04.033450522Z [2024-04-05 22:41:04,032: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-04-05T22:41:04.033453767Z [2024-04-05 22:41:04,032: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T22:41:04.033456912Z [2024-04-05 22:41:04,032: INFO/ForkPoolWorker-3] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:41:04.038473251Z [2024-04-05 22:41:04,037: ERROR/ForkPoolWorker-3] [049aa924-8064-4e20-bbd6-7c9426ec2df0] Failed to execute task Dag 'vim_status_794b19d9-5bf5-4602-8775-af4c7438009c' could not be found; either it does not exist or it failed to parse.. 2024-04-05T22:41:04.038499982Z Traceback (most recent call last): 2024-04-05T22:41:04.038505080Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-05T22:41:04.038509517Z args.func(args) 2024-04-05T22:41:04.038531163Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-05T22:41:04.038535815Z return func(*args, **kwargs) 2024-04-05T22:41:04.038539862Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-05T22:41:04.038543484Z return f(*args, **kwargs) 2024-04-05T22:41:04.038547502Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-05T22:41:04.038551039Z dag = get_dag(args.subdir, args.dag_id) 2024-04-05T22:41:04.038554849Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-05T22:41:04.038558515Z raise AirflowException( 2024-04-05T22:41:04.038562953Z airflow.exceptions.AirflowException: Dag 'vim_status_794b19d9-5bf5-4602-8775-af4c7438009c' could not be found; either it does not exist or it failed to parse. 2024-04-05T22:41:04.231879223Z [2024-04-05 22:41:04,231: ERROR/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[049aa924-8064-4e20-bbd6-7c9426ec2df0] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 049aa924-8064-4e20-bbd6-7c9426ec2df0') 2024-04-05T22:41:04.231908415Z Traceback (most recent call last): 2024-04-05T22:41:04.231914023Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-05T22:41:04.231918466Z R = retval = fun(*args, **kwargs) 2024-04-05T22:41:04.231923061Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-05T22:41:04.231927055Z return self.run(*args, **kwargs) 2024-04-05T22:41:04.231932199Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-05T22:41:04.231936688Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-05T22:41:04.231939667Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-05T22:41:04.231948450Z raise AirflowException(msg) 2024-04-05T22:41:04.231952551Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 049aa924-8064-4e20-bbd6-7c9426ec2df0 2024-04-05T22:41:04.992804406Z [2024-04-05 22:41:04,991: INFO/ForkPoolWorker-5] Getting VIM list 2024-04-05T22:41:04.996093534Z [2024-04-05 22:41:04,995: INFO/ForkPoolWorker-5] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:41:05.015480647Z [2024-04-05 22:41:05,015: INFO/ForkPoolWorker-5] Connected to database osm version 1.2 2024-04-05T22:41:05.016903614Z [2024-04-05 22:41:05,016: INFO/ForkPoolWorker-5] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:41:05.017005288Z [2024-04-05 22:41:05,016: INFO/ForkPoolWorker-5] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:41:05.017265337Z [2024-04-05 22:41:05,017: INFO/ForkPoolWorker-5] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T22:41:05.017426962Z [2024-04-05 22:41:05,017: INFO/ForkPoolWorker-5] Getting VIM list OK 2024-04-05T22:41:05.017835792Z [2024-04-05 22:41:05,017: INFO/ForkPoolWorker-5] VIM type 'dummy' not supported for collecting VM status 2024-04-05T22:41:05.017935016Z [2024-04-05 22:41:05,017: INFO/ForkPoolWorker-5] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:41:05.025314080Z [2024-04-05 22:41:05,025: WARNING/ForkPoolWorker-5] Dag 'vm_status_vim_731a3fa9-cb91-432b-ada3-b20941b99dab' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T22:41:05.026267905Z [2024-04-05 22:41:05,025: INFO/ForkPoolWorker-5] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T22:41:05.027166702Z [2024-04-05 22:41:05,027: INFO/ForkPoolWorker-5] Getting VIM list 2024-04-05T22:41:05.030395308Z [2024-04-05 22:41:05,030: INFO/ForkPoolWorker-5] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:41:05.075541120Z [2024-04-05 22:41:05,075: INFO/ForkPoolWorker-5] Connected to database osm version 1.2 2024-04-05T22:41:05.076846694Z [2024-04-05 22:41:05,076: INFO/ForkPoolWorker-5] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:41:05.076899072Z [2024-04-05 22:41:05,076: INFO/ForkPoolWorker-5] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:41:05.077073265Z [2024-04-05 22:41:05,076: INFO/ForkPoolWorker-5] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T22:41:05.077121946Z [2024-04-05 22:41:05,077: INFO/ForkPoolWorker-5] Getting VIM list OK 2024-04-05T22:41:05.077345959Z [2024-04-05 22:41:05,077: INFO/ForkPoolWorker-5] VIM type 'dummy' not supported for collecting VM status 2024-04-05T22:41:05.077410289Z [2024-04-05 22:41:05,077: INFO/ForkPoolWorker-5] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:41:05.081453131Z [2024-04-05 22:41:05,080: ERROR/ForkPoolWorker-5] [132f9fb8-e19d-4101-b592-b9d3fd41ee59] Failed to execute task Dag 'vm_status_vim_731a3fa9-cb91-432b-ada3-b20941b99dab' could not be found; either it does not exist or it failed to parse.. 2024-04-05T22:41:05.081466680Z Traceback (most recent call last): 2024-04-05T22:41:05.081470694Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-05T22:41:05.081474856Z args.func(args) 2024-04-05T22:41:05.081478562Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-05T22:41:05.081481863Z return func(*args, **kwargs) 2024-04-05T22:41:05.081484891Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-05T22:41:05.081488151Z return f(*args, **kwargs) 2024-04-05T22:41:05.081491190Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-05T22:41:05.081494559Z dag = get_dag(args.subdir, args.dag_id) 2024-04-05T22:41:05.081497540Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-05T22:41:05.081500598Z raise AirflowException( 2024-04-05T22:41:05.081504391Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_731a3fa9-cb91-432b-ada3-b20941b99dab' could not be found; either it does not exist or it failed to parse. 2024-04-05T22:41:05.125363852Z [2024-04-05 22:41:05,124: ERROR/ForkPoolWorker-5] Task airflow.executors.celery_executor.execute_command[132f9fb8-e19d-4101-b592-b9d3fd41ee59] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 132f9fb8-e19d-4101-b592-b9d3fd41ee59') 2024-04-05T22:41:05.125393529Z Traceback (most recent call last): 2024-04-05T22:41:05.125398163Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-05T22:41:05.125400992Z R = retval = fun(*args, **kwargs) 2024-04-05T22:41:05.125404157Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-05T22:41:05.125406968Z return self.run(*args, **kwargs) 2024-04-05T22:41:05.125410476Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-05T22:41:05.125414319Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-05T22:41:05.125417175Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-05T22:41:05.125420278Z raise AirflowException(msg) 2024-04-05T22:41:05.125424039Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 132f9fb8-e19d-4101-b592-b9d3fd41ee59 2024-04-05T22:41:05.171847713Z [2024-04-05 22:41:05,171: INFO/ForkPoolWorker-4] Getting VIM list 2024-04-05T22:41:05.175557091Z [2024-04-05 22:41:05,174: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:41:05.206063574Z [2024-04-05 22:41:05,205: INFO/ForkPoolWorker-4] Connected to database osm version 1.2 2024-04-05T22:41:05.207899019Z [2024-04-05 22:41:05,207: INFO/ForkPoolWorker-4] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:41:05.208063796Z [2024-04-05 22:41:05,207: INFO/ForkPoolWorker-4] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:41:05.208338845Z [2024-04-05 22:41:05,208: INFO/ForkPoolWorker-4] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T22:41:05.208526357Z [2024-04-05 22:41:05,208: INFO/ForkPoolWorker-4] Getting VIM list OK 2024-04-05T22:41:05.208858793Z [2024-04-05 22:41:05,208: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T22:41:05.209068688Z [2024-04-05 22:41:05,208: INFO/ForkPoolWorker-4] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:41:05.218165851Z [2024-04-05 22:41:05,217: WARNING/ForkPoolWorker-4] Dag 'vim_status_731a3fa9-cb91-432b-ada3-b20941b99dab' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T22:41:05.219050222Z [2024-04-05 22:41:05,218: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T22:41:05.222106658Z [2024-04-05 22:41:05,221: INFO/ForkPoolWorker-4] Getting VIM list 2024-04-05T22:41:05.226311947Z [2024-04-05 22:41:05,225: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:41:05.266611214Z [2024-04-05 22:41:05,266: INFO/ForkPoolWorker-4] Connected to database osm version 1.2 2024-04-05T22:41:05.270430938Z [2024-04-05 22:41:05,270: INFO/ForkPoolWorker-4] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:41:05.270592179Z [2024-04-05 22:41:05,270: INFO/ForkPoolWorker-4] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:41:05.270880334Z [2024-04-05 22:41:05,270: INFO/ForkPoolWorker-4] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T22:41:05.271122748Z [2024-04-05 22:41:05,270: INFO/ForkPoolWorker-4] Getting VIM list OK 2024-04-05T22:41:05.271504618Z [2024-04-05 22:41:05,271: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T22:41:05.271807485Z [2024-04-05 22:41:05,271: INFO/ForkPoolWorker-4] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:41:05.275782774Z [2024-04-05 22:41:05,274: ERROR/ForkPoolWorker-4] [f93a4fc6-e497-4aa2-a973-a0ba32df9e3f] Failed to execute task Dag 'vim_status_731a3fa9-cb91-432b-ada3-b20941b99dab' could not be found; either it does not exist or it failed to parse.. 2024-04-05T22:41:05.275794423Z Traceback (most recent call last): 2024-04-05T22:41:05.275798633Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-05T22:41:05.275802973Z args.func(args) 2024-04-05T22:41:05.275806984Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-05T22:41:05.275810581Z return func(*args, **kwargs) 2024-04-05T22:41:05.275814212Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-05T22:41:05.275832311Z return f(*args, **kwargs) 2024-04-05T22:41:05.275836140Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-05T22:41:05.275839664Z dag = get_dag(args.subdir, args.dag_id) 2024-04-05T22:41:05.275843212Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-05T22:41:05.275846265Z raise AirflowException( 2024-04-05T22:41:05.275854313Z airflow.exceptions.AirflowException: Dag 'vim_status_731a3fa9-cb91-432b-ada3-b20941b99dab' could not be found; either it does not exist or it failed to parse. 2024-04-05T22:41:05.337980984Z [2024-04-05 22:41:05,337: ERROR/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[f93a4fc6-e497-4aa2-a973-a0ba32df9e3f] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id f93a4fc6-e497-4aa2-a973-a0ba32df9e3f') 2024-04-05T22:41:05.338003746Z Traceback (most recent call last): 2024-04-05T22:41:05.338007793Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-05T22:41:05.338010876Z R = retval = fun(*args, **kwargs) 2024-04-05T22:41:05.338013893Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-05T22:41:05.338017196Z return self.run(*args, **kwargs) 2024-04-05T22:41:05.338020834Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-05T22:41:05.338024388Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-05T22:41:05.338027644Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-05T22:41:05.338031684Z raise AirflowException(msg) 2024-04-05T22:41:05.338056366Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id f93a4fc6-e497-4aa2-a973-a0ba32df9e3f 2024-04-05T22:41:05.466471159Z [2024-04-05 22:41:05,466: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-05T22:41:05.469325311Z [2024-04-05 22:41:05,468: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:41:05.500957520Z [2024-04-05 22:41:05,500: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-05T22:41:05.502663969Z [2024-04-05 22:41:05,502: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:41:05.502760632Z [2024-04-05 22:41:05,502: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:41:05.503050413Z [2024-04-05 22:41:05,502: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T22:41:05.503095535Z [2024-04-05 22:41:05,502: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-05T22:41:05.503499145Z [2024-04-05 22:41:05,503: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-05T22:41:05.503683296Z [2024-04-05 22:41:05,503: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:41:05.586723915Z [2024-04-05 22:41:05,586: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:41:06.926657117Z [2024-04-05 22:41:06,926: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6674ec70-14b8-40f5-a112-a93ceda95d62] succeeded in 5.71711571600008s: None 2024-04-05T22:41:07.770059322Z [2024-04-05 22:41:07,769: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[bda6b19f-46de-4217-8499-bd4b02ce2f1f] succeeded in 6.543149224999979s: None 2024-04-05T22:42:00.518543071Z [2024-04-05 22:42:00,518: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b9ea3b03-bfab-42a3-87e5-ffa410c157c9] received 2024-04-05T22:42:00.521347345Z [2024-04-05 22:42:00,521: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6bd921e9-9100-4653-8dc1-084f7244dd10] received 2024-04-05T22:42:00.527805185Z [2024-04-05 22:42:00,527: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[13c42c4c-39dd-41d6-88c3-7173ba074748] received 2024-04-05T22:42:00.529477943Z [2024-04-05 22:42:00,529: INFO/ForkPoolWorker-15] [b9ea3b03-bfab-42a3-87e5-ffa410c157c9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T22:42:00.531645805Z [2024-04-05 22:42:00,531: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[be77835b-ecb4-4e6a-88fc-c895c2324493] received 2024-04-05T22:42:00.535974923Z [2024-04-05 22:42:00,535: INFO/ForkPoolWorker-1] [13c42c4c-39dd-41d6-88c3-7173ba074748] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T22:42:00.539784435Z [2024-04-05 22:42:00,539: INFO/ForkPoolWorker-16] [6bd921e9-9100-4653-8dc1-084f7244dd10] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T22:42:00.543899767Z [2024-04-05 22:42:00,543: INFO/ForkPoolWorker-2] [be77835b-ecb4-4e6a-88fc-c895c2324493] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T22:42:00.870759181Z [2024-04-05 22:42:00,854: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-05T22:42:00.875775832Z [2024-04-05 22:42:00,872: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T22:42:00.944422368Z [2024-04-05 22:42:00,939: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T22:42:01.012869082Z [2024-04-05 22:42:01,008: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-05T22:42:01.155865953Z [2024-04-05 22:42:01,155: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:42:01.191048529Z [2024-04-05 22:42:01,190: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-05T22:42:01.195088784Z [2024-04-05 22:42:01,194: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:42:01.244601855Z [2024-04-05 22:42:01,244: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-05T22:42:01.248206983Z [2024-04-05 22:42:01,247: INFO/ForkPoolWorker-2] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-05T22:42:01.248293430Z [2024-04-05 22:42:01,248: INFO/ForkPoolWorker-2] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-05T22:42:01.248357987Z [2024-04-05 22:42:01,248: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-05T22:42:01.248601692Z [2024-04-05 22:42:01,248: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-05T22:42:01.409304553Z [2024-04-05 22:42:01,409: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:42:01.710333263Z [2024-04-05 22:42:01,709: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[13c42c4c-39dd-41d6-88c3-7173ba074748] succeeded in 1.1807856000000356s: None 2024-04-05T22:42:02.076458689Z [2024-04-05 22:42:02,076: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[be77835b-ecb4-4e6a-88fc-c895c2324493] succeeded in 1.5412030380000488s: None 2024-04-05T22:42:02.192604048Z [2024-04-05 22:42:02,191: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-05T22:42:02.195979114Z [2024-04-05 22:42:02,195: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:42:02.221122742Z [2024-04-05 22:42:02,220: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T22:42:02.222849617Z [2024-04-05 22:42:02,222: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:42:02.223022091Z [2024-04-05 22:42:02,222: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:42:02.223333361Z [2024-04-05 22:42:02,222: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T22:42:02.223590287Z [2024-04-05 22:42:02,223: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-05T22:42:02.224347418Z [2024-04-05 22:42:02,223: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T22:42:02.224569894Z [2024-04-05 22:42:02,224: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:42:02.296528200Z [2024-04-05 22:42:02,296: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T22:42:02.299775461Z [2024-04-05 22:42:02,299: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:42:02.318973604Z [2024-04-05 22:42:02,318: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T22:42:02.319405700Z [2024-04-05 22:42:02,319: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:42:02.320339912Z [2024-04-05 22:42:02,320: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:42:02.320474864Z [2024-04-05 22:42:02,320: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:42:02.320714360Z [2024-04-05 22:42:02,320: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T22:42:02.320785676Z [2024-04-05 22:42:02,320: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T22:42:02.321091442Z [2024-04-05 22:42:02,320: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-05T22:42:02.321103986Z [2024-04-05 22:42:02,321: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:42:02.412785570Z [2024-04-05 22:42:02,412: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:42:03.909382237Z [2024-04-05 22:42:03,908: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6bd921e9-9100-4653-8dc1-084f7244dd10] succeeded in 3.3857884999999897s: None 2024-04-05T22:42:04.389173561Z [2024-04-05 22:42:04,388: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b9ea3b03-bfab-42a3-87e5-ffa410c157c9] succeeded in 3.8671198480001294s: None 2024-04-05T22:43:01.051701573Z [2024-04-05 22:43:01,051: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a5a9fccd-2231-4e82-870b-d720d11f1a23] received 2024-04-05T22:43:01.058547175Z [2024-04-05 22:43:01,058: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a1e18d49-513a-4a41-b12c-9d2cebc2a7ae] received 2024-04-05T22:43:01.068420245Z [2024-04-05 22:43:01,068: INFO/ForkPoolWorker-16] [a1e18d49-513a-4a41-b12c-9d2cebc2a7ae] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T22:43:01.071269286Z [2024-04-05 22:43:01,071: INFO/ForkPoolWorker-15] [a5a9fccd-2231-4e82-870b-d720d11f1a23] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T22:43:01.077871290Z [2024-04-05 22:43:01,077: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[62fe4eae-7ca7-44de-9ae2-82d7d7ffd8c9] received 2024-04-05T22:43:01.092491533Z [2024-04-05 22:43:01,092: INFO/ForkPoolWorker-1] [62fe4eae-7ca7-44de-9ae2-82d7d7ffd8c9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T22:43:01.425603915Z [2024-04-05 22:43:01,421: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T22:43:01.803765215Z [2024-04-05 22:43:01,797: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T22:43:02.171474589Z [2024-04-05 22:43:02,159: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-05T22:43:02.586763523Z [2024-04-05 22:43:02,586: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-05T22:43:02.604857992Z [2024-04-05 22:43:02,604: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:43:02.658462966Z [2024-04-05 22:43:02,658: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T22:43:02.659902057Z [2024-04-05 22:43:02,659: INFO/ForkPoolWorker-15] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-05T22:43:02.660176654Z [2024-04-05 22:43:02,659: INFO/ForkPoolWorker-15] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-05T22:43:02.660301979Z [2024-04-05 22:43:02,660: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-05T22:43:02.660592958Z [2024-04-05 22:43:02,660: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-05T22:43:02.787856875Z [2024-04-05 22:43:02,787: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:43:02.965321664Z [2024-04-05 22:43:02,964: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-05T22:43:02.970192976Z [2024-04-05 22:43:02,969: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:43:02.994517681Z [2024-04-05 22:43:02,994: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T22:43:02.997133419Z [2024-04-05 22:43:02,995: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:43:02.997160859Z [2024-04-05 22:43:02,995: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:43:02.997165973Z [2024-04-05 22:43:02,995: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T22:43:02.997170001Z [2024-04-05 22:43:02,996: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-05T22:43:02.997173203Z [2024-04-05 22:43:02,996: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-05T22:43:02.997176405Z [2024-04-05 22:43:02,996: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:43:03.105220357Z [2024-04-05 22:43:03,104: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:43:03.564785401Z [2024-04-05 22:43:03,564: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a5a9fccd-2231-4e82-870b-d720d11f1a23] succeeded in 2.5082593850002013s: None 2024-04-05T22:43:03.681016002Z [2024-04-05 22:43:03,678: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-05T22:43:03.687392103Z [2024-04-05 22:43:03,686: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:43:03.783915658Z [2024-04-05 22:43:03,759: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-05T22:43:03.783933725Z [2024-04-05 22:43:03,760: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:43:03.783937337Z [2024-04-05 22:43:03,760: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:43:03.783941483Z [2024-04-05 22:43:03,760: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T22:43:03.783945426Z [2024-04-05 22:43:03,760: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-05T22:43:03.783948610Z [2024-04-05 22:43:03,761: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T22:43:03.783952204Z [2024-04-05 22:43:03,761: INFO/ForkPoolWorker-1] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:43:03.902340960Z [2024-04-05 22:43:03,902: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:43:05.500056373Z [2024-04-05 22:43:05,499: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a1e18d49-513a-4a41-b12c-9d2cebc2a7ae] succeeded in 4.438512484000057s: None 2024-04-05T22:43:06.129593129Z [2024-04-05 22:43:06,128: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[62fe4eae-7ca7-44de-9ae2-82d7d7ffd8c9] succeeded in 5.048559739999973s: None 2024-04-05T22:44:00.297234543Z [2024-04-05 22:44:00,296: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[51ab1e17-4ea0-4ec8-a92d-d1afddf8b7c8] received 2024-04-05T22:44:00.299944248Z [2024-04-05 22:44:00,299: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[01c25b42-e32b-418f-a06a-2154a9cf717c] received 2024-04-05T22:44:00.305508024Z [2024-04-05 22:44:00,305: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ece4709f-026a-4b40-b4ba-b83b76950ea5] received 2024-04-05T22:44:00.313236828Z [2024-04-05 22:44:00,312: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[25c2dd09-090b-47b1-b5b8-c8490b29996d] received 2024-04-05T22:44:00.318462159Z [2024-04-05 22:44:00,318: INFO/ForkPoolWorker-16] [01c25b42-e32b-418f-a06a-2154a9cf717c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T22:44:00.320825888Z [2024-04-05 22:44:00,320: INFO/ForkPoolWorker-15] [51ab1e17-4ea0-4ec8-a92d-d1afddf8b7c8] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T22:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T22:44:00.326927517Z [2024-04-05 22:44:00,326: INFO/ForkPoolWorker-1] [ece4709f-026a-4b40-b4ba-b83b76950ea5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T22:44:00.332048988Z [2024-04-05 22:44:00,331: INFO/ForkPoolWorker-2] [25c2dd09-090b-47b1-b5b8-c8490b29996d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T22:44:00.638452860Z [2024-04-05 22:44:00,634: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T22:44:00.657762239Z [2024-04-05 22:44:00,654: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T22:44:00.658910116Z [2024-04-05 22:44:00,654: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-05T22:44:00.799641428Z [2024-04-05 22:44:00,786: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-05T22:44:00.930618746Z [2024-04-05 22:44:00,930: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:44:01.012287886Z [2024-04-05 22:44:01,011: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-05T22:44:01.016925873Z [2024-04-05 22:44:01,016: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:44:01.059655439Z [2024-04-05 22:44:01,059: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-05T22:44:01.061111780Z [2024-04-05 22:44:01,060: INFO/ForkPoolWorker-2] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-05T22:44:01.061158217Z [2024-04-05 22:44:01,061: INFO/ForkPoolWorker-2] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-05T22:44:01.061199283Z [2024-04-05 22:44:01,061: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-05T22:44:01.061413727Z [2024-04-05 22:44:01,061: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-05T22:44:01.245509422Z [2024-04-05 22:44:01,245: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:44:01.824642205Z [2024-04-05 22:44:01,824: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[51ab1e17-4ea0-4ec8-a92d-d1afddf8b7c8] succeeded in 1.5227542299999186s: None 2024-04-05T22:44:02.077455843Z [2024-04-05 22:44:02,077: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-05T22:44:02.081136155Z [2024-04-05 22:44:02,080: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:44:02.102555542Z [2024-04-05 22:44:02,102: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[25c2dd09-090b-47b1-b5b8-c8490b29996d] succeeded in 1.784384073999945s: None 2024-04-05T22:44:02.109175007Z [2024-04-05 22:44:02,108: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T22:44:02.110392369Z [2024-04-05 22:44:02,110: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:44:02.110530387Z [2024-04-05 22:44:02,110: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:44:02.110718582Z [2024-04-05 22:44:02,110: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T22:44:02.110798043Z [2024-04-05 22:44:02,110: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-05T22:44:02.111113343Z [2024-04-05 22:44:02,110: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T22:44:02.111442077Z [2024-04-05 22:44:02,111: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:44:02.228455994Z [2024-04-05 22:44:02,228: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:44:02.285512879Z [2024-04-05 22:44:02,284: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-05T22:44:02.289931937Z [2024-04-05 22:44:02,289: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:44:02.324976738Z [2024-04-05 22:44:02,324: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-05T22:44:02.326324707Z [2024-04-05 22:44:02,326: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:44:02.326335021Z [2024-04-05 22:44:02,326: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:44:02.326417538Z [2024-04-05 22:44:02,326: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T22:44:02.326477709Z [2024-04-05 22:44:02,326: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-05T22:44:02.326706050Z [2024-04-05 22:44:02,326: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-05T22:44:02.326745448Z [2024-04-05 22:44:02,326: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:44:02.421783526Z [2024-04-05 22:44:02,421: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:44:03.811964741Z [2024-04-05 22:44:03,811: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[01c25b42-e32b-418f-a06a-2154a9cf717c] succeeded in 3.506798099000207s: None 2024-04-05T22:44:04.370708473Z [2024-04-05 22:44:04,369: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ece4709f-026a-4b40-b4ba-b83b76950ea5] succeeded in 4.052599751999878s: None 2024-04-05T22:45:00.894832253Z [2024-04-05 22:45:00,894: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a3a1ced4-d6b3-4e10-b796-e1c2c1a9511e] received 2024-04-05T22:45:00.898762337Z [2024-04-05 22:45:00,898: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5768d5c1-889d-482f-b435-d0f112c21676] received 2024-04-05T22:45:00.927772944Z [2024-04-05 22:45:00,927: INFO/ForkPoolWorker-15] [a3a1ced4-d6b3-4e10-b796-e1c2c1a9511e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T22:45:00.928604819Z [2024-04-05 22:45:00,928: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ccda257b-8449-422c-939e-386d9ce1c3b8] received 2024-04-05T22:45:00.950905239Z [2024-04-05 22:45:00,950: INFO/ForkPoolWorker-1] [ccda257b-8449-422c-939e-386d9ce1c3b8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T22:45:00.959301527Z [2024-04-05 22:45:00,959: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[66ac61d8-8c5a-49b4-9a25-790c76bac1fa] received 2024-04-05T22:45:00.966214477Z [2024-04-05 22:45:00,965: INFO/ForkPoolWorker-16] [5768d5c1-889d-482f-b435-d0f112c21676] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T22:45:01.040269087Z [2024-04-05 22:45:01,039: INFO/ForkPoolWorker-2] [66ac61d8-8c5a-49b4-9a25-790c76bac1fa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T22:45:01.304939656Z [2024-04-05 22:45:01,298: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T22:45:01.377961849Z [2024-04-05 22:45:01,373: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T22:45:01.495032607Z [2024-04-05 22:45:01,491: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-05T22:45:01.720191367Z [2024-04-05 22:45:01,715: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T22:45:01.822228195Z [2024-04-05 22:45:01,821: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-05T22:45:01.829862114Z [2024-04-05 22:45:01,829: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:45:01.859703966Z [2024-04-05 22:45:01,859: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T22:45:01.860999765Z [2024-04-05 22:45:01,860: INFO/ForkPoolWorker-16] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-05T22:45:01.861330751Z [2024-04-05 22:45:01,861: INFO/ForkPoolWorker-16] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-05T22:45:01.861496778Z [2024-04-05 22:45:01,861: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-05T22:45:01.861838138Z [2024-04-05 22:45:01,861: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-05T22:45:01.961411663Z [2024-04-05 22:45:01,961: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:45:02.783756161Z [2024-04-05 22:45:02,783: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5768d5c1-889d-482f-b435-d0f112c21676] succeeded in 1.8786941440000646s: None 2024-04-05T22:45:03.540559636Z [2024-04-05 22:45:03,540: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-05T22:45:03.544194730Z [2024-04-05 22:45:03,543: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:45:03.591359345Z [2024-04-05 22:45:03,588: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-05T22:45:03.598169588Z [2024-04-05 22:45:03,597: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:45:03.620742583Z [2024-04-05 22:45:03,619: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T22:45:03.627891736Z [2024-04-05 22:45:03,627: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-05T22:45:03.628675338Z [2024-04-05 22:45:03,628: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:45:03.631607979Z [2024-04-05 22:45:03,631: INFO/ForkPoolWorker-2] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:45:03.631881765Z [2024-04-05 22:45:03,631: INFO/ForkPoolWorker-2] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:45:03.632168835Z [2024-04-05 22:45:03,631: INFO/ForkPoolWorker-2] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T22:45:03.632702916Z [2024-04-05 22:45:03,632: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-05T22:45:03.633084492Z [2024-04-05 22:45:03,632: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T22:45:03.633258073Z [2024-04-05 22:45:03,633: INFO/ForkPoolWorker-2] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:45:03.661867461Z [2024-04-05 22:45:03,655: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-05T22:45:03.664873622Z [2024-04-05 22:45:03,664: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:45:03.664921344Z [2024-04-05 22:45:03,664: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:45:03.665010778Z [2024-04-05 22:45:03,664: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T22:45:03.665050934Z [2024-04-05 22:45:03,664: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-05T22:45:03.666856902Z [2024-04-05 22:45:03,666: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-05T22:45:03.666866213Z [2024-04-05 22:45:03,666: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:45:03.726700480Z [2024-04-05 22:45:03,720: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T22:45:03.726711660Z [2024-04-05 22:45:03,722: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:45:03.726715446Z [2024-04-05 22:45:03,722: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:45:03.726720104Z [2024-04-05 22:45:03,722: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T22:45:03.726724112Z [2024-04-05 22:45:03,725: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T22:45:03.731471972Z [2024-04-05 22:45:03,726: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T22:45:03.731496166Z [2024-04-05 22:45:03,729: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:45:03.860238654Z [2024-04-05 22:45:03,859: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:45:03.951871796Z [2024-04-05 22:45:03,949: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:45:03.956061877Z [2024-04-05 22:45:03,955: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:45:04.939762310Z [2024-04-05 22:45:04,939: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cc142b2a-6576-4d3c-92b2-c0a8d7e8f72f] received 2024-04-05T22:45:04.949526427Z [2024-04-05 22:45:04,949: INFO/ForkPoolWorker-16] [cc142b2a-6576-4d3c-92b2-c0a8d7e8f72f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'split_metrics', 'scheduled__2024-04-05T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T22:45:05.046875100Z [2024-04-05 22:45:05,046: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a3a1ced4-d6b3-4e10-b796-e1c2c1a9511e] succeeded in 4.139356140000018s: None 2024-04-05T22:45:05.265861406Z [2024-04-05 22:45:05,262: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T22:45:05.774316361Z [2024-04-05 22:45:05,773: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[66ac61d8-8c5a-49b4-9a25-790c76bac1fa] succeeded in 4.761232708999842s: None 2024-04-05T22:45:06.213900064Z [2024-04-05 22:45:06,213: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ccda257b-8449-422c-939e-386d9ce1c3b8] succeeded in 5.281595509999988s: None 2024-04-05T22:45:06.527201965Z [2024-04-05 22:45:06,526: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-05T22:45:06.530793084Z [2024-04-05 22:45:06,530: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:45:06.559825863Z [2024-04-05 22:45:06,559: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T22:45:06.561341100Z [2024-04-05 22:45:06,561: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:45:06.561618143Z [2024-04-05 22:45:06,561: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:45:06.561784957Z [2024-04-05 22:45:06,561: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T22:45:06.561855663Z [2024-04-05 22:45:06,561: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-05T22:45:06.562116169Z [2024-04-05 22:45:06,562: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T22:45:06.562486110Z [2024-04-05 22:45:06,562: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:45:06.653671964Z [2024-04-05 22:45:06,653: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:45:07.305666796Z [2024-04-05 22:45:07,305: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[cc142b2a-6576-4d3c-92b2-c0a8d7e8f72f] succeeded in 2.362441740000122s: None 2024-04-05T22:45:07.696024513Z [2024-04-05 22:45:07,695: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[386daf13-87fd-4017-98ad-140bdb323b2e] received 2024-04-05T22:45:07.707822769Z [2024-04-05 22:45:07,707: INFO/ForkPoolWorker-15] [386daf13-87fd-4017-98ad-140bdb323b2e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'collect_metrics', 'scheduled__2024-04-05T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T22:45:08.001229282Z [2024-04-05 22:45:07,998: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T22:45:09.292805683Z [2024-04-05 22:45:09,292: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T22:45:09.296194822Z [2024-04-05 22:45:09,295: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:45:09.318567548Z [2024-04-05 22:45:09,318: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T22:45:09.319937872Z [2024-04-05 22:45:09,319: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:45:09.320012220Z [2024-04-05 22:45:09,319: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:45:09.320017013Z [2024-04-05 22:45:09,319: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T22:45:09.320021119Z [2024-04-05 22:45:09,319: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T22:45:09.320238324Z [2024-04-05 22:45:09,320: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T22:45:09.320246689Z [2024-04-05 22:45:09,320: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:45:09.413826783Z [2024-04-05 22:45:09,413: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:45:09.900884541Z [2024-04-05 22:45:09,900: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[041a2db2-e91a-4764-bc07-005dbd2eecba] received 2024-04-05T22:45:09.913440867Z [2024-04-05 22:45:09,913: INFO/ForkPoolWorker-16] [041a2db2-e91a-4764-bc07-005dbd2eecba] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'send_prometheus', 'scheduled__2024-04-05T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T22:45:10.172861720Z [2024-04-05 22:45:10,170: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[386daf13-87fd-4017-98ad-140bdb323b2e] succeeded in 2.472186228000055s: None 2024-04-05T22:45:10.355866533Z [2024-04-05 22:45:10,352: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T22:45:11.573394941Z [2024-04-05 22:45:11,573: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-05T22:45:11.577126454Z [2024-04-05 22:45:11,576: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:45:11.611841016Z [2024-04-05 22:45:11,611: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T22:45:11.615840876Z [2024-04-05 22:45:11,615: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:45:11.616288239Z [2024-04-05 22:45:11,616: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:45:11.616608964Z [2024-04-05 22:45:11,616: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T22:45:11.616840668Z [2024-04-05 22:45:11,616: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-05T22:45:11.617322732Z [2024-04-05 22:45:11,617: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T22:45:11.617435479Z [2024-04-05 22:45:11,617: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:45:11.708197595Z [2024-04-05 22:45:11,707: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:45:12.390700860Z [2024-04-05 22:45:12,390: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[041a2db2-e91a-4764-bc07-005dbd2eecba] succeeded in 2.4857512460000635s: None 2024-04-05T22:46:00.907697702Z [2024-04-05 22:46:00,906: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5f7eff81-ef1c-4c97-9461-63cad3938f72] received 2024-04-05T22:46:00.911873229Z [2024-04-05 22:46:00,911: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3788ceb9-b23f-469f-ad42-4d23de05cf47] received 2024-04-05T22:46:00.914930241Z [2024-04-05 22:46:00,914: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[56292abd-0218-455f-b69f-510dc413cf97] received 2024-04-05T22:46:00.918324819Z [2024-04-05 22:46:00,918: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4adeabea-04fb-479d-b704-4869dd296868] received 2024-04-05T22:46:00.932191901Z [2024-04-05 22:46:00,931: INFO/ForkPoolWorker-15] [5f7eff81-ef1c-4c97-9461-63cad3938f72] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T22:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T22:46:00.935771512Z [2024-04-05 22:46:00,934: INFO/ForkPoolWorker-2] [4adeabea-04fb-479d-b704-4869dd296868] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T22:46:00.938271873Z [2024-04-05 22:46:00,937: INFO/ForkPoolWorker-16] [3788ceb9-b23f-469f-ad42-4d23de05cf47] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T22:46:00.943134751Z [2024-04-05 22:46:00,942: INFO/ForkPoolWorker-1] [56292abd-0218-455f-b69f-510dc413cf97] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T22:46:01.318127807Z [2024-04-05 22:46:01,310: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T22:46:01.336787156Z [2024-04-05 22:46:01,332: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-05T22:46:01.360343348Z [2024-04-05 22:46:01,342: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-05T22:46:01.424487638Z [2024-04-05 22:46:01,420: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T22:46:01.536353888Z [2024-04-05 22:46:01,535: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-05T22:46:01.540521682Z [2024-04-05 22:46:01,540: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:46:01.575876772Z [2024-04-05 22:46:01,575: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-05T22:46:01.579571751Z [2024-04-05 22:46:01,579: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-05T22:46:01.579764438Z [2024-04-05 22:46:01,579: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-05T22:46:01.579808142Z [2024-04-05 22:46:01,579: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-05T22:46:01.580129901Z [2024-04-05 22:46:01,579: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-05T22:46:01.608087114Z [2024-04-05 22:46:01,607: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:46:01.697339078Z [2024-04-05 22:46:01,697: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:46:02.289090359Z [2024-04-05 22:46:02,288: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5f7eff81-ef1c-4c97-9461-63cad3938f72] succeeded in 1.3759557040000345s: None 2024-04-05T22:46:02.412373603Z [2024-04-05 22:46:02,411: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[56292abd-0218-455f-b69f-510dc413cf97] succeeded in 1.4914611599999716s: None 2024-04-05T22:46:02.780178667Z [2024-04-05 22:46:02,779: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-05T22:46:02.784068212Z [2024-04-05 22:46:02,783: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:46:02.812843136Z [2024-04-05 22:46:02,812: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T22:46:02.814307534Z [2024-04-05 22:46:02,814: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:46:02.814510143Z [2024-04-05 22:46:02,814: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:46:02.814775335Z [2024-04-05 22:46:02,814: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T22:46:02.814927547Z [2024-04-05 22:46:02,814: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-05T22:46:02.815339132Z [2024-04-05 22:46:02,815: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T22:46:02.815515051Z [2024-04-05 22:46:02,815: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:46:02.909193412Z [2024-04-05 22:46:02,908: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:46:02.972730971Z [2024-04-05 22:46:02,972: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-05T22:46:02.976115544Z [2024-04-05 22:46:02,975: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:46:03.000477585Z [2024-04-05 22:46:03,000: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-05T22:46:03.007628194Z [2024-04-05 22:46:03,006: INFO/ForkPoolWorker-2] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:46:03.008196599Z [2024-04-05 22:46:03,007: INFO/ForkPoolWorker-2] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:46:03.008672299Z [2024-04-05 22:46:03,008: INFO/ForkPoolWorker-2] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T22:46:03.009129805Z [2024-04-05 22:46:03,008: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-05T22:46:03.010080294Z [2024-04-05 22:46:03,009: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-05T22:46:03.010639263Z [2024-04-05 22:46:03,010: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:46:03.117230154Z [2024-04-05 22:46:03,116: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:46:04.899905528Z [2024-04-05 22:46:04,899: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3788ceb9-b23f-469f-ad42-4d23de05cf47] succeeded in 3.986038731000008s: None 2024-04-05T22:46:05.287228613Z [2024-04-05 22:46:05,286: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[4adeabea-04fb-479d-b704-4869dd296868] succeeded in 4.36692382199999s: None 2024-04-05T22:47:00.695069587Z [2024-04-05 22:47:00,694: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6bacea6a-cb27-49f7-8e2d-4ead4bad8045] received 2024-04-05T22:47:00.699940055Z [2024-04-05 22:47:00,699: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[820f9764-f7d6-4833-afa4-63e47c4c4381] received 2024-04-05T22:47:00.702624638Z [2024-04-05 22:47:00,702: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c8b52616-ea21-4f26-ab28-8dfe1cab4845] received 2024-04-05T22:47:00.707444611Z [2024-04-05 22:47:00,707: INFO/ForkPoolWorker-15] [6bacea6a-cb27-49f7-8e2d-4ead4bad8045] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T22:47:00.713542321Z [2024-04-05 22:47:00,712: INFO/ForkPoolWorker-16] [820f9764-f7d6-4833-afa4-63e47c4c4381] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T22:47:00.721108551Z [2024-04-05 22:47:00,720: INFO/ForkPoolWorker-1] [c8b52616-ea21-4f26-ab28-8dfe1cab4845] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T22:47:01.020255507Z [2024-04-05 22:47:01,016: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T22:47:01.058051200Z [2024-04-05 22:47:01,053: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T22:47:01.086621702Z [2024-04-05 22:47:01,082: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-05T22:47:01.256388225Z [2024-04-05 22:47:01,255: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-05T22:47:01.260814165Z [2024-04-05 22:47:01,260: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:47:01.291035952Z [2024-04-05 22:47:01,290: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-05T22:47:01.293789261Z [2024-04-05 22:47:01,293: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-05T22:47:01.294109278Z [2024-04-05 22:47:01,293: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-05T22:47:01.294350974Z [2024-04-05 22:47:01,294: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-05T22:47:01.294942423Z [2024-04-05 22:47:01,294: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-05T22:47:01.434959108Z [2024-04-05 22:47:01,434: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:47:02.022604756Z [2024-04-05 22:47:02,022: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c8b52616-ea21-4f26-ab28-8dfe1cab4845] succeeded in 1.315979845000129s: None 2024-04-05T22:47:02.190643416Z [2024-04-05 22:47:02,190: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-05T22:47:02.193898309Z [2024-04-05 22:47:02,193: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:47:02.211846691Z [2024-04-05 22:47:02,211: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T22:47:02.212871756Z [2024-04-05 22:47:02,212: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:47:02.212881395Z [2024-04-05 22:47:02,212: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:47:02.213000425Z [2024-04-05 22:47:02,212: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T22:47:02.213006097Z [2024-04-05 22:47:02,212: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-05T22:47:02.213204206Z [2024-04-05 22:47:02,213: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-05T22:47:02.213209095Z [2024-04-05 22:47:02,213: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:47:02.312039661Z [2024-04-05 22:47:02,311: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:47:02.329604559Z [2024-04-05 22:47:02,329: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T22:47:02.333017173Z [2024-04-05 22:47:02,332: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:47:02.352818742Z [2024-04-05 22:47:02,352: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T22:47:02.353851156Z [2024-04-05 22:47:02,353: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:47:02.353861648Z [2024-04-05 22:47:02,353: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:47:02.353966234Z [2024-04-05 22:47:02,353: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T22:47:02.354018022Z [2024-04-05 22:47:02,353: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T22:47:02.354280753Z [2024-04-05 22:47:02,354: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T22:47:02.354291061Z [2024-04-05 22:47:02,354: INFO/ForkPoolWorker-15] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:47:02.426162671Z [2024-04-05 22:47:02,425: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:47:03.940841128Z [2024-04-05 22:47:03,940: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6bacea6a-cb27-49f7-8e2d-4ead4bad8045] succeeded in 3.241018691999898s: None 2024-04-05T22:47:04.127883076Z [2024-04-05 22:47:04,127: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[820f9764-f7d6-4833-afa4-63e47c4c4381] succeeded in 3.4248518599999898s: None 2024-04-05T22:48:00.301794431Z [2024-04-05 22:48:00,301: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a46dff70-87d6-4584-9c0b-7841c7f0f588] received 2024-04-05T22:48:00.306482022Z [2024-04-05 22:48:00,306: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3a1b4408-c070-4a72-bf94-741fb90cf364] received 2024-04-05T22:48:00.309403582Z [2024-04-05 22:48:00,309: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[394f90ed-3983-421b-8614-cbeca8f58b43] received 2024-04-05T22:48:00.315269719Z [2024-04-05 22:48:00,314: INFO/ForkPoolWorker-16] [3a1b4408-c070-4a72-bf94-741fb90cf364] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T22:48:00.317476113Z [2024-04-05 22:48:00,317: INFO/ForkPoolWorker-1] [394f90ed-3983-421b-8614-cbeca8f58b43] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T22:48:00.323063476Z [2024-04-05 22:48:00,322: INFO/ForkPoolWorker-15] [a46dff70-87d6-4584-9c0b-7841c7f0f588] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T22:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T22:48:00.324385454Z [2024-04-05 22:48:00,324: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b5198cc8-ca76-41eb-8ac8-61d494c914dd] received 2024-04-05T22:48:00.348058008Z [2024-04-05 22:48:00,347: INFO/ForkPoolWorker-2] [b5198cc8-ca76-41eb-8ac8-61d494c914dd] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T22:48:00.710716496Z [2024-04-05 22:48:00,707: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-05T22:48:00.777622330Z [2024-04-05 22:48:00,773: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-05T22:48:00.864373850Z [2024-04-05 22:48:00,856: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T22:48:00.946692126Z [2024-04-05 22:48:00,943: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T22:48:00.966209693Z [2024-04-05 22:48:00,965: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-05T22:48:00.970998619Z [2024-04-05 22:48:00,970: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:48:00.995026041Z [2024-04-05 22:48:00,994: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-05T22:48:00.997851160Z [2024-04-05 22:48:00,997: INFO/ForkPoolWorker-2] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-05T22:48:00.998097001Z [2024-04-05 22:48:00,997: INFO/ForkPoolWorker-2] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-05T22:48:00.998234763Z [2024-04-05 22:48:00,998: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-05T22:48:00.998526970Z [2024-04-05 22:48:00,998: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-05T22:48:01.030319380Z [2024-04-05 22:48:01,029: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:48:01.144858357Z [2024-04-05 22:48:01,144: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:48:01.689162030Z [2024-04-05 22:48:01,688: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a46dff70-87d6-4584-9c0b-7841c7f0f588] succeeded in 1.380887120000125s: None 2024-04-05T22:48:01.822279658Z [2024-04-05 22:48:01,821: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b5198cc8-ca76-41eb-8ac8-61d494c914dd] succeeded in 1.493081790000133s: None 2024-04-05T22:48:02.242402961Z [2024-04-05 22:48:02,242: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-05T22:48:02.246254379Z [2024-04-05 22:48:02,245: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:48:02.275452318Z [2024-04-05 22:48:02,275: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T22:48:02.277656691Z [2024-04-05 22:48:02,277: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:48:02.277877353Z [2024-04-05 22:48:02,277: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:48:02.278200712Z [2024-04-05 22:48:02,277: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T22:48:02.278434232Z [2024-04-05 22:48:02,278: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-05T22:48:02.278872135Z [2024-04-05 22:48:02,278: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T22:48:02.278986861Z [2024-04-05 22:48:02,278: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:48:02.403000518Z [2024-04-05 22:48:02,402: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:48:02.496989013Z [2024-04-05 22:48:02,496: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-05T22:48:02.500490597Z [2024-04-05 22:48:02,499: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:48:02.528089856Z [2024-04-05 22:48:02,527: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-05T22:48:02.529604422Z [2024-04-05 22:48:02,529: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:48:02.529629165Z [2024-04-05 22:48:02,529: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:48:02.529776008Z [2024-04-05 22:48:02,529: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T22:48:02.529817391Z [2024-04-05 22:48:02,529: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-05T22:48:02.530210730Z [2024-04-05 22:48:02,530: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-05T22:48:02.530268569Z [2024-04-05 22:48:02,530: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:48:02.639507420Z [2024-04-05 22:48:02,638: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:48:03.855826449Z [2024-04-05 22:48:03,855: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3a1b4408-c070-4a72-bf94-741fb90cf364] succeeded in 3.547596723000197s: None 2024-04-05T22:48:04.569193309Z [2024-04-05 22:48:04,568: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[394f90ed-3983-421b-8614-cbeca8f58b43] succeeded in 4.257904936999921s: None 2024-04-05T22:49:00.547423243Z [2024-04-05 22:49:00,543: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bf54dae4-6e0c-45e6-98d9-f3d7ebe3e591] received 2024-04-05T22:49:00.549844481Z [2024-04-05 22:49:00,549: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[46a2cca3-d6fc-4b11-8e60-4d034e4bb1e4] received 2024-04-05T22:49:00.557130880Z [2024-04-05 22:49:00,556: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cfd5d90e-76c1-434b-9eba-4ddb59468458] received 2024-04-05T22:49:00.557958178Z [2024-04-05 22:49:00,557: INFO/ForkPoolWorker-15] [bf54dae4-6e0c-45e6-98d9-f3d7ebe3e591] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T22:49:00.567791017Z [2024-04-05 22:49:00,567: INFO/ForkPoolWorker-16] [46a2cca3-d6fc-4b11-8e60-4d034e4bb1e4] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T22:49:00.576109607Z [2024-04-05 22:49:00,575: INFO/ForkPoolWorker-1] [cfd5d90e-76c1-434b-9eba-4ddb59468458] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T22:49:00.978429480Z [2024-04-05 22:49:00,973: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T22:49:01.008983346Z [2024-04-05 22:49:01,004: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-05T22:49:01.087297761Z [2024-04-05 22:49:01,081: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T22:49:01.186858661Z [2024-04-05 22:49:01,186: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-05T22:49:01.193128714Z [2024-04-05 22:49:01,192: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:49:01.243179627Z [2024-04-05 22:49:01,242: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T22:49:01.247704817Z [2024-04-05 22:49:01,247: INFO/ForkPoolWorker-16] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-05T22:49:01.248105795Z [2024-04-05 22:49:01,247: INFO/ForkPoolWorker-16] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-05T22:49:01.248312478Z [2024-04-05 22:49:01,248: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-05T22:49:01.248678075Z [2024-04-05 22:49:01,248: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-05T22:49:01.501663419Z [2024-04-05 22:49:01,500: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:49:02.550051752Z [2024-04-05 22:49:02,549: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[46a2cca3-d6fc-4b11-8e60-4d034e4bb1e4] succeeded in 1.9974003190000076s: None 2024-04-05T22:49:02.926782342Z [2024-04-05 22:49:02,926: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T22:49:02.930304820Z [2024-04-05 22:49:02,929: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:49:02.992284174Z [2024-04-05 22:49:02,992: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T22:49:03.010865076Z [2024-04-05 22:49:03,010: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:49:03.011333051Z [2024-04-05 22:49:03,010: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:49:03.011570281Z [2024-04-05 22:49:03,011: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T22:49:03.011702791Z [2024-04-05 22:49:03,011: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T22:49:03.012064992Z [2024-04-05 22:49:03,011: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-05T22:49:03.012183022Z [2024-04-05 22:49:03,012: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:49:03.034679133Z [2024-04-05 22:49:03,034: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-05T22:49:03.039628839Z [2024-04-05 22:49:03,039: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:49:03.105024783Z [2024-04-05 22:49:03,104: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-05T22:49:03.108608214Z [2024-04-05 22:49:03,108: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:49:03.108627269Z [2024-04-05 22:49:03,108: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:49:03.108886268Z [2024-04-05 22:49:03,108: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T22:49:03.108893704Z [2024-04-05 22:49:03,108: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-05T22:49:03.108978430Z [2024-04-05 22:49:03,108: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T22:49:03.109045821Z [2024-04-05 22:49:03,108: INFO/ForkPoolWorker-1] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:49:03.235117636Z [2024-04-05 22:49:03,234: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:49:03.239927742Z [2024-04-05 22:49:03,239: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:49:05.912806853Z [2024-04-05 22:49:05,912: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[cfd5d90e-76c1-434b-9eba-4ddb59468458] succeeded in 5.35303197799999s: None 2024-04-05T22:49:07.009600824Z [2024-04-05 22:49:07,009: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bf54dae4-6e0c-45e6-98d9-f3d7ebe3e591] succeeded in 6.460630286999958s: None 2024-04-05T22:50:01.033135027Z [2024-04-05 22:50:01,032: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f34e7e25-9721-4e6c-93b7-157e141c8c49] received 2024-04-05T22:50:01.035952148Z [2024-04-05 22:50:01,035: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3b72cc76-65a7-40cf-9514-bc6894215066] received 2024-04-05T22:50:01.053408833Z [2024-04-05 22:50:01,052: INFO/ForkPoolWorker-15] [f34e7e25-9721-4e6c-93b7-157e141c8c49] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T22:50:01.054315683Z [2024-04-05 22:50:01,053: INFO/ForkPoolWorker-16] [3b72cc76-65a7-40cf-9514-bc6894215066] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T22:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T22:50:01.061193388Z [2024-04-05 22:50:01,060: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ebcedca0-1bc3-4e6b-a0b6-bf6c7289abb8] received 2024-04-05T22:50:01.071025699Z [2024-04-05 22:50:01,070: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fc566fa6-3566-47da-9403-2db35fc7c0e4] received 2024-04-05T22:50:01.074824961Z [2024-04-05 22:50:01,074: INFO/ForkPoolWorker-1] [ebcedca0-1bc3-4e6b-a0b6-bf6c7289abb8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T22:50:01.087759105Z [2024-04-05 22:50:01,087: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f17a877e-3c30-436a-a781-e8247e00bdcb] received 2024-04-05T22:50:01.106835876Z [2024-04-05 22:50:01,106: INFO/ForkPoolWorker-2] [fc566fa6-3566-47da-9403-2db35fc7c0e4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T22:50:01.113618515Z [2024-04-05 22:50:01,112: INFO/ForkPoolWorker-3] [f17a877e-3c30-436a-a781-e8247e00bdcb] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T22:50:01.507092237Z [2024-04-05 22:50:01,503: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T22:50:01.512178157Z [2024-04-05 22:50:01,507: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-05T22:50:01.540277297Z [2024-04-05 22:50:01,536: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T22:50:01.684324205Z [2024-04-05 22:50:01,683: INFO/ForkPoolWorker-3] Getting SDNC list 2024-04-05T22:50:01.688292213Z [2024-04-05 22:50:01,687: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:50:01.700486142Z [2024-04-05 22:50:01,696: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T22:50:01.725154749Z [2024-04-05 22:50:01,724: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-05T22:50:01.727192878Z [2024-04-05 22:50:01,726: INFO/ForkPoolWorker-3] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-05T22:50:01.727641167Z [2024-04-05 22:50:01,727: INFO/ForkPoolWorker-3] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-05T22:50:01.727711385Z [2024-04-05 22:50:01,727: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-04-05T22:50:01.728236313Z [2024-04-05 22:50:01,727: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-05T22:50:01.732599080Z [2024-04-05 22:50:01,729: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-05T22:50:01.891181634Z [2024-04-05 22:50:01,890: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:50:02.313022078Z [2024-04-05 22:50:02,312: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:50:03.296550035Z [2024-04-05 22:50:03,296: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[f17a877e-3c30-436a-a781-e8247e00bdcb] succeeded in 2.2059256089999053s: None 2024-04-05T22:50:03.469134938Z [2024-04-05 22:50:03,468: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3b72cc76-65a7-40cf-9514-bc6894215066] succeeded in 2.427232075999882s: None 2024-04-05T22:50:03.790475995Z [2024-04-05 22:50:03,790: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-05T22:50:03.793959378Z [2024-04-05 22:50:03,793: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:50:03.809800322Z [2024-04-05 22:50:03,809: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-05T22:50:03.813767769Z [2024-04-05 22:50:03,813: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:50:03.825182805Z [2024-04-05 22:50:03,824: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-05T22:50:03.826507540Z [2024-04-05 22:50:03,826: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:50:03.826562852Z [2024-04-05 22:50:03,826: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:50:03.826657478Z [2024-04-05 22:50:03,826: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T22:50:03.826701832Z [2024-04-05 22:50:03,826: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-05T22:50:03.827045760Z [2024-04-05 22:50:03,826: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T22:50:03.827123268Z [2024-04-05 22:50:03,826: INFO/ForkPoolWorker-1] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:50:03.860277205Z [2024-04-05 22:50:03,860: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-05T22:50:03.861530168Z [2024-04-05 22:50:03,861: INFO/ForkPoolWorker-2] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:50:03.861608375Z [2024-04-05 22:50:03,861: INFO/ForkPoolWorker-2] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:50:03.861648119Z [2024-04-05 22:50:03,861: INFO/ForkPoolWorker-2] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T22:50:03.861762551Z [2024-04-05 22:50:03,861: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-05T22:50:03.862053002Z [2024-04-05 22:50:03,861: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-05T22:50:03.862060085Z [2024-04-05 22:50:03,861: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:50:03.932174227Z [2024-04-05 22:50:03,931: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:50:03.976395816Z [2024-04-05 22:50:03,976: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:50:04.013919997Z [2024-04-05 22:50:04,013: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T22:50:04.019720967Z [2024-04-05 22:50:04,019: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:50:04.071000614Z [2024-04-05 22:50:04,070: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T22:50:04.072534511Z [2024-04-05 22:50:04,072: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:50:04.072593376Z [2024-04-05 22:50:04,072: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:50:04.072746364Z [2024-04-05 22:50:04,072: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T22:50:04.072759437Z [2024-04-05 22:50:04,072: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T22:50:04.073175566Z [2024-04-05 22:50:04,072: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T22:50:04.073257131Z [2024-04-05 22:50:04,073: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:50:04.174093050Z [2024-04-05 22:50:04,173: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:50:04.873065983Z [2024-04-05 22:50:04,872: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f34e7e25-9721-4e6c-93b7-157e141c8c49] succeeded in 3.83333807300005s: None 2024-04-05T22:50:05.205084696Z [2024-04-05 22:50:05,204: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[36654437-2048-4716-927a-0b5d1341ef9a] received 2024-04-05T22:50:05.215511493Z [2024-04-05 22:50:05,215: INFO/ForkPoolWorker-15] [36654437-2048-4716-927a-0b5d1341ef9a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'split_metrics', 'scheduled__2024-04-05T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T22:50:05.508490859Z [2024-04-05 22:50:05,505: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T22:50:05.608555928Z [2024-04-05 22:50:05,608: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ebcedca0-1bc3-4e6b-a0b6-bf6c7289abb8] succeeded in 4.545582503000105s: None 2024-04-05T22:50:06.018990986Z [2024-04-05 22:50:06,018: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[fc566fa6-3566-47da-9403-2db35fc7c0e4] succeeded in 4.941415729000028s: None 2024-04-05T22:50:06.766526945Z [2024-04-05 22:50:06,765: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T22:50:06.769888540Z [2024-04-05 22:50:06,769: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:50:06.801426818Z [2024-04-05 22:50:06,801: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T22:50:06.802993366Z [2024-04-05 22:50:06,802: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:50:06.803074733Z [2024-04-05 22:50:06,802: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:50:06.803393749Z [2024-04-05 22:50:06,803: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T22:50:06.803485615Z [2024-04-05 22:50:06,803: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T22:50:06.804086915Z [2024-04-05 22:50:06,803: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T22:50:06.804110826Z [2024-04-05 22:50:06,803: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:50:06.938921820Z [2024-04-05 22:50:06,938: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:50:07.644185193Z [2024-04-05 22:50:07,643: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[36654437-2048-4716-927a-0b5d1341ef9a] succeeded in 2.4371434969998518s: None 2024-04-05T22:50:08.569838079Z [2024-04-05 22:50:08,569: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[62b82c2d-61f3-41bd-9068-4e64446e0b5f] received 2024-04-05T22:50:08.594156945Z [2024-04-05 22:50:08,593: INFO/ForkPoolWorker-15] [62b82c2d-61f3-41bd-9068-4e64446e0b5f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'collect_metrics', 'scheduled__2024-04-05T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T22:50:08.880395363Z [2024-04-05 22:50:08,876: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T22:50:10.054581354Z [2024-04-05 22:50:10,053: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T22:50:10.060562419Z [2024-04-05 22:50:10,059: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:50:10.213781057Z [2024-04-05 22:50:10,213: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T22:50:10.215637965Z [2024-04-05 22:50:10,215: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:50:10.215783702Z [2024-04-05 22:50:10,215: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:50:10.215932974Z [2024-04-05 22:50:10,215: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T22:50:10.216008712Z [2024-04-05 22:50:10,215: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T22:50:10.216304914Z [2024-04-05 22:50:10,216: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T22:50:10.216327678Z [2024-04-05 22:50:10,216: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:50:10.314360688Z [2024-04-05 22:50:10,314: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:50:10.966472058Z [2024-04-05 22:50:10,966: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[62b82c2d-61f3-41bd-9068-4e64446e0b5f] succeeded in 2.392148167999949s: None 2024-04-05T22:50:11.631006779Z [2024-04-05 22:50:11,630: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[749de74b-180c-4209-bab4-cc79b6acc2a2] received 2024-04-05T22:50:11.644517771Z [2024-04-05 22:50:11,644: INFO/ForkPoolWorker-15] [749de74b-180c-4209-bab4-cc79b6acc2a2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'send_prometheus', 'scheduled__2024-04-05T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T22:50:11.927079612Z [2024-04-05 22:50:11,923: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T22:50:13.218005013Z [2024-04-05 22:50:13,217: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T22:50:13.221643612Z [2024-04-05 22:50:13,221: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:50:13.295504429Z [2024-04-05 22:50:13,294: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T22:50:13.302139513Z [2024-04-05 22:50:13,301: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:50:13.302365347Z [2024-04-05 22:50:13,301: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:50:13.302711465Z [2024-04-05 22:50:13,302: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T22:50:13.302923326Z [2024-04-05 22:50:13,302: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T22:50:13.304302617Z [2024-04-05 22:50:13,304: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T22:50:13.304543729Z [2024-04-05 22:50:13,304: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:50:13.426492226Z [2024-04-05 22:50:13,426: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:50:14.071784137Z [2024-04-05 22:50:14,071: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[749de74b-180c-4209-bab4-cc79b6acc2a2] succeeded in 2.434170858000016s: None 2024-04-05T22:51:00.290824023Z [2024-04-05 22:51:00,290: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[383c63a3-f4db-45ef-a56e-c8a57615e53f] received 2024-04-05T22:51:00.302086912Z [2024-04-05 22:51:00,301: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3a99a35c-a3b9-405d-93b7-a967b536f5f8] received 2024-04-05T22:51:00.304452266Z [2024-04-05 22:51:00,304: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[deb15bad-c173-4083-b7a5-0a0a2cae976f] received 2024-04-05T22:51:00.307532111Z [2024-04-05 22:51:00,307: INFO/ForkPoolWorker-15] [383c63a3-f4db-45ef-a56e-c8a57615e53f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T22:51:00.313654282Z [2024-04-05 22:51:00,313: INFO/ForkPoolWorker-16] [3a99a35c-a3b9-405d-93b7-a967b536f5f8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T22:51:00.325356866Z [2024-04-05 22:51:00,324: INFO/ForkPoolWorker-1] [deb15bad-c173-4083-b7a5-0a0a2cae976f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T22:51:00.651485626Z [2024-04-05 22:51:00,647: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T22:51:00.660448232Z [2024-04-05 22:51:00,656: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T22:51:00.726155268Z [2024-04-05 22:51:00,721: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-05T22:51:00.903334771Z [2024-04-05 22:51:00,902: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-05T22:51:00.909175913Z [2024-04-05 22:51:00,908: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:51:00.937544554Z [2024-04-05 22:51:00,937: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-05T22:51:00.938829702Z [2024-04-05 22:51:00,938: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-05T22:51:00.938956175Z [2024-04-05 22:51:00,938: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-05T22:51:00.939021307Z [2024-04-05 22:51:00,938: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-05T22:51:00.939244057Z [2024-04-05 22:51:00,939: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-05T22:51:01.029574818Z [2024-04-05 22:51:01,029: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:51:01.613719005Z [2024-04-05 22:51:01,613: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[deb15bad-c173-4083-b7a5-0a0a2cae976f] succeeded in 1.304845084000135s: None 2024-04-05T22:51:01.904427777Z [2024-04-05 22:51:01,903: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T22:51:01.907947276Z [2024-04-05 22:51:01,907: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:51:01.942558497Z [2024-04-05 22:51:01,942: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T22:51:01.944322657Z [2024-04-05 22:51:01,944: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:51:01.944405380Z [2024-04-05 22:51:01,944: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:51:01.944562810Z [2024-04-05 22:51:01,944: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T22:51:01.944614869Z [2024-04-05 22:51:01,944: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T22:51:01.945215242Z [2024-04-05 22:51:01,944: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-05T22:51:01.945286375Z [2024-04-05 22:51:01,945: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:51:01.999908336Z [2024-04-05 22:51:01,999: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-05T22:51:02.003465981Z [2024-04-05 22:51:02,002: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:51:02.027565100Z [2024-04-05 22:51:02,027: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T22:51:02.029077613Z [2024-04-05 22:51:02,028: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:51:02.029127577Z [2024-04-05 22:51:02,029: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:51:02.029292792Z [2024-04-05 22:51:02,029: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T22:51:02.029430620Z [2024-04-05 22:51:02,029: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-05T22:51:02.029726684Z [2024-04-05 22:51:02,029: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T22:51:02.029916969Z [2024-04-05 22:51:02,029: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:51:02.059829820Z [2024-04-05 22:51:02,059: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:51:02.128646321Z [2024-04-05 22:51:02,128: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:51:03.936691712Z [2024-04-05 22:51:03,936: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3a99a35c-a3b9-405d-93b7-a967b536f5f8] succeeded in 3.6319488700000875s: None 2024-04-05T22:51:05.001456241Z [2024-04-05 22:51:05,000: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[383c63a3-f4db-45ef-a56e-c8a57615e53f] succeeded in 4.70474996300004s: None 2024-04-05T22:52:00.496138813Z [2024-04-05 22:52:00,495: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3c7dd0bd-e896-4d6c-be04-97303006fb2a] received 2024-04-05T22:52:00.500317930Z [2024-04-05 22:52:00,499: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ab9292af-e508-43e8-bca9-2aab4f30c4c1] received 2024-04-05T22:52:00.505936010Z [2024-04-05 22:52:00,505: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d14851e8-5812-4ef1-87f8-af1fa244f45e] received 2024-04-05T22:52:00.519502488Z [2024-04-05 22:52:00,519: INFO/ForkPoolWorker-1] [d14851e8-5812-4ef1-87f8-af1fa244f45e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T22:52:00.519837398Z [2024-04-05 22:52:00,519: INFO/ForkPoolWorker-15] [3c7dd0bd-e896-4d6c-be04-97303006fb2a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T22:52:00.524123932Z [2024-04-05 22:52:00,523: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a0478a92-2690-4d69-b82d-32eb9d7ec8b4] received 2024-04-05T22:52:00.525819904Z [2024-04-05 22:52:00,525: INFO/ForkPoolWorker-16] [ab9292af-e508-43e8-bca9-2aab4f30c4c1] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T22:52:00.539689730Z [2024-04-05 22:52:00,539: INFO/ForkPoolWorker-2] [a0478a92-2690-4d69-b82d-32eb9d7ec8b4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T22:52:00.829420799Z [2024-04-05 22:52:00,826: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-05T22:52:00.963676320Z [2024-04-05 22:52:00,959: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T22:52:01.005326355Z [2024-04-05 22:52:01,001: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T22:52:01.016311158Z [2024-04-05 22:52:01,011: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-05T22:52:01.115119101Z [2024-04-05 22:52:01,114: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:52:01.212047728Z [2024-04-05 22:52:01,211: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-05T22:52:01.216851105Z [2024-04-05 22:52:01,216: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:52:01.241826807Z [2024-04-05 22:52:01,241: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T22:52:01.243049553Z [2024-04-05 22:52:01,242: INFO/ForkPoolWorker-16] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-05T22:52:01.243219035Z [2024-04-05 22:52:01,242: INFO/ForkPoolWorker-16] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-05T22:52:01.243531814Z [2024-04-05 22:52:01,243: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-05T22:52:01.243833489Z [2024-04-05 22:52:01,243: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-05T22:52:01.349615301Z [2024-04-05 22:52:01,349: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:52:01.737438192Z [2024-04-05 22:52:01,736: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d14851e8-5812-4ef1-87f8-af1fa244f45e] succeeded in 1.2296338020000803s: None 2024-04-05T22:52:02.039940094Z [2024-04-05 22:52:02,039: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ab9292af-e508-43e8-bca9-2aab4f30c4c1] succeeded in 1.535267764000082s: None 2024-04-05T22:52:02.364135988Z [2024-04-05 22:52:02,363: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T22:52:02.368083706Z [2024-04-05 22:52:02,367: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:52:02.389187275Z [2024-04-05 22:52:02,388: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T22:52:02.390306899Z [2024-04-05 22:52:02,390: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:52:02.390372299Z [2024-04-05 22:52:02,390: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:52:02.390478648Z [2024-04-05 22:52:02,390: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T22:52:02.390803732Z [2024-04-05 22:52:02,390: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T22:52:02.391086005Z [2024-04-05 22:52:02,390: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-05T22:52:02.391142722Z [2024-04-05 22:52:02,391: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:52:02.482222711Z [2024-04-05 22:52:02,481: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:52:02.561682816Z [2024-04-05 22:52:02,561: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-05T22:52:02.565307993Z [2024-04-05 22:52:02,564: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:52:02.588889770Z [2024-04-05 22:52:02,588: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-05T22:52:02.590926025Z [2024-04-05 22:52:02,590: INFO/ForkPoolWorker-2] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:52:02.591131291Z [2024-04-05 22:52:02,590: INFO/ForkPoolWorker-2] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:52:02.591478084Z [2024-04-05 22:52:02,591: INFO/ForkPoolWorker-2] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T22:52:02.591772983Z [2024-04-05 22:52:02,591: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-05T22:52:02.592119124Z [2024-04-05 22:52:02,591: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T22:52:02.592663665Z [2024-04-05 22:52:02,592: INFO/ForkPoolWorker-2] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:52:02.690426805Z [2024-04-05 22:52:02,690: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:52:04.504692509Z [2024-04-05 22:52:04,503: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a0478a92-2690-4d69-b82d-32eb9d7ec8b4] succeeded in 3.97649942299995s: None 2024-04-05T22:52:04.780859960Z [2024-04-05 22:52:04,780: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3c7dd0bd-e896-4d6c-be04-97303006fb2a] succeeded in 4.2812706330000765s: None 2024-04-05T22:52:50.932559951Z [2024-04-05 22:52:50,932: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7c17fbf6-fbf4-44aa-8920-56f7ca72a49f] received 2024-04-05T22:52:50.934651925Z [2024-04-05 22:52:50,934: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[91501bb3-c519-410b-8a96-cf2de5371725] received 2024-04-05T22:52:50.947394372Z [2024-04-05 22:52:50,947: INFO/ForkPoolWorker-15] [7c17fbf6-fbf4-44aa-8920-56f7ca72a49f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fe56ae22-7961-4710-9ad3-f363d7f4bbdf', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T22:52:50.956198686Z [2024-04-05 22:52:50,955: INFO/ForkPoolWorker-16] [91501bb3-c519-410b-8a96-cf2de5371725] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fe56ae22-7961-4710-9ad3-f363d7f4bbdf', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T22:52:51.229385285Z [2024-04-05 22:52:51,225: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T22:52:51.256586925Z [2024-04-05 22:52:51,252: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T22:52:52.405819145Z [2024-04-05 22:52:52,405: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-05T22:52:52.409371358Z [2024-04-05 22:52:52,408: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:52:52.420845198Z [2024-04-05 22:52:52,420: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T22:52:52.425782727Z [2024-04-05 22:52:52,425: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:52:52.447542055Z [2024-04-05 22:52:52,447: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T22:52:52.450868475Z [2024-04-05 22:52:52,449: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:52:52.451383002Z [2024-04-05 22:52:52,450: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:52:52.451816775Z [2024-04-05 22:52:52,451: INFO/ForkPoolWorker-16] Read VIM fe56ae22-7961-4710-9ad3-f363d7f4bbdf (basic_08_vim_test) 2024-04-05T22:52:52.452332799Z [2024-04-05 22:52:52,451: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'fe56ae22-7961-4710-9ad3-f363d7f4bbdf', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-05T22:52:52.452596327Z [2024-04-05 22:52:52,452: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-05T22:52:52.453133670Z [2024-04-05 22:52:52,452: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-05T22:52:52.453418966Z [2024-04-05 22:52:52,453: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:52:52.456462525Z [2024-04-05 22:52:52,456: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T22:52:52.458473035Z [2024-04-05 22:52:52,458: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:52:52.458537562Z [2024-04-05 22:52:52,458: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:52:52.458679546Z [2024-04-05 22:52:52,458: INFO/ForkPoolWorker-15] Read VIM fe56ae22-7961-4710-9ad3-f363d7f4bbdf (basic_08_vim_test) 2024-04-05T22:52:52.458861320Z [2024-04-05 22:52:52,458: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'fe56ae22-7961-4710-9ad3-f363d7f4bbdf', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-05T22:52:52.458935120Z [2024-04-05 22:52:52,458: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T22:52:52.459494259Z [2024-04-05 22:52:52,459: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T22:52:52.459648169Z [2024-04-05 22:52:52,459: INFO/ForkPoolWorker-15] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:52:52.462993383Z [2024-04-05 22:52:52,462: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_fe56ae22-7961-4710-9ad3-f363d7f4bbdf 2024-04-05T22:52:52.464687002Z [2024-04-05 22:52:52,464: INFO/ForkPoolWorker-15] Creating DAG vim_status_fe56ae22-7961-4710-9ad3-f363d7f4bbdf 2024-04-05T22:52:52.532595466Z [2024-04-05 22:52:52,532: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:52:52.538153344Z [2024-04-05 22:52:52,537: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:52:54.041852614Z [2024-04-05 22:52:54,041: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7c17fbf6-fbf4-44aa-8920-56f7ca72a49f] succeeded in 3.1076432059999206s: None 2024-04-05T22:52:54.390791194Z [2024-04-05 22:52:54,390: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[91501bb3-c519-410b-8a96-cf2de5371725] succeeded in 3.4531693520000317s: None 2024-04-05T22:52:55.891939952Z [2024-04-05 22:52:55,891: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[97e350f4-fa12-4f26-8f78-fe0144158147] received 2024-04-05T22:52:55.911204943Z [2024-04-05 22:52:55,910: INFO/ForkPoolWorker-15] [97e350f4-fa12-4f26-8f78-fe0144158147] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fe56ae22-7961-4710-9ad3-f363d7f4bbdf', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T22:52:56.174911525Z [2024-04-05 22:52:56,171: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T22:52:57.294547370Z [2024-04-05 22:52:57,294: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T22:52:57.298342346Z [2024-04-05 22:52:57,297: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:52:57.316398205Z [2024-04-05 22:52:57,316: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T22:52:57.317837405Z [2024-04-05 22:52:57,317: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:52:57.317924286Z [2024-04-05 22:52:57,317: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:52:57.318031753Z [2024-04-05 22:52:57,317: INFO/ForkPoolWorker-15] Read VIM fe56ae22-7961-4710-9ad3-f363d7f4bbdf (basic_08_vim_test) 2024-04-05T22:52:57.318259507Z [2024-04-05 22:52:57,317: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'fe56ae22-7961-4710-9ad3-f363d7f4bbdf', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-05T22:52:57.318314223Z [2024-04-05 22:52:57,318: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T22:52:57.318657214Z [2024-04-05 22:52:57,318: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T22:52:57.318666990Z [2024-04-05 22:52:57,318: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:52:57.324535089Z [2024-04-05 22:52:57,324: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fe56ae22-7961-4710-9ad3-f363d7f4bbdf 2024-04-05T22:52:57.420672099Z [2024-04-05 22:52:57,420: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:52:58.095841412Z [2024-04-05 22:52:58,095: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[97e350f4-fa12-4f26-8f78-fe0144158147] succeeded in 2.1909023979999347s: None 2024-04-05T22:52:58.713091763Z [2024-04-05 22:52:58,712: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2771c614-ba63-4362-8746-368d0f2dbe3e] received 2024-04-05T22:52:58.731866481Z [2024-04-05 22:52:58,731: INFO/ForkPoolWorker-15] [2771c614-ba63-4362-8746-368d0f2dbe3e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fe56ae22-7961-4710-9ad3-f363d7f4bbdf', 'split_metrics', 'scheduled__2024-04-05T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T22:52:59.049037164Z [2024-04-05 22:52:59,044: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T22:53:00.386206728Z [2024-04-05 22:53:00,385: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T22:53:00.389787154Z [2024-04-05 22:53:00,389: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:53:00.428200338Z [2024-04-05 22:53:00,427: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T22:53:00.430668091Z [2024-04-05 22:53:00,430: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:53:00.431731340Z [2024-04-05 22:53:00,431: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:53:00.432561231Z [2024-04-05 22:53:00,432: INFO/ForkPoolWorker-15] Read VIM fe56ae22-7961-4710-9ad3-f363d7f4bbdf (basic_08_vim_test) 2024-04-05T22:53:00.432998447Z [2024-04-05 22:53:00,432: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'fe56ae22-7961-4710-9ad3-f363d7f4bbdf', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-05T22:53:00.433678670Z [2024-04-05 22:53:00,433: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T22:53:00.434614072Z [2024-04-05 22:53:00,434: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T22:53:00.434834018Z [2024-04-05 22:53:00,434: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:53:00.442989467Z [2024-04-05 22:53:00,442: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fe56ae22-7961-4710-9ad3-f363d7f4bbdf 2024-04-05T22:53:00.538159394Z [2024-04-05 22:53:00,537: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:53:01.237595452Z [2024-04-05 22:53:01,237: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2771c614-ba63-4362-8746-368d0f2dbe3e] succeeded in 2.5222782369999095s: None 2024-04-05T22:53:01.243848600Z [2024-04-05 22:53:01,243: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dd937602-2094-4eed-ae3e-ec4b342147c4] received 2024-04-05T22:53:01.245686320Z [2024-04-05 22:53:01,245: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bc02eb57-a32d-4c7e-9439-1767091037e4] received 2024-04-05T22:53:01.247417537Z [2024-04-05 22:53:01,247: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2e93d993-2ec4-492c-a04e-745097b9009a] received 2024-04-05T22:53:01.250223352Z [2024-04-05 22:53:01,250: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[60a360a2-aedb-4ddb-86c4-cf0227dea968] received 2024-04-05T22:53:01.252616256Z [2024-04-05 22:53:01,252: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c90715a8-6bc1-4f1b-9482-a62ea4118e67] received 2024-04-05T22:53:01.257054166Z [2024-04-05 22:53:01,256: INFO/ForkPoolWorker-16] [bc02eb57-a32d-4c7e-9439-1767091037e4] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T22:53:01.261320043Z [2024-04-05 22:53:01,261: INFO/ForkPoolWorker-2] [60a360a2-aedb-4ddb-86c4-cf0227dea968] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T22:53:01.266529867Z [2024-04-05 22:53:01,266: INFO/ForkPoolWorker-15] [dd937602-2094-4eed-ae3e-ec4b342147c4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fe56ae22-7961-4710-9ad3-f363d7f4bbdf', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T22:53:01.276044521Z [2024-04-05 22:53:01,275: INFO/ForkPoolWorker-1] [2e93d993-2ec4-492c-a04e-745097b9009a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fe56ae22-7961-4710-9ad3-f363d7f4bbdf', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T22:53:01.276225144Z [2024-04-05 22:53:01,275: INFO/ForkPoolWorker-3] [c90715a8-6bc1-4f1b-9482-a62ea4118e67] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T22:53:01.612709919Z [2024-04-05 22:53:01,609: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T22:53:01.656408930Z [2024-04-05 22:53:01,653: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-05T22:53:01.756005223Z [2024-04-05 22:53:01,750: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T22:53:01.784443127Z [2024-04-05 22:53:01,777: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T22:53:01.836810521Z [2024-04-05 22:53:01,836: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-05T22:53:01.841495647Z [2024-04-05 22:53:01,840: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:53:01.894331719Z [2024-04-05 22:53:01,894: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T22:53:01.896693201Z [2024-04-05 22:53:01,896: INFO/ForkPoolWorker-16] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-05T22:53:01.896845987Z [2024-04-05 22:53:01,896: INFO/ForkPoolWorker-16] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-05T22:53:01.896900591Z [2024-04-05 22:53:01,896: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-05T22:53:01.897180678Z [2024-04-05 22:53:01,897: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-05T22:53:01.928340372Z [2024-04-05 22:53:01,928: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b6faffaf-8984-4a07-a654-3374b80c809b] received 2024-04-05T22:53:01.933086384Z [2024-04-05 22:53:01,915: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T22:53:01.955538118Z [2024-04-05 22:53:01,953: INFO/ForkPoolWorker-4] [b6faffaf-8984-4a07-a654-3374b80c809b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fe56ae22-7961-4710-9ad3-f363d7f4bbdf', 'collect_metrics', 'scheduled__2024-04-05T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T22:53:02.081838721Z [2024-04-05 22:53:02,081: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:53:02.492618729Z [2024-04-05 22:53:02,488: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T22:53:02.884885496Z [2024-04-05 22:53:02,884: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[bc02eb57-a32d-4c7e-9439-1767091037e4] succeeded in 1.6369531010000173s: None 2024-04-05T22:53:03.606134492Z [2024-04-05 22:53:03,605: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-05T22:53:03.609666037Z [2024-04-05 22:53:03,609: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:53:03.656423611Z [2024-04-05 22:53:03,656: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-05T22:53:03.660387169Z [2024-04-05 22:53:03,660: INFO/ForkPoolWorker-2] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:53:03.660491849Z [2024-04-05 22:53:03,660: INFO/ForkPoolWorker-2] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:53:03.660583228Z [2024-04-05 22:53:03,660: INFO/ForkPoolWorker-2] Read VIM fe56ae22-7961-4710-9ad3-f363d7f4bbdf (basic_08_vim_test) 2024-04-05T22:53:03.661154817Z [2024-04-05 22:53:03,660: INFO/ForkPoolWorker-2] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'fe56ae22-7961-4710-9ad3-f363d7f4bbdf', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-05T22:53:03.661173198Z [2024-04-05 22:53:03,661: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-05T22:53:03.661459675Z [2024-04-05 22:53:03,661: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T22:53:03.661518802Z [2024-04-05 22:53:03,661: INFO/ForkPoolWorker-2] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:53:03.666708776Z [2024-04-05 22:53:03,666: INFO/ForkPoolWorker-2] Creating DAG vim_status_fe56ae22-7961-4710-9ad3-f363d7f4bbdf 2024-04-05T22:53:03.748382716Z [2024-04-05 22:53:03,737: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T22:53:03.770506690Z [2024-04-05 22:53:03,768: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:53:03.836949887Z [2024-04-05 22:53:03,836: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:53:03.840440790Z [2024-04-05 22:53:03,840: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T22:53:03.844659828Z [2024-04-05 22:53:03,844: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:53:03.844848374Z [2024-04-05 22:53:03,844: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:53:03.845050564Z [2024-04-05 22:53:03,844: INFO/ForkPoolWorker-15] Read VIM fe56ae22-7961-4710-9ad3-f363d7f4bbdf (basic_08_vim_test) 2024-04-05T22:53:03.845354081Z [2024-04-05 22:53:03,845: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'fe56ae22-7961-4710-9ad3-f363d7f4bbdf', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-05T22:53:03.845536465Z [2024-04-05 22:53:03,845: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T22:53:03.846004053Z [2024-04-05 22:53:03,845: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-05T22:53:03.846195884Z [2024-04-05 22:53:03,845: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:53:03.854052051Z [2024-04-05 22:53:03,853: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_fe56ae22-7961-4710-9ad3-f363d7f4bbdf 2024-04-05T22:53:03.924322739Z [2024-04-05 22:53:03,923: INFO/ForkPoolWorker-3] Getting VIM list 2024-04-05T22:53:03.928925962Z [2024-04-05 22:53:03,928: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:53:03.974955431Z [2024-04-05 22:53:03,974: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-05T22:53:03.978950148Z [2024-04-05 22:53:03,978: INFO/ForkPoolWorker-3] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:53:03.978974383Z [2024-04-05 22:53:03,978: INFO/ForkPoolWorker-3] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:53:03.979079781Z [2024-04-05 22:53:03,978: INFO/ForkPoolWorker-3] Read VIM fe56ae22-7961-4710-9ad3-f363d7f4bbdf (basic_08_vim_test) 2024-04-05T22:53:03.981762153Z [2024-04-05 22:53:03,979: INFO/ForkPoolWorker-3] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'fe56ae22-7961-4710-9ad3-f363d7f4bbdf', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-05T22:53:03.982585207Z [2024-04-05 22:53:03,982: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-04-05T22:53:03.983514420Z [2024-04-05 22:53:03,983: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-04-05T22:53:03.983666542Z [2024-04-05 22:53:03,983: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:53:03.997179534Z [2024-04-05 22:53:03,996: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_fe56ae22-7961-4710-9ad3-f363d7f4bbdf 2024-04-05T22:53:04.022819111Z [2024-04-05 22:53:04,020: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:53:04.182316946Z [2024-04-05 22:53:04,182: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:53:04.417313103Z [2024-04-05 22:53:04,416: INFO/ForkPoolWorker-4] Getting VIM list 2024-04-05T22:53:04.420942966Z [2024-04-05 22:53:04,420: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:53:04.490192201Z [2024-04-05 22:53:04,489: INFO/ForkPoolWorker-4] Connected to database osm version 1.2 2024-04-05T22:53:04.494522158Z [2024-04-05 22:53:04,494: INFO/ForkPoolWorker-4] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:53:04.494769802Z [2024-04-05 22:53:04,494: INFO/ForkPoolWorker-4] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:53:04.494896878Z [2024-04-05 22:53:04,494: INFO/ForkPoolWorker-4] Read VIM fe56ae22-7961-4710-9ad3-f363d7f4bbdf (basic_08_vim_test) 2024-04-05T22:53:04.495093805Z [2024-04-05 22:53:04,494: INFO/ForkPoolWorker-4] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'fe56ae22-7961-4710-9ad3-f363d7f4bbdf', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-05T22:53:04.495214922Z [2024-04-05 22:53:04,495: INFO/ForkPoolWorker-4] Getting VIM list OK 2024-04-05T22:53:04.495575582Z [2024-04-05 22:53:04,495: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T22:53:04.496143664Z [2024-04-05 22:53:04,496: INFO/ForkPoolWorker-4] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:53:04.503208943Z [2024-04-05 22:53:04,503: INFO/ForkPoolWorker-4] Creating DAG vm_metrics_vim_fe56ae22-7961-4710-9ad3-f363d7f4bbdf 2024-04-05T22:53:04.512799953Z [2024-04-05 22:53:04,512: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-05T22:53:04.516021847Z [2024-04-05 22:53:04,515: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:53:04.542078848Z [2024-04-05 22:53:04,541: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-05T22:53:04.549339906Z [2024-04-05 22:53:04,549: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:53:04.549356341Z [2024-04-05 22:53:04,549: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:53:04.549366699Z [2024-04-05 22:53:04,549: INFO/ForkPoolWorker-1] Read VIM fe56ae22-7961-4710-9ad3-f363d7f4bbdf (basic_08_vim_test) 2024-04-05T22:53:04.549446572Z [2024-04-05 22:53:04,549: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'fe56ae22-7961-4710-9ad3-f363d7f4bbdf', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-05T22:53:04.549498814Z [2024-04-05 22:53:04,549: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-05T22:53:04.549806535Z [2024-04-05 22:53:04,549: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T22:53:04.549835688Z [2024-04-05 22:53:04,549: INFO/ForkPoolWorker-1] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:53:04.557502540Z [2024-04-05 22:53:04,557: INFO/ForkPoolWorker-1] Creating DAG vim_status_fe56ae22-7961-4710-9ad3-f363d7f4bbdf 2024-04-05T22:53:04.634072037Z [2024-04-05 22:53:04,633: INFO/ForkPoolWorker-4] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:53:04.670033940Z [2024-04-05 22:53:04,668: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:53:05.304434032Z [2024-04-05 22:53:05,304: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[53f73601-a150-4284-a8ad-e5970eda22a9] received 2024-04-05T22:53:05.312799638Z [2024-04-05 22:53:05,312: INFO/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[b6faffaf-8984-4a07-a654-3374b80c809b] succeeded in 3.381580191000012s: None 2024-04-05T22:53:05.316538860Z [2024-04-05 22:53:05,316: INFO/ForkPoolWorker-16] [53f73601-a150-4284-a8ad-e5970eda22a9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fe56ae22-7961-4710-9ad3-f363d7f4bbdf', 'send_prometheus', 'scheduled__2024-04-05T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T22:53:05.601937035Z [2024-04-05 22:53:05,598: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T22:53:06.076922607Z [2024-04-05 22:53:06,076: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[60a360a2-aedb-4ddb-86c4-cf0227dea968] succeeded in 4.823678281000184s: None 2024-04-05T22:53:06.415425026Z [2024-04-05 22:53:06,414: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2e93d993-2ec4-492c-a04e-745097b9009a] succeeded in 5.163117650999993s: None 2024-04-05T22:53:06.823788518Z [2024-04-05 22:53:06,822: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[c90715a8-6bc1-4f1b-9482-a62ea4118e67] succeeded in 5.567148665000104s: None 2024-04-05T22:53:06.835147813Z [2024-04-05 22:53:06,834: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[dd937602-2094-4eed-ae3e-ec4b342147c4] succeeded in 5.588393810999833s: None 2024-04-05T22:53:06.874207973Z [2024-04-05 22:53:06,873: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-05T22:53:06.877668243Z [2024-04-05 22:53:06,877: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:53:06.905076551Z [2024-04-05 22:53:06,904: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T22:53:06.906551545Z [2024-04-05 22:53:06,906: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:53:06.906690481Z [2024-04-05 22:53:06,906: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:53:06.906857650Z [2024-04-05 22:53:06,906: INFO/ForkPoolWorker-16] Read VIM fe56ae22-7961-4710-9ad3-f363d7f4bbdf (basic_08_vim_test) 2024-04-05T22:53:06.907103160Z [2024-04-05 22:53:06,906: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'fe56ae22-7961-4710-9ad3-f363d7f4bbdf', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-05T22:53:06.907385775Z [2024-04-05 22:53:06,907: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-05T22:53:06.907737150Z [2024-04-05 22:53:06,907: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T22:53:06.907753648Z [2024-04-05 22:53:06,907: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:53:06.914953662Z [2024-04-05 22:53:06,914: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_fe56ae22-7961-4710-9ad3-f363d7f4bbdf 2024-04-05T22:53:07.001375721Z [2024-04-05 22:53:07,001: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:53:07.725791313Z [2024-04-05 22:53:07,725: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[53f73601-a150-4284-a8ad-e5970eda22a9] succeeded in 2.419507335999924s: None 2024-04-05T22:54:00.552217581Z [2024-04-05 22:54:00,551: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[66200ffd-9208-4caa-84db-e3795bf8dee9] received 2024-04-05T22:54:00.557519089Z [2024-04-05 22:54:00,557: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[966beb6d-d40d-4296-894f-cd46288aac03] received 2024-04-05T22:54:00.563428830Z [2024-04-05 22:54:00,562: INFO/ForkPoolWorker-15] [66200ffd-9208-4caa-84db-e3795bf8dee9] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T22:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T22:54:00.568263236Z [2024-04-05 22:54:00,567: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8e7b7d57-4f7d-4a2d-9cee-1e025d0d9c14] received 2024-04-05T22:54:00.574415193Z [2024-04-05 22:54:00,574: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d93f710e-6fad-4eb3-b9f5-45638f0ef262] received 2024-04-05T22:54:00.575067529Z [2024-04-05 22:54:00,574: INFO/ForkPoolWorker-16] [966beb6d-d40d-4296-894f-cd46288aac03] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T22:54:00.576403996Z [2024-04-05 22:54:00,576: INFO/ForkPoolWorker-1] [8e7b7d57-4f7d-4a2d-9cee-1e025d0d9c14] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fe56ae22-7961-4710-9ad3-f363d7f4bbdf', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T22:54:00.581585306Z [2024-04-05 22:54:00,581: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d14f808c-5482-409e-8f86-aba1d240673d] received 2024-04-05T22:54:00.585443162Z [2024-04-05 22:54:00,585: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4dc60ba5-457e-466f-adc5-c3f65a03d3a4] received 2024-04-05T22:54:00.589096536Z [2024-04-05 22:54:00,588: INFO/ForkPoolWorker-3] [d14f808c-5482-409e-8f86-aba1d240673d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T22:54:00.593517899Z [2024-04-05 22:54:00,593: INFO/ForkPoolWorker-2] [d93f710e-6fad-4eb3-b9f5-45638f0ef262] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T22:54:00.602650324Z [2024-04-05 22:54:00,602: INFO/ForkPoolWorker-4] [4dc60ba5-457e-466f-adc5-c3f65a03d3a4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fe56ae22-7961-4710-9ad3-f363d7f4bbdf', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T22:54:01.123842345Z [2024-04-05 22:54:01,113: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T22:54:01.268289396Z [2024-04-05 22:54:01,264: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T22:54:01.286493250Z [2024-04-05 22:54:01,281: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-05T22:54:01.321637832Z [2024-04-05 22:54:01,317: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-05T22:54:01.491096946Z [2024-04-05 22:54:01,490: INFO/ForkPoolWorker-3] Getting SDNC list 2024-04-05T22:54:01.496116937Z [2024-04-05 22:54:01,495: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:54:01.548806473Z [2024-04-05 22:54:01,548: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-05T22:54:01.554885334Z [2024-04-05 22:54:01,552: INFO/ForkPoolWorker-3] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-05T22:54:01.555213561Z [2024-04-05 22:54:01,554: INFO/ForkPoolWorker-3] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-05T22:54:01.555412015Z [2024-04-05 22:54:01,555: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-04-05T22:54:01.555761608Z [2024-04-05 22:54:01,555: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-05T22:54:01.640976954Z [2024-04-05 22:54:01,640: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:54:01.689729871Z [2024-04-05 22:54:01,676: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T22:54:01.703322212Z [2024-04-05 22:54:01,666: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T22:54:01.792025730Z [2024-04-05 22:54:01,791: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:54:02.743977612Z [2024-04-05 22:54:02,743: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[66200ffd-9208-4caa-84db-e3795bf8dee9] succeeded in 2.1893508880000354s: None 2024-04-05T22:54:02.905541909Z [2024-04-05 22:54:02,905: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[d14f808c-5482-409e-8f86-aba1d240673d] succeeded in 2.32115105999992s: None 2024-04-05T22:54:03.208300526Z [2024-04-05 22:54:03,207: INFO/ForkPoolWorker-4] Getting VIM list 2024-04-05T22:54:03.211754922Z [2024-04-05 22:54:03,211: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:54:03.256786263Z [2024-04-05 22:54:03,256: INFO/ForkPoolWorker-4] Connected to database osm version 1.2 2024-04-05T22:54:03.259936951Z [2024-04-05 22:54:03,259: INFO/ForkPoolWorker-4] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:54:03.259952087Z [2024-04-05 22:54:03,259: INFO/ForkPoolWorker-4] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:54:03.260083821Z [2024-04-05 22:54:03,259: INFO/ForkPoolWorker-4] Read VIM fe56ae22-7961-4710-9ad3-f363d7f4bbdf (basic_08_vim_test) 2024-04-05T22:54:03.260282048Z [2024-04-05 22:54:03,260: INFO/ForkPoolWorker-4] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'fe56ae22-7961-4710-9ad3-f363d7f4bbdf', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-05T22:54:03.260316316Z [2024-04-05 22:54:03,260: INFO/ForkPoolWorker-4] Getting VIM list OK 2024-04-05T22:54:03.260610211Z [2024-04-05 22:54:03,260: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for collecting VM status 2024-04-05T22:54:03.260651636Z [2024-04-05 22:54:03,260: INFO/ForkPoolWorker-4] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:54:03.265432809Z [2024-04-05 22:54:03,265: INFO/ForkPoolWorker-4] Creating DAG vm_status_vim_fe56ae22-7961-4710-9ad3-f363d7f4bbdf 2024-04-05T22:54:03.375861353Z [2024-04-05 22:54:03,375: INFO/ForkPoolWorker-4] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:54:03.460282124Z [2024-04-05 22:54:03,459: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-05T22:54:03.464511077Z [2024-04-05 22:54:03,463: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:54:03.523788060Z [2024-04-05 22:54:03,521: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-05T22:54:03.528620626Z [2024-04-05 22:54:03,528: INFO/ForkPoolWorker-2] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:54:03.528919606Z [2024-04-05 22:54:03,528: INFO/ForkPoolWorker-2] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:54:03.529001582Z [2024-04-05 22:54:03,528: INFO/ForkPoolWorker-2] Read VIM fe56ae22-7961-4710-9ad3-f363d7f4bbdf (basic_08_vim_test) 2024-04-05T22:54:03.529190811Z [2024-04-05 22:54:03,529: INFO/ForkPoolWorker-2] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'fe56ae22-7961-4710-9ad3-f363d7f4bbdf', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-05T22:54:03.529247269Z [2024-04-05 22:54:03,529: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-05T22:54:03.529545547Z [2024-04-05 22:54:03,529: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-05T22:54:03.529614108Z [2024-04-05 22:54:03,529: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:54:03.536362903Z [2024-04-05 22:54:03,536: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_fe56ae22-7961-4710-9ad3-f363d7f4bbdf 2024-04-05T22:54:03.752385328Z [2024-04-05 22:54:03,737: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:54:03.848433497Z [2024-04-05 22:54:03,847: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-05T22:54:03.852695339Z [2024-04-05 22:54:03,852: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:54:03.896601301Z [2024-04-05 22:54:03,896: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-05T22:54:03.900044517Z [2024-04-05 22:54:03,899: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:54:03.900117628Z [2024-04-05 22:54:03,899: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:54:03.900197974Z [2024-04-05 22:54:03,900: INFO/ForkPoolWorker-1] Read VIM fe56ae22-7961-4710-9ad3-f363d7f4bbdf (basic_08_vim_test) 2024-04-05T22:54:03.900379346Z [2024-04-05 22:54:03,900: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'fe56ae22-7961-4710-9ad3-f363d7f4bbdf', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-05T22:54:03.900404665Z [2024-04-05 22:54:03,900: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-05T22:54:03.900855666Z [2024-04-05 22:54:03,900: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T22:54:03.900902672Z [2024-04-05 22:54:03,900: INFO/ForkPoolWorker-1] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:54:03.908248421Z [2024-04-05 22:54:03,907: INFO/ForkPoolWorker-1] Creating DAG vim_status_fe56ae22-7961-4710-9ad3-f363d7f4bbdf 2024-04-05T22:54:04.032976636Z [2024-04-05 22:54:04,032: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:54:04.146972054Z [2024-04-05 22:54:04,146: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-05T22:54:04.150546717Z [2024-04-05 22:54:04,150: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:54:04.182205260Z [2024-04-05 22:54:04,181: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T22:54:04.184112472Z [2024-04-05 22:54:04,183: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:54:04.184347300Z [2024-04-05 22:54:04,184: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:54:04.184598032Z [2024-04-05 22:54:04,184: INFO/ForkPoolWorker-16] Read VIM fe56ae22-7961-4710-9ad3-f363d7f4bbdf (basic_08_vim_test) 2024-04-05T22:54:04.184875815Z [2024-04-05 22:54:04,184: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'fe56ae22-7961-4710-9ad3-f363d7f4bbdf', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-05T22:54:04.185061737Z [2024-04-05 22:54:04,184: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-05T22:54:04.185440613Z [2024-04-05 22:54:04,185: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T22:54:04.185598208Z [2024-04-05 22:54:04,185: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:54:04.194088710Z [2024-04-05 22:54:04,193: INFO/ForkPoolWorker-16] Creating DAG vim_status_fe56ae22-7961-4710-9ad3-f363d7f4bbdf 2024-04-05T22:54:04.348177060Z [2024-04-05 22:54:04,347: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:54:05.889289301Z [2024-04-05 22:54:05,888: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8e7b7d57-4f7d-4a2d-9cee-1e025d0d9c14] succeeded in 5.319034796000096s: None 2024-04-05T22:54:05.906692886Z [2024-04-05 22:54:05,905: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[966beb6d-d40d-4296-894f-cd46288aac03] succeeded in 5.345372276000035s: None 2024-04-05T22:54:06.095227093Z [2024-04-05 22:54:06,094: INFO/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[4dc60ba5-457e-466f-adc5-c3f65a03d3a4] succeeded in 5.506079747000058s: None 2024-04-05T22:54:06.352802239Z [2024-04-05 22:54:06,352: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d93f710e-6fad-4eb3-b9f5-45638f0ef262] succeeded in 5.775959854999883s: None 2024-04-05T22:55:01.192673245Z [2024-04-05 22:55:01,192: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8623003c-df85-4afa-888e-e684c84c2d7d] received 2024-04-05T22:55:01.196969148Z [2024-04-05 22:55:01,196: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f2cbcc91-54ec-4e36-86b1-f6e71ac30aa0] received 2024-04-05T22:55:01.199669741Z [2024-04-05 22:55:01,199: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[037bcd23-40d8-457b-9280-c48873e38e9e] received 2024-04-05T22:55:01.211240652Z [2024-04-05 22:55:01,210: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d92670dd-c487-4aef-ae2e-4e2eefd44ad4] received 2024-04-05T22:55:01.213860625Z [2024-04-05 22:55:01,213: INFO/ForkPoolWorker-16] [f2cbcc91-54ec-4e36-86b1-f6e71ac30aa0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T22:55:01.214327316Z [2024-04-05 22:55:01,214: INFO/ForkPoolWorker-1] [037bcd23-40d8-457b-9280-c48873e38e9e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T22:55:01.214639000Z [2024-04-05 22:55:01,214: INFO/ForkPoolWorker-15] [8623003c-df85-4afa-888e-e684c84c2d7d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fe56ae22-7961-4710-9ad3-f363d7f4bbdf', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T22:55:01.227811140Z [2024-04-05 22:55:01,227: INFO/ForkPoolWorker-2] [d92670dd-c487-4aef-ae2e-4e2eefd44ad4] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T22:55:01.243944870Z [2024-04-05 22:55:01,243: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ce3251ca-3fdb-4f78-8d5f-4846cac57a8b] received 2024-04-05T22:55:01.260925243Z [2024-04-05 22:55:01,260: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9df3e02b-9aeb-471c-9508-dde788a93cc3] received 2024-04-05T22:55:01.263312104Z [2024-04-05 22:55:01,263: INFO/ForkPoolWorker-3] [ce3251ca-3fdb-4f78-8d5f-4846cac57a8b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fe56ae22-7961-4710-9ad3-f363d7f4bbdf', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T22:55:01.286066275Z [2024-04-05 22:55:01,285: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0c90d2a3-0f13-4f96-9513-dacc0e1525f4] received 2024-04-05T22:55:01.288074396Z [2024-04-05 22:55:01,287: INFO/ForkPoolWorker-4] [9df3e02b-9aeb-471c-9508-dde788a93cc3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T22:55:01.338727717Z [2024-04-05 22:55:01,338: INFO/ForkPoolWorker-5] [0c90d2a3-0f13-4f96-9513-dacc0e1525f4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fe56ae22-7961-4710-9ad3-f363d7f4bbdf', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T22:55:01.663214053Z [2024-04-05 22:55:01,659: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T22:55:01.730505930Z [2024-04-05 22:55:01,726: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-05T22:55:01.909973919Z [2024-04-05 22:55:01,906: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T22:55:01.910750734Z [2024-04-05 22:55:01,910: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-05T22:55:01.915019784Z [2024-04-05 22:55:01,914: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:55:01.958684106Z [2024-04-05 22:55:01,958: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-05T22:55:01.960566807Z [2024-04-05 22:55:01,960: INFO/ForkPoolWorker-2] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-05T22:55:01.961479762Z [2024-04-05 22:55:01,960: INFO/ForkPoolWorker-2] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-05T22:55:01.961680340Z [2024-04-05 22:55:01,961: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-05T22:55:01.962072200Z [2024-04-05 22:55:01,961: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-05T22:55:02.015808627Z [2024-04-05 22:55:02,001: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T22:55:02.162173937Z [2024-04-05 22:55:02,157: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T22:55:02.186108848Z [2024-04-05 22:55:02,184: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:55:02.247049913Z [2024-04-05 22:55:02,181: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T22:55:02.426292707Z [2024-04-05 22:55:02,412: INFO/ForkPoolWorker-5] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T22:55:03.316429481Z [2024-04-05 22:55:03,316: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d92670dd-c487-4aef-ae2e-4e2eefd44ad4] succeeded in 2.1026724529999683s: None 2024-04-05T22:55:04.439127147Z [2024-04-05 22:55:04,438: INFO/ForkPoolWorker-3] Getting VIM list 2024-04-05T22:55:04.446755613Z [2024-04-05 22:55:04,446: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:55:04.518819518Z [2024-04-05 22:55:04,518: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-05T22:55:04.534895849Z [2024-04-05 22:55:04,534: INFO/ForkPoolWorker-3] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:55:04.534940618Z [2024-04-05 22:55:04,534: INFO/ForkPoolWorker-3] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:55:04.534962439Z [2024-04-05 22:55:04,534: INFO/ForkPoolWorker-3] Read VIM fe56ae22-7961-4710-9ad3-f363d7f4bbdf (basic_08_vim_test) 2024-04-05T22:55:04.536161353Z [2024-04-05 22:55:04,534: INFO/ForkPoolWorker-3] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'fe56ae22-7961-4710-9ad3-f363d7f4bbdf', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-05T22:55:04.536257491Z [2024-04-05 22:55:04,536: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-04-05T22:55:04.536654367Z [2024-04-05 22:55:04,536: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-04-05T22:55:04.536684411Z [2024-04-05 22:55:04,536: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:55:04.586522841Z [2024-04-05 22:55:04,586: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_fe56ae22-7961-4710-9ad3-f363d7f4bbdf 2024-04-05T22:55:04.677131592Z [2024-04-05 22:55:04,675: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T22:55:04.680602557Z [2024-04-05 22:55:04,680: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:55:04.702001502Z [2024-04-05 22:55:04,701: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T22:55:04.703336195Z [2024-04-05 22:55:04,703: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:55:04.703444569Z [2024-04-05 22:55:04,703: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:55:04.703492827Z [2024-04-05 22:55:04,703: INFO/ForkPoolWorker-15] Read VIM fe56ae22-7961-4710-9ad3-f363d7f4bbdf (basic_08_vim_test) 2024-04-05T22:55:04.703698511Z [2024-04-05 22:55:04,703: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'fe56ae22-7961-4710-9ad3-f363d7f4bbdf', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-05T22:55:04.703732617Z [2024-04-05 22:55:04,703: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T22:55:04.704370633Z [2024-04-05 22:55:04,704: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T22:55:04.704441411Z [2024-04-05 22:55:04,704: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:55:04.710751848Z [2024-04-05 22:55:04,710: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fe56ae22-7961-4710-9ad3-f363d7f4bbdf 2024-04-05T22:55:04.819905623Z [2024-04-05 22:55:04,819: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:55:04.826066908Z [2024-04-05 22:55:04,825: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:55:04.998887487Z [2024-04-05 22:55:04,998: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-05T22:55:05.008807225Z [2024-04-05 22:55:05,008: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:55:05.061192383Z [2024-04-05 22:55:05,060: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T22:55:05.066301912Z [2024-04-05 22:55:05,065: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:55:05.067837044Z [2024-04-05 22:55:05,067: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:55:05.068058522Z [2024-04-05 22:55:05,067: INFO/ForkPoolWorker-16] Read VIM fe56ae22-7961-4710-9ad3-f363d7f4bbdf (basic_08_vim_test) 2024-04-05T22:55:05.068842802Z [2024-04-05 22:55:05,068: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'fe56ae22-7961-4710-9ad3-f363d7f4bbdf', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-05T22:55:05.069475395Z [2024-04-05 22:55:05,069: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-05T22:55:05.069976479Z [2024-04-05 22:55:05,069: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T22:55:05.070688887Z [2024-04-05 22:55:05,070: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:55:05.092844302Z [2024-04-05 22:55:05,092: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_fe56ae22-7961-4710-9ad3-f363d7f4bbdf 2024-04-05T22:55:05.195284812Z [2024-04-05 22:55:05,194: INFO/ForkPoolWorker-5] Getting VIM list 2024-04-05T22:55:05.212479381Z [2024-04-05 22:55:05,212: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:55:05.228818309Z [2024-04-05 22:55:05,228: INFO/ForkPoolWorker-5] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:55:05.309004244Z [2024-04-05 22:55:05,308: INFO/ForkPoolWorker-5] Connected to database osm version 1.2 2024-04-05T22:55:05.310614506Z [2024-04-05 22:55:05,310: INFO/ForkPoolWorker-5] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:55:05.310634900Z [2024-04-05 22:55:05,310: INFO/ForkPoolWorker-5] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:55:05.310732790Z [2024-04-05 22:55:05,310: INFO/ForkPoolWorker-5] Read VIM fe56ae22-7961-4710-9ad3-f363d7f4bbdf (basic_08_vim_test) 2024-04-05T22:55:05.310943237Z [2024-04-05 22:55:05,310: INFO/ForkPoolWorker-5] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'fe56ae22-7961-4710-9ad3-f363d7f4bbdf', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-05T22:55:05.311064617Z [2024-04-05 22:55:05,310: INFO/ForkPoolWorker-5] Getting VIM list OK 2024-04-05T22:55:05.311506365Z [2024-04-05 22:55:05,311: INFO/ForkPoolWorker-5] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T22:55:05.311669569Z [2024-04-05 22:55:05,311: INFO/ForkPoolWorker-5] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:55:05.316968347Z [2024-04-05 22:55:05,316: INFO/ForkPoolWorker-5] Creating DAG vim_status_fe56ae22-7961-4710-9ad3-f363d7f4bbdf 2024-04-05T22:55:05.433572666Z [2024-04-05 22:55:05,433: INFO/ForkPoolWorker-5] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:55:05.462912350Z [2024-04-05 22:55:05,462: INFO/ForkPoolWorker-4] Getting VIM list 2024-04-05T22:55:05.471879622Z [2024-04-05 22:55:05,471: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:55:05.540500488Z [2024-04-05 22:55:05,540: INFO/ForkPoolWorker-4] Connected to database osm version 1.2 2024-04-05T22:55:05.547597455Z [2024-04-05 22:55:05,547: INFO/ForkPoolWorker-4] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:55:05.547625575Z [2024-04-05 22:55:05,547: INFO/ForkPoolWorker-4] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:55:05.547638722Z [2024-04-05 22:55:05,547: INFO/ForkPoolWorker-4] Read VIM fe56ae22-7961-4710-9ad3-f363d7f4bbdf (basic_08_vim_test) 2024-04-05T22:55:05.547854851Z [2024-04-05 22:55:05,547: INFO/ForkPoolWorker-4] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'fe56ae22-7961-4710-9ad3-f363d7f4bbdf', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-05T22:55:05.547880580Z [2024-04-05 22:55:05,547: INFO/ForkPoolWorker-4] Getting VIM list OK 2024-04-05T22:55:05.548204234Z [2024-04-05 22:55:05,548: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T22:55:05.548218446Z [2024-04-05 22:55:05,548: INFO/ForkPoolWorker-4] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:55:05.574129411Z [2024-04-05 22:55:05,573: INFO/ForkPoolWorker-4] Creating DAG vim_status_fe56ae22-7961-4710-9ad3-f363d7f4bbdf 2024-04-05T22:55:05.728556862Z [2024-04-05 22:55:05,728: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-05T22:55:05.736214621Z [2024-04-05 22:55:05,735: INFO/ForkPoolWorker-4] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:55:05.737890354Z [2024-04-05 22:55:05,737: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:55:05.782252556Z [2024-04-05 22:55:05,782: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-05T22:55:05.783654865Z [2024-04-05 22:55:05,783: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:55:05.783865890Z [2024-04-05 22:55:05,783: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:55:05.784041359Z [2024-04-05 22:55:05,783: INFO/ForkPoolWorker-1] Read VIM fe56ae22-7961-4710-9ad3-f363d7f4bbdf (basic_08_vim_test) 2024-04-05T22:55:05.784250675Z [2024-04-05 22:55:05,784: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'fe56ae22-7961-4710-9ad3-f363d7f4bbdf', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-05T22:55:05.784383529Z [2024-04-05 22:55:05,784: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-05T22:55:05.784689203Z [2024-04-05 22:55:05,784: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-05T22:55:05.784937365Z [2024-04-05 22:55:05,784: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:55:05.795111179Z [2024-04-05 22:55:05,792: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_fe56ae22-7961-4710-9ad3-f363d7f4bbdf 2024-04-05T22:55:05.900182126Z [2024-04-05 22:55:05,899: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8623003c-df85-4afa-888e-e684c84c2d7d] succeeded in 4.699530515000106s: None 2024-04-05T22:55:05.968197631Z [2024-04-05 22:55:05,967: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:55:06.144416674Z [2024-04-05 22:55:06,144: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f2cbcc91-54ec-4e36-86b1-f6e71ac30aa0] succeeded in 4.945262980000052s: None 2024-04-05T22:55:06.318281312Z [2024-04-05 22:55:06,317: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a6281bb5-2778-49d8-9b1e-0795eedc608c] received 2024-04-05T22:55:06.326684562Z [2024-04-05 22:55:06,326: INFO/ForkPoolWorker-15] [a6281bb5-2778-49d8-9b1e-0795eedc608c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fe56ae22-7961-4710-9ad3-f363d7f4bbdf', 'split_metrics', 'scheduled__2024-04-05T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T22:55:06.332416813Z [2024-04-05 22:55:06,332: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7c82aadc-e960-4c90-bde3-dc9ea439f7d7] received 2024-04-05T22:55:06.340375859Z [2024-04-05 22:55:06,340: INFO/ForkPoolWorker-16] [7c82aadc-e960-4c90-bde3-dc9ea439f7d7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'split_metrics', 'scheduled__2024-04-05T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T22:55:06.618122549Z [2024-04-05 22:55:06,614: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T22:55:06.652818117Z [2024-04-05 22:55:06,649: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T22:55:07.236649831Z [2024-04-05 22:55:07,236: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[ce3251ca-3fdb-4f78-8d5f-4846cac57a8b] succeeded in 5.989173086000164s: None 2024-04-05T22:55:07.621018728Z [2024-04-05 22:55:07,620: INFO/ForkPoolWorker-5] Task airflow.executors.celery_executor.execute_command[0c90d2a3-0f13-4f96-9513-dacc0e1525f4] succeeded in 6.316283741999996s: None 2024-04-05T22:55:07.628275119Z [2024-04-05 22:55:07,627: INFO/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[9df3e02b-9aeb-471c-9508-dde788a93cc3] succeeded in 6.365534559000025s: None 2024-04-05T22:55:07.880001190Z [2024-04-05 22:55:07,879: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-05T22:55:07.883224080Z [2024-04-05 22:55:07,882: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:55:07.902590364Z [2024-04-05 22:55:07,902: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T22:55:07.906126324Z [2024-04-05 22:55:07,905: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:55:07.916823208Z [2024-04-05 22:55:07,916: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T22:55:07.918477709Z [2024-04-05 22:55:07,918: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:55:07.918540353Z [2024-04-05 22:55:07,918: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:55:07.918613981Z [2024-04-05 22:55:07,918: INFO/ForkPoolWorker-16] Read VIM fe56ae22-7961-4710-9ad3-f363d7f4bbdf (basic_08_vim_test) 2024-04-05T22:55:07.918765521Z [2024-04-05 22:55:07,918: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'fe56ae22-7961-4710-9ad3-f363d7f4bbdf', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-05T22:55:07.918836362Z [2024-04-05 22:55:07,918: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-05T22:55:07.919120505Z [2024-04-05 22:55:07,918: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T22:55:07.919560804Z [2024-04-05 22:55:07,919: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:55:07.928179513Z [2024-04-05 22:55:07,927: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T22:55:07.929370795Z [2024-04-05 22:55:07,929: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_fe56ae22-7961-4710-9ad3-f363d7f4bbdf 2024-04-05T22:55:07.929382429Z [2024-04-05 22:55:07,929: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:55:07.929561929Z [2024-04-05 22:55:07,929: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:55:07.929716828Z [2024-04-05 22:55:07,929: INFO/ForkPoolWorker-15] Read VIM fe56ae22-7961-4710-9ad3-f363d7f4bbdf (basic_08_vim_test) 2024-04-05T22:55:07.929920593Z [2024-04-05 22:55:07,929: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'fe56ae22-7961-4710-9ad3-f363d7f4bbdf', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-05T22:55:07.929944801Z [2024-04-05 22:55:07,929: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T22:55:07.930205402Z [2024-04-05 22:55:07,930: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T22:55:07.930314685Z [2024-04-05 22:55:07,930: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:55:07.936093160Z [2024-04-05 22:55:07,935: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fe56ae22-7961-4710-9ad3-f363d7f4bbdf 2024-04-05T22:55:08.016501975Z [2024-04-05 22:55:08,016: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:55:08.023138633Z [2024-04-05 22:55:08,022: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:55:08.062003137Z [2024-04-05 22:55:08,061: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[037bcd23-40d8-457b-9280-c48873e38e9e] succeeded in 6.859053572999983s: None 2024-04-05T22:55:08.649424334Z [2024-04-05 22:55:08,648: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a6281bb5-2778-49d8-9b1e-0795eedc608c] succeeded in 2.3292751769999995s: None 2024-04-05T22:55:08.671347783Z [2024-04-05 22:55:08,670: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7c82aadc-e960-4c90-bde3-dc9ea439f7d7] succeeded in 2.3372575149999193s: None 2024-04-05T22:55:08.984572690Z [2024-04-05 22:55:08,984: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[99f2918a-f703-4647-b25a-2fc284818f3a] received 2024-04-05T22:55:08.987286446Z [2024-04-05 22:55:08,986: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a6199dd8-6f04-4ca7-8370-fb67951d8fa2] received 2024-04-05T22:55:08.993401151Z [2024-04-05 22:55:08,993: INFO/ForkPoolWorker-16] [a6199dd8-6f04-4ca7-8370-fb67951d8fa2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fe56ae22-7961-4710-9ad3-f363d7f4bbdf', 'collect_metrics', 'scheduled__2024-04-05T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T22:55:08.999166442Z [2024-04-05 22:55:08,998: INFO/ForkPoolWorker-15] [99f2918a-f703-4647-b25a-2fc284818f3a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'collect_metrics', 'scheduled__2024-04-05T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T22:55:09.253803193Z [2024-04-05 22:55:09,250: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T22:55:09.295395136Z [2024-04-05 22:55:09,292: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T22:55:10.461948685Z [2024-04-05 22:55:10,461: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T22:55:10.465134829Z [2024-04-05 22:55:10,464: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:55:10.492461222Z [2024-04-05 22:55:10,492: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T22:55:10.494480725Z [2024-04-05 22:55:10,494: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:55:10.494525529Z [2024-04-05 22:55:10,494: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:55:10.494645358Z [2024-04-05 22:55:10,494: INFO/ForkPoolWorker-15] Read VIM fe56ae22-7961-4710-9ad3-f363d7f4bbdf (basic_08_vim_test) 2024-04-05T22:55:10.494877275Z [2024-04-05 22:55:10,494: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'fe56ae22-7961-4710-9ad3-f363d7f4bbdf', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-05T22:55:10.494977064Z [2024-04-05 22:55:10,494: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T22:55:10.495374964Z [2024-04-05 22:55:10,495: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T22:55:10.495585589Z [2024-04-05 22:55:10,495: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:55:10.504659329Z [2024-04-05 22:55:10,504: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fe56ae22-7961-4710-9ad3-f363d7f4bbdf 2024-04-05T22:55:10.524748702Z [2024-04-05 22:55:10,524: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-05T22:55:10.528030962Z [2024-04-05 22:55:10,527: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:55:10.549461239Z [2024-04-05 22:55:10,549: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T22:55:10.550668916Z [2024-04-05 22:55:10,550: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:55:10.550703102Z [2024-04-05 22:55:10,550: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:55:10.550810577Z [2024-04-05 22:55:10,550: INFO/ForkPoolWorker-16] Read VIM fe56ae22-7961-4710-9ad3-f363d7f4bbdf (basic_08_vim_test) 2024-04-05T22:55:10.551011260Z [2024-04-05 22:55:10,550: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'fe56ae22-7961-4710-9ad3-f363d7f4bbdf', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-05T22:55:10.551067173Z [2024-04-05 22:55:10,550: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-05T22:55:10.551482013Z [2024-04-05 22:55:10,551: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T22:55:10.551535414Z [2024-04-05 22:55:10,551: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:55:10.557873637Z [2024-04-05 22:55:10,557: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_fe56ae22-7961-4710-9ad3-f363d7f4bbdf 2024-04-05T22:55:10.599757960Z [2024-04-05 22:55:10,599: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:55:10.661424066Z [2024-04-05 22:55:10,661: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:55:11.182304896Z [2024-04-05 22:55:11,181: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[99f2918a-f703-4647-b25a-2fc284818f3a] succeeded in 2.1919442400001117s: None 2024-04-05T22:55:11.203506390Z [2024-04-05 22:55:11,202: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a6199dd8-6f04-4ca7-8370-fb67951d8fa2] succeeded in 2.214754515999857s: None 2024-04-05T22:55:12.059153668Z [2024-04-05 22:55:12,058: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[63279a2c-baca-4e10-add3-171a8bbfca22] received 2024-04-05T22:55:12.062098895Z [2024-04-05 22:55:12,061: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8980538b-eac7-47a8-80e2-06fd05615e42] received 2024-04-05T22:55:12.072347307Z [2024-04-05 22:55:12,072: INFO/ForkPoolWorker-15] [63279a2c-baca-4e10-add3-171a8bbfca22] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'send_prometheus', 'scheduled__2024-04-05T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T22:55:12.075361114Z [2024-04-05 22:55:12,075: INFO/ForkPoolWorker-16] [8980538b-eac7-47a8-80e2-06fd05615e42] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fe56ae22-7961-4710-9ad3-f363d7f4bbdf', 'send_prometheus', 'scheduled__2024-04-05T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T22:55:12.399774138Z [2024-04-05 22:55:12,395: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T22:55:12.414538688Z [2024-04-05 22:55:12,410: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T22:55:13.665598508Z [2024-04-05 22:55:13,665: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-05T22:55:13.668896018Z [2024-04-05 22:55:13,668: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:55:13.718010290Z [2024-04-05 22:55:13,707: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T22:55:13.718038595Z [2024-04-05 22:55:13,711: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T22:55:13.718042893Z [2024-04-05 22:55:13,713: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:55:13.718046820Z [2024-04-05 22:55:13,713: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:55:13.718050164Z [2024-04-05 22:55:13,713: INFO/ForkPoolWorker-16] Read VIM fe56ae22-7961-4710-9ad3-f363d7f4bbdf (basic_08_vim_test) 2024-04-05T22:55:13.718066491Z [2024-04-05 22:55:13,713: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'fe56ae22-7961-4710-9ad3-f363d7f4bbdf', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-05T22:55:13.718070100Z [2024-04-05 22:55:13,713: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-05T22:55:13.718073176Z [2024-04-05 22:55:13,714: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T22:55:13.718076088Z [2024-04-05 22:55:13,714: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:55:13.718080034Z [2024-04-05 22:55:13,714: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:55:13.722471186Z [2024-04-05 22:55:13,720: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_fe56ae22-7961-4710-9ad3-f363d7f4bbdf 2024-04-05T22:55:13.781471913Z [2024-04-05 22:55:13,781: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T22:55:13.784251464Z [2024-04-05 22:55:13,783: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:55:13.784271816Z [2024-04-05 22:55:13,784: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:55:13.784392470Z [2024-04-05 22:55:13,784: INFO/ForkPoolWorker-15] Read VIM fe56ae22-7961-4710-9ad3-f363d7f4bbdf (basic_08_vim_test) 2024-04-05T22:55:13.784642171Z [2024-04-05 22:55:13,784: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'fe56ae22-7961-4710-9ad3-f363d7f4bbdf', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-05T22:55:13.784790084Z [2024-04-05 22:55:13,784: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T22:55:13.785166515Z [2024-04-05 22:55:13,784: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T22:55:13.785723633Z [2024-04-05 22:55:13,785: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:55:13.792254401Z [2024-04-05 22:55:13,792: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fe56ae22-7961-4710-9ad3-f363d7f4bbdf 2024-04-05T22:55:13.814233769Z [2024-04-05 22:55:13,813: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:55:13.883125975Z [2024-04-05 22:55:13,882: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:55:14.401838647Z [2024-04-05 22:55:14,398: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8980538b-eac7-47a8-80e2-06fd05615e42] succeeded in 2.3351779160000206s: None 2024-04-05T22:55:14.453296949Z [2024-04-05 22:55:14,452: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[63279a2c-baca-4e10-add3-171a8bbfca22] succeeded in 2.389496782999913s: None 2024-04-05T22:56:00.370878044Z [2024-04-05 22:56:00,370: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bee37fb3-65b9-46d9-b88b-09886f5bfd3f] received 2024-04-05T22:56:00.379184802Z [2024-04-05 22:56:00,378: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4807ad21-a11c-4704-b7e7-4b07598c333f] received 2024-04-05T22:56:00.384772064Z [2024-04-05 22:56:00,384: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fbfbf84d-edd5-40c0-bfaf-b37b85e0eae2] received 2024-04-05T22:56:00.391150172Z [2024-04-05 22:56:00,390: INFO/ForkPoolWorker-16] [4807ad21-a11c-4704-b7e7-4b07598c333f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T22:56:00.400144869Z [2024-04-05 22:56:00,399: INFO/ForkPoolWorker-15] [bee37fb3-65b9-46d9-b88b-09886f5bfd3f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T22:56:00.403295347Z [2024-04-05 22:56:00,402: INFO/ForkPoolWorker-1] [fbfbf84d-edd5-40c0-bfaf-b37b85e0eae2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T22:56:00.406690354Z [2024-04-05 22:56:00,406: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[77aab264-7fae-4b2d-86a5-4674b65b26d4] received 2024-04-05T22:56:00.410087557Z [2024-04-05 22:56:00,409: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[596a55b4-4e5b-49f0-845d-133e0e08df61] received 2024-04-05T22:56:00.432891199Z [2024-04-05 22:56:00,432: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[532acdf5-f2fb-4047-bd04-1cebec4c8f83] received 2024-04-05T22:56:00.438848189Z [2024-04-05 22:56:00,438: INFO/ForkPoolWorker-2] [77aab264-7fae-4b2d-86a5-4674b65b26d4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fe56ae22-7961-4710-9ad3-f363d7f4bbdf', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T22:56:00.450938713Z [2024-04-05 22:56:00,443: INFO/ForkPoolWorker-3] [596a55b4-4e5b-49f0-845d-133e0e08df61] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T22:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T22:56:00.481120833Z [2024-04-05 22:56:00,480: INFO/ForkPoolWorker-4] [532acdf5-f2fb-4047-bd04-1cebec4c8f83] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fe56ae22-7961-4710-9ad3-f363d7f4bbdf', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T22:56:00.975408186Z [2024-04-05 22:56:00,971: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-05T22:56:01.135967770Z [2024-04-05 22:56:01,128: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T22:56:01.169337129Z [2024-04-05 22:56:01,165: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-05T22:56:01.285898962Z [2024-04-05 22:56:01,285: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:56:01.349961355Z [2024-04-05 22:56:01,327: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T22:56:01.362524567Z [2024-04-05 22:56:01,358: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T22:56:01.384020261Z [2024-04-05 22:56:01,361: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T22:56:01.593610792Z [2024-04-05 22:56:01,593: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-05T22:56:01.608663304Z [2024-04-05 22:56:01,608: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:56:01.702070326Z [2024-04-05 22:56:01,701: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-05T22:56:01.709207079Z [2024-04-05 22:56:01,708: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-05T22:56:01.709403542Z [2024-04-05 22:56:01,709: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-05T22:56:01.709530549Z [2024-04-05 22:56:01,709: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-05T22:56:01.709838879Z [2024-04-05 22:56:01,709: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-05T22:56:01.916118551Z [2024-04-05 22:56:01,915: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:56:02.257015605Z [2024-04-05 22:56:02,256: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[596a55b4-4e5b-49f0-845d-133e0e08df61] succeeded in 1.8314266790002875s: None 2024-04-05T22:56:02.623677014Z [2024-04-05 22:56:02,623: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[fbfbf84d-edd5-40c0-bfaf-b37b85e0eae2] succeeded in 2.2344170619999204s: None 2024-04-05T22:56:02.917748378Z [2024-04-05 22:56:02,917: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-05T22:56:02.921639699Z [2024-04-05 22:56:02,921: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:56:02.954833369Z [2024-04-05 22:56:02,954: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-05T22:56:02.958900027Z [2024-04-05 22:56:02,958: INFO/ForkPoolWorker-2] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:56:02.958914270Z [2024-04-05 22:56:02,958: INFO/ForkPoolWorker-2] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:56:02.959044990Z [2024-04-05 22:56:02,958: INFO/ForkPoolWorker-2] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T22:56:02.959057346Z [2024-04-05 22:56:02,958: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-05T22:56:02.959437124Z [2024-04-05 22:56:02,959: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-05T22:56:02.959448635Z [2024-04-05 22:56:02,959: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:56:02.966179609Z [2024-04-05 22:56:02,965: WARNING/ForkPoolWorker-2] Dag 'vm_status_vim_fe56ae22-7961-4710-9ad3-f363d7f4bbdf' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T22:56:02.967427980Z [2024-04-05 22:56:02,966: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T22:56:02.968344045Z [2024-04-05 22:56:02,968: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-05T22:56:02.970836438Z [2024-04-05 22:56:02,970: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:56:03.012264362Z [2024-04-05 22:56:03,012: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-05T22:56:03.016372667Z [2024-04-05 22:56:03,016: INFO/ForkPoolWorker-2] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:56:03.016390012Z [2024-04-05 22:56:03,016: INFO/ForkPoolWorker-2] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:56:03.016520693Z [2024-04-05 22:56:03,016: INFO/ForkPoolWorker-2] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T22:56:03.016552588Z [2024-04-05 22:56:03,016: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-05T22:56:03.016895021Z [2024-04-05 22:56:03,016: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-05T22:56:03.016919043Z [2024-04-05 22:56:03,016: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:56:03.020454750Z [2024-04-05 22:56:03,019: ERROR/ForkPoolWorker-2] [77aab264-7fae-4b2d-86a5-4674b65b26d4] Failed to execute task Dag 'vm_status_vim_fe56ae22-7961-4710-9ad3-f363d7f4bbdf' could not be found; either it does not exist or it failed to parse.. 2024-04-05T22:56:03.020473805Z Traceback (most recent call last): 2024-04-05T22:56:03.020479298Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-05T22:56:03.020483609Z args.func(args) 2024-04-05T22:56:03.020487371Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-05T22:56:03.020492845Z return func(*args, **kwargs) 2024-04-05T22:56:03.020496107Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-05T22:56:03.020499806Z return f(*args, **kwargs) 2024-04-05T22:56:03.020503301Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-05T22:56:03.020506774Z dag = get_dag(args.subdir, args.dag_id) 2024-04-05T22:56:03.020509957Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-05T22:56:03.020513030Z raise AirflowException( 2024-04-05T22:56:03.020517170Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_fe56ae22-7961-4710-9ad3-f363d7f4bbdf' could not be found; either it does not exist or it failed to parse. 2024-04-05T22:56:03.059289801Z [2024-04-05 22:56:03,058: ERROR/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[77aab264-7fae-4b2d-86a5-4674b65b26d4] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 77aab264-7fae-4b2d-86a5-4674b65b26d4') 2024-04-05T22:56:03.059337495Z Traceback (most recent call last): 2024-04-05T22:56:03.059341334Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-05T22:56:03.059344748Z R = retval = fun(*args, **kwargs) 2024-04-05T22:56:03.059347665Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-05T22:56:03.059350774Z return self.run(*args, **kwargs) 2024-04-05T22:56:03.059354233Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-05T22:56:03.059357794Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-05T22:56:03.059360584Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-05T22:56:03.059363959Z raise AirflowException(msg) 2024-04-05T22:56:03.059367906Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 77aab264-7fae-4b2d-86a5-4674b65b26d4 2024-04-05T22:56:03.238790453Z [2024-04-05 22:56:03,236: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-05T22:56:03.243607333Z [2024-04-05 22:56:03,242: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:56:03.277287896Z [2024-04-05 22:56:03,277: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T22:56:03.278454121Z [2024-04-05 22:56:03,278: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:56:03.278493748Z [2024-04-05 22:56:03,278: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:56:03.278585342Z [2024-04-05 22:56:03,278: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T22:56:03.278615983Z [2024-04-05 22:56:03,278: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-05T22:56:03.278819684Z [2024-04-05 22:56:03,278: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-05T22:56:03.278850976Z [2024-04-05 22:56:03,278: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:56:03.385337008Z [2024-04-05 22:56:03,384: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:56:03.484635276Z [2024-04-05 22:56:03,484: INFO/ForkPoolWorker-4] Getting VIM list 2024-04-05T22:56:03.487934591Z [2024-04-05 22:56:03,487: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:56:03.493831281Z [2024-04-05 22:56:03,493: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T22:56:03.497766001Z [2024-04-05 22:56:03,497: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:56:03.518901101Z [2024-04-05 22:56:03,518: INFO/ForkPoolWorker-4] Connected to database osm version 1.2 2024-04-05T22:56:03.522605703Z [2024-04-05 22:56:03,522: INFO/ForkPoolWorker-4] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:56:03.522776778Z [2024-04-05 22:56:03,522: INFO/ForkPoolWorker-4] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:56:03.523094040Z [2024-04-05 22:56:03,522: INFO/ForkPoolWorker-4] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T22:56:03.523119659Z [2024-04-05 22:56:03,523: INFO/ForkPoolWorker-4] Getting VIM list OK 2024-04-05T22:56:03.523479918Z [2024-04-05 22:56:03,523: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T22:56:03.523492376Z [2024-04-05 22:56:03,523: INFO/ForkPoolWorker-4] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:56:03.527594295Z [2024-04-05 22:56:03,527: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T22:56:03.530425423Z [2024-04-05 22:56:03,530: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:56:03.530591922Z [2024-04-05 22:56:03,530: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:56:03.530790911Z [2024-04-05 22:56:03,530: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T22:56:03.530902731Z [2024-04-05 22:56:03,530: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T22:56:03.531203129Z [2024-04-05 22:56:03,531: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T22:56:03.531882022Z [2024-04-05 22:56:03,531: INFO/ForkPoolWorker-15] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:56:03.532309082Z [2024-04-05 22:56:03,531: WARNING/ForkPoolWorker-4] Dag 'vim_status_fe56ae22-7961-4710-9ad3-f363d7f4bbdf' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T22:56:03.533157695Z [2024-04-05 22:56:03,532: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T22:56:03.534007803Z [2024-04-05 22:56:03,533: INFO/ForkPoolWorker-4] Getting VIM list 2024-04-05T22:56:03.536830045Z [2024-04-05 22:56:03,536: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:56:03.573794792Z [2024-04-05 22:56:03,573: INFO/ForkPoolWorker-4] Connected to database osm version 1.2 2024-04-05T22:56:03.575943581Z [2024-04-05 22:56:03,575: INFO/ForkPoolWorker-4] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:56:03.575986649Z [2024-04-05 22:56:03,575: INFO/ForkPoolWorker-4] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:56:03.576042824Z [2024-04-05 22:56:03,575: INFO/ForkPoolWorker-4] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T22:56:03.576081477Z [2024-04-05 22:56:03,576: INFO/ForkPoolWorker-4] Getting VIM list OK 2024-04-05T22:56:03.576323855Z [2024-04-05 22:56:03,576: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T22:56:03.576368691Z [2024-04-05 22:56:03,576: INFO/ForkPoolWorker-4] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:56:03.581315529Z [2024-04-05 22:56:03,580: ERROR/ForkPoolWorker-4] [532acdf5-f2fb-4047-bd04-1cebec4c8f83] Failed to execute task Dag 'vim_status_fe56ae22-7961-4710-9ad3-f363d7f4bbdf' could not be found; either it does not exist or it failed to parse.. 2024-04-05T22:56:03.581330014Z Traceback (most recent call last): 2024-04-05T22:56:03.581334540Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-05T22:56:03.581338387Z args.func(args) 2024-04-05T22:56:03.581342214Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-05T22:56:03.581346584Z return func(*args, **kwargs) 2024-04-05T22:56:03.581350148Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-05T22:56:03.581353487Z return f(*args, **kwargs) 2024-04-05T22:56:03.581356701Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-05T22:56:03.581359861Z dag = get_dag(args.subdir, args.dag_id) 2024-04-05T22:56:03.581363029Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-05T22:56:03.581365949Z raise AirflowException( 2024-04-05T22:56:03.581373033Z airflow.exceptions.AirflowException: Dag 'vim_status_fe56ae22-7961-4710-9ad3-f363d7f4bbdf' could not be found; either it does not exist or it failed to parse. 2024-04-05T22:56:03.623758812Z [2024-04-05 22:56:03,622: ERROR/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[532acdf5-f2fb-4047-bd04-1cebec4c8f83] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 532acdf5-f2fb-4047-bd04-1cebec4c8f83') 2024-04-05T22:56:03.623788100Z Traceback (most recent call last): 2024-04-05T22:56:03.623792426Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-05T22:56:03.623795693Z R = retval = fun(*args, **kwargs) 2024-04-05T22:56:03.623799343Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-05T22:56:03.623802865Z return self.run(*args, **kwargs) 2024-04-05T22:56:03.623806802Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-05T22:56:03.623814357Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-05T22:56:03.623817554Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-05T22:56:03.623821239Z raise AirflowException(msg) 2024-04-05T22:56:03.623825726Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 532acdf5-f2fb-4047-bd04-1cebec4c8f83 2024-04-05T22:56:03.642737584Z [2024-04-05 22:56:03,642: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:56:05.644335023Z [2024-04-05 22:56:05,643: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bee37fb3-65b9-46d9-b88b-09886f5bfd3f] succeeded in 5.266188864000014s: None 2024-04-05T22:56:05.704933288Z [2024-04-05 22:56:05,704: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4807ad21-a11c-4704-b7e7-4b07598c333f] succeeded in 5.3209415390001595s: None 2024-04-05T22:56:13.625500518Z [2024-04-05 22:56:13,625: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d5a9549e-d487-4594-ac50-223ed40d22c9] received 2024-04-05T22:56:13.650982670Z [2024-04-05 22:56:13,650: INFO/ForkPoolWorker-15] [d5a9549e-d487-4594-ac50-223ed40d22c9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fe56ae22-7961-4710-9ad3-f363d7f4bbdf', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T22:56:14.010654215Z [2024-04-05 22:56:14,007: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T22:56:14.899349717Z [2024-04-05 22:56:14,899: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b6ca9075-61f7-4b61-b496-202b7ac6f23a] received 2024-04-05T22:56:14.909457280Z [2024-04-05 22:56:14,909: INFO/ForkPoolWorker-16] [b6ca9075-61f7-4b61-b496-202b7ac6f23a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fe56ae22-7961-4710-9ad3-f363d7f4bbdf', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T22:56:15.115771970Z [2024-04-05 22:56:15,114: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T22:56:15.118796854Z [2024-04-05 22:56:15,118: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:56:15.143340843Z [2024-04-05 22:56:15,142: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T22:56:15.145639901Z [2024-04-05 22:56:15,145: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:56:15.145660047Z [2024-04-05 22:56:15,145: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:56:15.145821107Z [2024-04-05 22:56:15,145: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T22:56:15.145838957Z [2024-04-05 22:56:15,145: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T22:56:15.146143589Z [2024-04-05 22:56:15,145: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-05T22:56:15.146292382Z [2024-04-05 22:56:15,146: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:56:15.154404697Z [2024-04-05 22:56:15,153: WARNING/ForkPoolWorker-15] Dag 'vm_status_vim_fe56ae22-7961-4710-9ad3-f363d7f4bbdf' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T22:56:15.155126063Z [2024-04-05 22:56:15,154: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T22:56:15.155972601Z [2024-04-05 22:56:15,155: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T22:56:15.158645674Z [2024-04-05 22:56:15,158: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:56:15.176818040Z [2024-04-05 22:56:15,176: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T22:56:15.178169568Z [2024-04-05 22:56:15,177: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:56:15.178184456Z [2024-04-05 22:56:15,178: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:56:15.178342505Z [2024-04-05 22:56:15,178: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T22:56:15.178379199Z [2024-04-05 22:56:15,178: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T22:56:15.178907242Z [2024-04-05 22:56:15,178: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-05T22:56:15.178933588Z [2024-04-05 22:56:15,178: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:56:15.183035909Z [2024-04-05 22:56:15,182: ERROR/ForkPoolWorker-15] [d5a9549e-d487-4594-ac50-223ed40d22c9] Failed to execute task Dag 'vm_status_vim_fe56ae22-7961-4710-9ad3-f363d7f4bbdf' could not be found; either it does not exist or it failed to parse.. 2024-04-05T22:56:15.183049709Z Traceback (most recent call last): 2024-04-05T22:56:15.183053361Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-05T22:56:15.183057043Z args.func(args) 2024-04-05T22:56:15.183060684Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-05T22:56:15.183065422Z return func(*args, **kwargs) 2024-04-05T22:56:15.183068351Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-05T22:56:15.183071379Z return f(*args, **kwargs) 2024-04-05T22:56:15.183074237Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-05T22:56:15.183088862Z dag = get_dag(args.subdir, args.dag_id) 2024-04-05T22:56:15.183091986Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-05T22:56:15.183095006Z raise AirflowException( 2024-04-05T22:56:15.183098342Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_fe56ae22-7961-4710-9ad3-f363d7f4bbdf' could not be found; either it does not exist or it failed to parse. 2024-04-05T22:56:15.189994946Z [2024-04-05 22:56:15,186: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T22:56:15.214002302Z [2024-04-05 22:56:15,213: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d5a9549e-d487-4594-ac50-223ed40d22c9] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id d5a9549e-d487-4594-ac50-223ed40d22c9') 2024-04-05T22:56:15.214030744Z Traceback (most recent call last): 2024-04-05T22:56:15.214034912Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-05T22:56:15.214037850Z R = retval = fun(*args, **kwargs) 2024-04-05T22:56:15.214051927Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-05T22:56:15.214055162Z return self.run(*args, **kwargs) 2024-04-05T22:56:15.214058619Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-05T22:56:15.214063990Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-05T22:56:15.214085205Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-05T22:56:15.214088842Z raise AirflowException(msg) 2024-04-05T22:56:15.214092542Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id d5a9549e-d487-4594-ac50-223ed40d22c9 2024-04-05T22:56:16.397125551Z [2024-04-05 22:56:16,395: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-05T22:56:16.399395970Z [2024-04-05 22:56:16,398: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:56:16.419405683Z [2024-04-05 22:56:16,419: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T22:56:16.420783481Z [2024-04-05 22:56:16,420: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:56:16.420892351Z [2024-04-05 22:56:16,420: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:56:16.421123021Z [2024-04-05 22:56:16,420: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T22:56:16.421220733Z [2024-04-05 22:56:16,421: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-05T22:56:16.421513979Z [2024-04-05 22:56:16,421: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T22:56:16.421603462Z [2024-04-05 22:56:16,421: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:56:16.429843910Z [2024-04-05 22:56:16,429: WARNING/ForkPoolWorker-16] Dag 'vim_status_fe56ae22-7961-4710-9ad3-f363d7f4bbdf' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T22:56:16.430808480Z [2024-04-05 22:56:16,429: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T22:56:16.431761352Z [2024-04-05 22:56:16,431: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-05T22:56:16.434283485Z [2024-04-05 22:56:16,434: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:56:16.449409532Z [2024-04-05 22:56:16,449: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T22:56:16.450898960Z [2024-04-05 22:56:16,450: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:56:16.450943568Z [2024-04-05 22:56:16,450: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:56:16.451103029Z [2024-04-05 22:56:16,450: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T22:56:16.451184533Z [2024-04-05 22:56:16,451: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-05T22:56:16.451542159Z [2024-04-05 22:56:16,451: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T22:56:16.451644054Z [2024-04-05 22:56:16,451: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:56:16.455172335Z [2024-04-05 22:56:16,454: ERROR/ForkPoolWorker-16] [b6ca9075-61f7-4b61-b496-202b7ac6f23a] Failed to execute task Dag 'vim_status_fe56ae22-7961-4710-9ad3-f363d7f4bbdf' could not be found; either it does not exist or it failed to parse.. 2024-04-05T22:56:16.455205404Z Traceback (most recent call last): 2024-04-05T22:56:16.455210271Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-05T22:56:16.455215525Z args.func(args) 2024-04-05T22:56:16.455226088Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-05T22:56:16.455231915Z return func(*args, **kwargs) 2024-04-05T22:56:16.455235222Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-05T22:56:16.455238428Z return f(*args, **kwargs) 2024-04-05T22:56:16.455241548Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-05T22:56:16.455244889Z dag = get_dag(args.subdir, args.dag_id) 2024-04-05T22:56:16.455282999Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-05T22:56:16.455287544Z raise AirflowException( 2024-04-05T22:56:16.455292513Z airflow.exceptions.AirflowException: Dag 'vim_status_fe56ae22-7961-4710-9ad3-f363d7f4bbdf' could not be found; either it does not exist or it failed to parse. 2024-04-05T22:56:16.505365578Z [2024-04-05 22:56:16,504: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b6ca9075-61f7-4b61-b496-202b7ac6f23a] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id b6ca9075-61f7-4b61-b496-202b7ac6f23a') 2024-04-05T22:56:16.505390064Z Traceback (most recent call last): 2024-04-05T22:56:16.505395714Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-05T22:56:16.505399882Z R = retval = fun(*args, **kwargs) 2024-04-05T22:56:16.505404323Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-05T22:56:16.505408702Z return self.run(*args, **kwargs) 2024-04-05T22:56:16.505413574Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-05T22:56:16.505421409Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-05T22:56:16.505425628Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-05T22:56:16.505430443Z raise AirflowException(msg) 2024-04-05T22:56:16.505435269Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id b6ca9075-61f7-4b61-b496-202b7ac6f23a 2024-04-05T22:57:00.596446140Z [2024-04-05 22:57:00,596: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2e5d2395-b3c1-431e-b05f-f9292beeb545] received 2024-04-05T22:57:00.598237212Z [2024-04-05 22:57:00,598: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bb421465-3e0b-4bf2-923d-79f629a8e9c0] received 2024-04-05T22:57:00.605551393Z [2024-04-05 22:57:00,605: INFO/ForkPoolWorker-16] [bb421465-3e0b-4bf2-923d-79f629a8e9c0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T22:57:00.615306042Z [2024-04-05 22:57:00,614: INFO/ForkPoolWorker-15] [2e5d2395-b3c1-431e-b05f-f9292beeb545] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T22:57:00.624759414Z [2024-04-05 22:57:00,624: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5deb2161-a423-4e4b-876d-c69ab824c8d1] received 2024-04-05T22:57:00.643132885Z [2024-04-05 22:57:00,642: INFO/ForkPoolWorker-1] [5deb2161-a423-4e4b-876d-c69ab824c8d1] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T22:57:00.922550488Z [2024-04-05 22:57:00,918: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T22:57:00.929568590Z [2024-04-05 22:57:00,926: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T22:57:01.018152253Z [2024-04-05 22:57:01,014: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-05T22:57:01.187395364Z [2024-04-05 22:57:01,186: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-05T22:57:01.191585090Z [2024-04-05 22:57:01,190: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:57:01.217422907Z [2024-04-05 22:57:01,217: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-05T22:57:01.218532121Z [2024-04-05 22:57:01,218: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-05T22:57:01.218683335Z [2024-04-05 22:57:01,218: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-05T22:57:01.219467252Z [2024-04-05 22:57:01,218: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-05T22:57:01.220135848Z [2024-04-05 22:57:01,219: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-05T22:57:01.347248926Z [2024-04-05 22:57:01,346: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:57:02.007420298Z [2024-04-05 22:57:02,006: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5deb2161-a423-4e4b-876d-c69ab824c8d1] succeeded in 1.3786011779998262s: None 2024-04-05T22:57:02.219338446Z [2024-04-05 22:57:02,218: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T22:57:02.222811652Z [2024-04-05 22:57:02,222: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:57:02.260300805Z [2024-04-05 22:57:02,259: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-05T22:57:02.264302069Z [2024-04-05 22:57:02,263: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:57:02.281605770Z [2024-04-05 22:57:02,281: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T22:57:02.285749569Z [2024-04-05 22:57:02,285: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T22:57:02.287294552Z [2024-04-05 22:57:02,287: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:57:02.287310363Z [2024-04-05 22:57:02,287: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:57:02.287440373Z [2024-04-05 22:57:02,287: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T22:57:02.287465878Z [2024-04-05 22:57:02,287: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-05T22:57:02.287756440Z [2024-04-05 22:57:02,287: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-05T22:57:02.287797046Z [2024-04-05 22:57:02,287: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:57:02.291816106Z [2024-04-05 22:57:02,291: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:57:02.291826901Z [2024-04-05 22:57:02,291: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:57:02.291993762Z [2024-04-05 22:57:02,291: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T22:57:02.292062415Z [2024-04-05 22:57:02,291: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T22:57:02.292382014Z [2024-04-05 22:57:02,292: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T22:57:02.292390719Z [2024-04-05 22:57:02,292: INFO/ForkPoolWorker-15] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:57:02.379428245Z [2024-04-05 22:57:02,379: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:57:02.440705332Z [2024-04-05 22:57:02,440: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:57:04.034615451Z [2024-04-05 22:57:04,034: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2e5d2395-b3c1-431e-b05f-f9292beeb545] succeeded in 3.435161934000007s: None 2024-04-05T22:57:04.791641891Z [2024-04-05 22:57:04,791: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[bb421465-3e0b-4bf2-923d-79f629a8e9c0] succeeded in 4.191713282000364s: None 2024-04-05T22:58:00.616034724Z [2024-04-05 22:58:00,614: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[146e7d6e-bede-4632-89e4-ce94323c4b7b] received 2024-04-05T22:58:00.619370021Z [2024-04-05 22:58:00,619: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[70ef69c6-d0c6-4498-b5fd-3789ecc8f77e] received 2024-04-05T22:58:00.623522207Z [2024-04-05 22:58:00,622: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[31525d52-7574-4adf-9f0e-8117f15b1e96] received 2024-04-05T22:58:00.625952024Z [2024-04-05 22:58:00,625: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[599d8be1-a220-42a9-bc84-204570306720] received 2024-04-05T22:58:00.632652674Z [2024-04-05 22:58:00,631: INFO/ForkPoolWorker-15] [146e7d6e-bede-4632-89e4-ce94323c4b7b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T22:58:00.654105970Z [2024-04-05 22:58:00,653: INFO/ForkPoolWorker-1] [31525d52-7574-4adf-9f0e-8117f15b1e96] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T22:58:00.654729163Z [2024-04-05 22:58:00,654: INFO/ForkPoolWorker-16] [70ef69c6-d0c6-4498-b5fd-3789ecc8f77e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T22:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T22:58:00.659295420Z [2024-04-05 22:58:00,658: INFO/ForkPoolWorker-2] [599d8be1-a220-42a9-bc84-204570306720] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T22:58:00.969827024Z [2024-04-05 22:58:00,965: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T22:58:01.120386202Z [2024-04-05 22:58:01,116: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-05T22:58:01.128790216Z [2024-04-05 22:58:01,125: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T22:58:01.306425467Z [2024-04-05 22:58:01,301: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-05T22:58:01.405902470Z [2024-04-05 22:58:01,405: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:58:01.587417623Z [2024-04-05 22:58:01,586: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-05T22:58:01.591862987Z [2024-04-05 22:58:01,591: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:58:01.623661446Z [2024-04-05 22:58:01,623: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-05T22:58:01.624779230Z [2024-04-05 22:58:01,624: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-05T22:58:01.624852804Z [2024-04-05 22:58:01,624: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-05T22:58:01.624896302Z [2024-04-05 22:58:01,624: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-05T22:58:01.625093923Z [2024-04-05 22:58:01,624: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-05T22:58:01.746056646Z [2024-04-05 22:58:01,745: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:58:02.081306967Z [2024-04-05 22:58:02,080: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[70ef69c6-d0c6-4498-b5fd-3789ecc8f77e] succeeded in 1.4589836089999153s: None 2024-04-05T22:58:02.447969039Z [2024-04-05 22:58:02,447: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[31525d52-7574-4adf-9f0e-8117f15b1e96] succeeded in 1.8166777530000218s: None 2024-04-05T22:58:02.448837047Z [2024-04-05 22:58:02,448: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T22:58:02.452175569Z [2024-04-05 22:58:02,451: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:58:02.464008799Z [2024-04-05 22:58:02,463: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-05T22:58:02.467274439Z [2024-04-05 22:58:02,466: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:58:02.485712490Z [2024-04-05 22:58:02,485: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T22:58:02.488886723Z [2024-04-05 22:58:02,488: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:58:02.488919804Z [2024-04-05 22:58:02,488: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:58:02.489324806Z [2024-04-05 22:58:02,489: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T22:58:02.490737293Z [2024-04-05 22:58:02,489: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T22:58:02.490749883Z [2024-04-05 22:58:02,489: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T22:58:02.490753753Z [2024-04-05 22:58:02,489: INFO/ForkPoolWorker-15] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:58:02.497856185Z [2024-04-05 22:58:02,497: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-05T22:58:02.499623165Z [2024-04-05 22:58:02,499: INFO/ForkPoolWorker-2] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:58:02.499785514Z [2024-04-05 22:58:02,499: INFO/ForkPoolWorker-2] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:58:02.500043165Z [2024-04-05 22:58:02,499: INFO/ForkPoolWorker-2] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T22:58:02.500212786Z [2024-04-05 22:58:02,500: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-05T22:58:02.500516255Z [2024-04-05 22:58:02,500: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-05T22:58:02.500613653Z [2024-04-05 22:58:02,500: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:58:02.601175607Z [2024-04-05 22:58:02,600: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:58:02.605949109Z [2024-04-05 22:58:02,605: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:58:04.217022602Z [2024-04-05 22:58:04,215: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[146e7d6e-bede-4632-89e4-ce94323c4b7b] succeeded in 3.598057214000164s: None 2024-04-05T22:58:04.503170046Z [2024-04-05 22:58:04,502: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[599d8be1-a220-42a9-bc84-204570306720] succeeded in 3.8546050250001826s: None 2024-04-05T22:59:00.476758497Z [2024-04-05 22:59:00,476: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[62c62131-55eb-4557-a78a-2553ccb11067] received 2024-04-05T22:59:00.488942269Z [2024-04-05 22:59:00,488: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[211f5b3c-3de3-49f2-9865-883b382cfd04] received 2024-04-05T22:59:00.491327510Z [2024-04-05 22:59:00,490: INFO/ForkPoolWorker-15] [62c62131-55eb-4557-a78a-2553ccb11067] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T22:59:00.498482860Z [2024-04-05 22:59:00,498: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2558ddb0-de8c-4d63-ae95-6c5bc3f32e2c] received 2024-04-05T22:59:00.527827171Z [2024-04-05 22:59:00,527: INFO/ForkPoolWorker-1] [2558ddb0-de8c-4d63-ae95-6c5bc3f32e2c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T22:59:00.550273583Z [2024-04-05 22:59:00,549: INFO/ForkPoolWorker-16] [211f5b3c-3de3-49f2-9865-883b382cfd04] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T22:59:00.839852211Z [2024-04-05 22:59:00,835: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T22:59:00.869974728Z [2024-04-05 22:59:00,865: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T22:59:00.875719056Z [2024-04-05 22:59:00,871: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-05T22:59:01.047727561Z [2024-04-05 22:59:01,047: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-05T22:59:01.051972007Z [2024-04-05 22:59:01,051: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:59:01.082650027Z [2024-04-05 22:59:01,082: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-05T22:59:01.084018491Z [2024-04-05 22:59:01,083: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-05T22:59:01.084250483Z [2024-04-05 22:59:01,083: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-05T22:59:01.084304954Z [2024-04-05 22:59:01,084: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-05T22:59:01.084608819Z [2024-04-05 22:59:01,084: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-05T22:59:01.189571186Z [2024-04-05 22:59:01,189: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:59:01.964427519Z [2024-04-05 22:59:01,963: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2558ddb0-de8c-4d63-ae95-6c5bc3f32e2c] succeeded in 1.464216666000084s: None 2024-04-05T22:59:02.115992305Z [2024-04-05 22:59:02,115: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-05T22:59:02.119554100Z [2024-04-05 22:59:02,118: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:59:02.123233703Z [2024-04-05 22:59:02,122: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T22:59:02.129720774Z [2024-04-05 22:59:02,128: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T22:59:02.144587397Z [2024-04-05 22:59:02,144: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T22:59:02.148437889Z [2024-04-05 22:59:02,148: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:59:02.148548578Z [2024-04-05 22:59:02,148: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:59:02.148753754Z [2024-04-05 22:59:02,148: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T22:59:02.148876607Z [2024-04-05 22:59:02,148: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-05T22:59:02.149289718Z [2024-04-05 22:59:02,149: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T22:59:02.149448801Z [2024-04-05 22:59:02,149: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:59:02.159729919Z [2024-04-05 22:59:02,159: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T22:59:02.161900118Z [2024-04-05 22:59:02,161: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T22:59:02.161913587Z [2024-04-05 22:59:02,161: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T22:59:02.162028882Z [2024-04-05 22:59:02,161: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T22:59:02.162034093Z [2024-04-05 22:59:02,161: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T22:59:02.162323753Z [2024-04-05 22:59:02,162: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-05T22:59:02.162331212Z [2024-04-05 22:59:02,162: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T22:59:02.244931514Z [2024-04-05 22:59:02,244: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:59:02.290777180Z [2024-04-05 22:59:02,290: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T22:59:04.195481291Z [2024-04-05 22:59:04,194: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[211f5b3c-3de3-49f2-9865-883b382cfd04] succeeded in 3.6690396019998843s: None 2024-04-05T22:59:04.712247813Z [2024-04-05 22:59:04,711: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[62c62131-55eb-4557-a78a-2553ccb11067] succeeded in 4.232216572000198s: None 2024-04-05T23:00:00.382295097Z [2024-04-05 23:00:00,381: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d7764ad7-137e-4637-aa5b-8bd5aaa79821] received 2024-04-05T23:00:00.384717940Z [2024-04-05 23:00:00,384: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d1b05c57-b0f5-45a9-982c-8becd4da89e4] received 2024-04-05T23:00:00.386635579Z [2024-04-05 23:00:00,386: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f0befe18-f1f7-41ac-9ea1-5181181432be] received 2024-04-05T23:00:00.390707750Z [2024-04-05 23:00:00,390: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7c8ff84b-e7ce-4a43-a4ec-688283266f87] received 2024-04-05T23:00:00.390812771Z [2024-04-05 23:00:00,390: INFO/ForkPoolWorker-15] [d7764ad7-137e-4637-aa5b-8bd5aaa79821] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T23:00:00.400243656Z [2024-04-05 23:00:00,399: INFO/ForkPoolWorker-1] [f0befe18-f1f7-41ac-9ea1-5181181432be] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T23:00:00.405252080Z [2024-04-05 23:00:00,405: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5b7c4471-12db-43fe-b2eb-16db213eebb1] received 2024-04-05T23:00:00.406307649Z [2024-04-05 23:00:00,406: INFO/ForkPoolWorker-2] [7c8ff84b-e7ce-4a43-a4ec-688283266f87] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T22:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T23:00:00.412235787Z [2024-04-05 23:00:00,411: INFO/ForkPoolWorker-16] [d1b05c57-b0f5-45a9-982c-8becd4da89e4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T23:00:00.433521662Z [2024-04-05 23:00:00,433: INFO/ForkPoolWorker-3] [5b7c4471-12db-43fe-b2eb-16db213eebb1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T22:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T23:00:00.738936318Z [2024-04-05 23:00:00,735: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-05T23:00:00.768664703Z [2024-04-05 23:00:00,765: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T23:00:00.801974513Z [2024-04-05 23:00:00,798: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-05T23:00:01.012560072Z [2024-04-05 23:00:01,012: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-05T23:00:01.035006324Z [2024-04-05 23:00:01,034: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:00:01.067732304Z [2024-04-05 23:00:01,057: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T23:00:01.068719642Z [2024-04-05 23:00:01,068: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:00:01.087111740Z [2024-04-05 23:00:01,076: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T23:00:01.098910584Z [2024-04-05 23:00:01,098: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-05T23:00:01.104356632Z [2024-04-05 23:00:01,104: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-05T23:00:01.104385085Z [2024-04-05 23:00:01,104: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-05T23:00:01.104506694Z [2024-04-05 23:00:01,104: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-05T23:00:01.104733814Z [2024-04-05 23:00:01,104: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-05T23:00:01.198852978Z [2024-04-05 23:00:01,198: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:00:01.775486463Z [2024-04-05 23:00:01,775: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[7c8ff84b-e7ce-4a43-a4ec-688283266f87] succeeded in 1.3826263679998192s: None 2024-04-05T23:00:01.983951886Z [2024-04-05 23:00:01,983: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f0befe18-f1f7-41ac-9ea1-5181181432be] succeeded in 1.5928528010003902s: None 2024-04-05T23:00:02.288747092Z [2024-04-05 23:00:02,288: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T23:00:02.292606606Z [2024-04-05 23:00:02,292: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:00:02.320189084Z [2024-04-05 23:00:02,319: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T23:00:02.321520854Z [2024-04-05 23:00:02,321: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:00:02.321536108Z [2024-04-05 23:00:02,321: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:00:02.321708666Z [2024-04-05 23:00:02,321: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:00:02.321785511Z [2024-04-05 23:00:02,321: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T23:00:02.322012108Z [2024-04-05 23:00:02,321: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T23:00:02.322037515Z [2024-04-05 23:00:02,321: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:00:02.423494567Z [2024-04-05 23:00:02,423: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:00:02.490089291Z [2024-04-05 23:00:02,489: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-05T23:00:02.493214136Z [2024-04-05 23:00:02,492: INFO/ForkPoolWorker-3] Getting VIM list 2024-04-05T23:00:02.493623014Z [2024-04-05 23:00:02,493: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:00:02.497123846Z [2024-04-05 23:00:02,496: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:00:02.515777277Z [2024-04-05 23:00:02,515: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T23:00:02.517811290Z [2024-04-05 23:00:02,517: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:00:02.517855824Z [2024-04-05 23:00:02,517: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:00:02.518059774Z [2024-04-05 23:00:02,517: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:00:02.518097881Z [2024-04-05 23:00:02,517: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-05T23:00:02.518422823Z [2024-04-05 23:00:02,518: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T23:00:02.518487739Z [2024-04-05 23:00:02,518: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:00:02.525663925Z [2024-04-05 23:00:02,525: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-05T23:00:02.527200219Z [2024-04-05 23:00:02,526: INFO/ForkPoolWorker-3] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:00:02.527341448Z [2024-04-05 23:00:02,527: INFO/ForkPoolWorker-3] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:00:02.527601577Z [2024-04-05 23:00:02,527: INFO/ForkPoolWorker-3] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:00:02.527622189Z [2024-04-05 23:00:02,527: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-04-05T23:00:02.527887719Z [2024-04-05 23:00:02,527: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-04-05T23:00:02.527911524Z [2024-04-05 23:00:02,527: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:00:02.623120927Z [2024-04-05 23:00:02,622: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:00:02.632864021Z [2024-04-05 23:00:02,632: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:00:03.080304406Z [2024-04-05 23:00:03,079: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d7764ad7-137e-4637-aa5b-8bd5aaa79821] succeeded in 2.696606284000154s: None 2024-04-05T23:00:03.972909290Z [2024-04-05 23:00:03,972: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bd45047e-d034-44a9-831b-4eecf6632dbd] received 2024-04-05T23:00:03.983812037Z [2024-04-05 23:00:03,983: INFO/ForkPoolWorker-15] [bd45047e-d034-44a9-831b-4eecf6632dbd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'split_metrics', 'scheduled__2024-04-05T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T23:00:04.271348872Z [2024-04-05 23:00:04,270: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d1b05c57-b0f5-45a9-982c-8becd4da89e4] succeeded in 3.881760659000065s: None 2024-04-05T23:00:04.284184011Z [2024-04-05 23:00:04,281: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T23:00:05.383743911Z [2024-04-05 23:00:05,382: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[5b7c4471-12db-43fe-b2eb-16db213eebb1] succeeded in 4.968877820000216s: None 2024-04-05T23:00:05.569530934Z [2024-04-05 23:00:05,569: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T23:00:05.573005823Z [2024-04-05 23:00:05,572: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:00:05.599083994Z [2024-04-05 23:00:05,598: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T23:00:05.600874008Z [2024-04-05 23:00:05,600: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:00:05.601005040Z [2024-04-05 23:00:05,600: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:00:05.601244655Z [2024-04-05 23:00:05,601: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:00:05.601398878Z [2024-04-05 23:00:05,601: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T23:00:05.601777186Z [2024-04-05 23:00:05,601: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T23:00:05.601954528Z [2024-04-05 23:00:05,601: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:00:05.680519778Z [2024-04-05 23:00:05,680: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:00:06.333298560Z [2024-04-05 23:00:06,332: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bd45047e-d034-44a9-831b-4eecf6632dbd] succeeded in 2.3566854530004093s: None 2024-04-05T23:00:07.198507758Z [2024-04-05 23:00:07,198: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c0ee5884-ba88-459a-b9d1-8f95ebb265be] received 2024-04-05T23:00:07.209303362Z [2024-04-05 23:00:07,208: INFO/ForkPoolWorker-15] [c0ee5884-ba88-459a-b9d1-8f95ebb265be] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'collect_metrics', 'scheduled__2024-04-05T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T23:00:07.494239858Z [2024-04-05 23:00:07,490: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T23:00:08.698999638Z [2024-04-05 23:00:08,698: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T23:00:08.702438410Z [2024-04-05 23:00:08,701: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:00:08.720812296Z [2024-04-05 23:00:08,720: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T23:00:08.723802286Z [2024-04-05 23:00:08,723: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:00:08.724549721Z [2024-04-05 23:00:08,724: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:00:08.724657953Z [2024-04-05 23:00:08,724: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:00:08.724670757Z [2024-04-05 23:00:08,724: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T23:00:08.726000370Z [2024-04-05 23:00:08,724: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T23:00:08.726015978Z [2024-04-05 23:00:08,724: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:00:08.800469197Z [2024-04-05 23:00:08,800: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:00:09.391266001Z [2024-04-05 23:00:09,390: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c0ee5884-ba88-459a-b9d1-8f95ebb265be] succeeded in 2.189173854999808s: None 2024-04-05T23:00:09.558628260Z [2024-04-05 23:00:09,558: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[defcc415-4b44-4d04-9dd3-1d7b09c1af83] received 2024-04-05T23:00:09.567405203Z [2024-04-05 23:00:09,567: INFO/ForkPoolWorker-15] [defcc415-4b44-4d04-9dd3-1d7b09c1af83] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'send_prometheus', 'scheduled__2024-04-05T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T23:00:09.890915998Z [2024-04-05 23:00:09,887: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T23:00:11.034457860Z [2024-04-05 23:00:11,033: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T23:00:11.037826316Z [2024-04-05 23:00:11,037: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:00:11.060819486Z [2024-04-05 23:00:11,060: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T23:00:11.064603084Z [2024-04-05 23:00:11,064: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:00:11.064905165Z [2024-04-05 23:00:11,064: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:00:11.065299275Z [2024-04-05 23:00:11,065: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:00:11.065561696Z [2024-04-05 23:00:11,065: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T23:00:11.066067789Z [2024-04-05 23:00:11,065: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T23:00:11.066910680Z [2024-04-05 23:00:11,066: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:00:11.175840516Z [2024-04-05 23:00:11,175: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:00:11.864856855Z [2024-04-05 23:00:11,864: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[defcc415-4b44-4d04-9dd3-1d7b09c1af83] succeeded in 2.3040222939998785s: None 2024-04-05T23:01:00.271102482Z [2024-04-05 23:01:00,270: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9a5d40f7-cfbf-41b0-924b-01c7e4c93e15] received 2024-04-05T23:01:00.280848429Z [2024-04-05 23:01:00,280: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3ce10fad-211c-48d4-a3e8-a0667bc9cbf3] received 2024-04-05T23:01:00.281134935Z [2024-04-05 23:01:00,280: INFO/ForkPoolWorker-15] [9a5d40f7-cfbf-41b0-924b-01c7e4c93e15] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T23:01:00.288262874Z [2024-04-05 23:01:00,288: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e0d1fc2c-1be0-4f5d-8d31-f2c2b94240ec] received 2024-04-05T23:01:00.291386839Z [2024-04-05 23:01:00,291: INFO/ForkPoolWorker-16] [3ce10fad-211c-48d4-a3e8-a0667bc9cbf3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T23:01:00.297390404Z [2024-04-05 23:01:00,297: INFO/ForkPoolWorker-1] [e0d1fc2c-1be0-4f5d-8d31-f2c2b94240ec] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T23:01:00.594776039Z [2024-04-05 23:01:00,590: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-05T23:01:00.603625463Z [2024-04-05 23:01:00,600: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T23:01:00.624370125Z [2024-04-05 23:01:00,620: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T23:01:00.762825543Z [2024-04-05 23:01:00,762: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-05T23:01:00.766911362Z [2024-04-05 23:01:00,766: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:01:00.790016098Z [2024-04-05 23:01:00,789: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T23:01:00.790987371Z [2024-04-05 23:01:00,790: INFO/ForkPoolWorker-15] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-05T23:01:00.791136134Z [2024-04-05 23:01:00,790: INFO/ForkPoolWorker-15] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-05T23:01:00.791209712Z [2024-04-05 23:01:00,791: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-05T23:01:00.791644508Z [2024-04-05 23:01:00,791: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-05T23:01:00.919123279Z [2024-04-05 23:01:00,918: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:01:01.589343133Z [2024-04-05 23:01:01,588: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9a5d40f7-cfbf-41b0-924b-01c7e4c93e15] succeeded in 1.313591407000331s: None 2024-04-05T23:01:01.815667202Z [2024-04-05 23:01:01,815: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-05T23:01:01.819283191Z [2024-04-05 23:01:01,818: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:01:01.831388524Z [2024-04-05 23:01:01,830: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-05T23:01:01.834944367Z [2024-04-05 23:01:01,834: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:01:01.855735724Z [2024-04-05 23:01:01,855: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-05T23:01:01.857320427Z [2024-04-05 23:01:01,857: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:01:01.857376176Z [2024-04-05 23:01:01,857: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:01:01.857549850Z [2024-04-05 23:01:01,857: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:01:01.857571495Z [2024-04-05 23:01:01,857: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-05T23:01:01.857864280Z [2024-04-05 23:01:01,857: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-05T23:01:01.857899430Z [2024-04-05 23:01:01,857: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:01:01.867388013Z [2024-04-05 23:01:01,867: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T23:01:01.868801916Z [2024-04-05 23:01:01,868: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:01:01.869016968Z [2024-04-05 23:01:01,868: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:01:01.869280275Z [2024-04-05 23:01:01,869: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:01:01.869418339Z [2024-04-05 23:01:01,869: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-05T23:01:01.869883406Z [2024-04-05 23:01:01,869: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T23:01:01.869973393Z [2024-04-05 23:01:01,869: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:01:01.940476126Z [2024-04-05 23:01:01,940: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:01:01.967759289Z [2024-04-05 23:01:01,963: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:01:03.380432465Z [2024-04-05 23:01:03,379: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3ce10fad-211c-48d4-a3e8-a0667bc9cbf3] succeeded in 3.096958170999642s: None 2024-04-05T23:01:03.911612114Z [2024-04-05 23:01:03,910: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e0d1fc2c-1be0-4f5d-8d31-f2c2b94240ec] succeeded in 3.6207431359998736s: None 2024-04-05T23:02:00.265928097Z [2024-04-05 23:02:00,265: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[447f05dd-8b53-47a8-bbc4-1cb6ff44b98f] received 2024-04-05T23:02:00.268466421Z [2024-04-05 23:02:00,268: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[09cdff15-0670-4fba-9c2c-71fe6b264032] received 2024-04-05T23:02:00.270711799Z [2024-04-05 23:02:00,270: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[04e1708c-3a4b-4b46-9989-36d00f64f791] received 2024-04-05T23:02:00.281452443Z [2024-04-05 23:02:00,281: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fd06926b-2bc6-4a59-97c1-265888e1c094] received 2024-04-05T23:02:00.284529932Z [2024-04-05 23:02:00,284: INFO/ForkPoolWorker-15] [447f05dd-8b53-47a8-bbc4-1cb6ff44b98f] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T23:02:00.294198661Z [2024-04-05 23:02:00,293: INFO/ForkPoolWorker-2] [fd06926b-2bc6-4a59-97c1-265888e1c094] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T23:02:00.295625768Z [2024-04-05 23:02:00,295: INFO/ForkPoolWorker-1] [04e1708c-3a4b-4b46-9989-36d00f64f791] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T23:02:00.298327782Z [2024-04-05 23:02:00,298: INFO/ForkPoolWorker-16] [09cdff15-0670-4fba-9c2c-71fe6b264032] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T23:02:00.641014530Z [2024-04-05 23:02:00,637: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-05T23:02:00.649096842Z [2024-04-05 23:02:00,644: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T23:02:00.652671942Z [2024-04-05 23:02:00,648: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-05T23:02:00.656819778Z [2024-04-05 23:02:00,653: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T23:02:00.857952822Z [2024-04-05 23:02:00,857: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-05T23:02:00.867269765Z [2024-04-05 23:02:00,866: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:02:00.911452100Z [2024-04-05 23:02:00,908: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-05T23:02:00.915008885Z [2024-04-05 23:02:00,914: INFO/ForkPoolWorker-2] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-05T23:02:00.919162275Z [2024-04-05 23:02:00,918: INFO/ForkPoolWorker-2] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-05T23:02:00.919195227Z [2024-04-05 23:02:00,919: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-05T23:02:00.919529305Z [2024-04-05 23:02:00,919: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-05T23:02:00.978026891Z [2024-04-05 23:02:00,977: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:02:01.034711814Z [2024-04-05 23:02:01,034: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:02:01.591475313Z [2024-04-05 23:02:01,590: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[447f05dd-8b53-47a8-bbc4-1cb6ff44b98f] succeeded in 1.3210848390003775s: None 2024-04-05T23:02:01.758239825Z [2024-04-05 23:02:01,757: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[fd06926b-2bc6-4a59-97c1-265888e1c094] succeeded in 1.473366327000349s: None 2024-04-05T23:02:01.946569557Z [2024-04-05 23:02:01,946: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-05T23:02:01.950186530Z [2024-04-05 23:02:01,949: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:02:01.979225578Z [2024-04-05 23:02:01,978: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T23:02:01.982205089Z [2024-04-05 23:02:01,981: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:02:01.982627893Z [2024-04-05 23:02:01,982: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:02:01.983030781Z [2024-04-05 23:02:01,982: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:02:01.983279116Z [2024-04-05 23:02:01,983: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-05T23:02:01.983998625Z [2024-04-05 23:02:01,983: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T23:02:01.984798627Z [2024-04-05 23:02:01,984: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:02:02.107842694Z [2024-04-05 23:02:02,107: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:02:02.132016875Z [2024-04-05 23:02:02,131: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-05T23:02:02.135771855Z [2024-04-05 23:02:02,135: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:02:02.169823995Z [2024-04-05 23:02:02,169: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-05T23:02:02.172229979Z [2024-04-05 23:02:02,171: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:02:02.172442976Z [2024-04-05 23:02:02,172: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:02:02.172813919Z [2024-04-05 23:02:02,172: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:02:02.173060961Z [2024-04-05 23:02:02,172: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-05T23:02:02.173627663Z [2024-04-05 23:02:02,173: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-05T23:02:02.173911783Z [2024-04-05 23:02:02,173: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:02:02.317983010Z [2024-04-05 23:02:02,317: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:02:03.969169691Z [2024-04-05 23:02:03,968: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[09cdff15-0670-4fba-9c2c-71fe6b264032] succeeded in 3.6982125409999753s: None 2024-04-05T23:02:04.372358542Z [2024-04-05 23:02:04,371: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[04e1708c-3a4b-4b46-9989-36d00f64f791] succeeded in 4.09382368200022s: None 2024-04-05T23:03:01.182013549Z [2024-04-05 23:03:01,181: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[358c191c-5fbd-48fd-931b-06f86a0c4fa4] received 2024-04-05T23:03:01.201844235Z [2024-04-05 23:03:01,201: INFO/ForkPoolWorker-15] [358c191c-5fbd-48fd-931b-06f86a0c4fa4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T23:03:01.204577106Z [2024-04-05 23:03:01,204: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7bf635d7-3258-4236-8fe4-06e33aebbf8b] received 2024-04-05T23:03:01.218630926Z [2024-04-05 23:03:01,218: INFO/ForkPoolWorker-16] [7bf635d7-3258-4236-8fe4-06e33aebbf8b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T23:03:01.221862120Z [2024-04-05 23:03:01,221: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[066aeded-573d-4a39-b7a3-dcb5e62b86a1] received 2024-04-05T23:03:01.247574082Z [2024-04-05 23:03:01,247: INFO/ForkPoolWorker-1] [066aeded-573d-4a39-b7a3-dcb5e62b86a1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T23:03:01.505998412Z [2024-04-05 23:03:01,501: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-05T23:03:01.529281141Z [2024-04-05 23:03:01,525: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T23:03:01.547524581Z [2024-04-05 23:03:01,542: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T23:03:01.680250633Z [2024-04-05 23:03:01,679: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-05T23:03:01.684957455Z [2024-04-05 23:03:01,684: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:03:01.716462703Z [2024-04-05 23:03:01,716: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T23:03:01.717674717Z [2024-04-05 23:03:01,717: INFO/ForkPoolWorker-16] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-05T23:03:01.717782134Z [2024-04-05 23:03:01,717: INFO/ForkPoolWorker-16] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-05T23:03:01.717861857Z [2024-04-05 23:03:01,717: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-05T23:03:01.718127316Z [2024-04-05 23:03:01,718: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-05T23:03:01.840785735Z [2024-04-05 23:03:01,840: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:03:02.560758727Z [2024-04-05 23:03:02,560: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7bf635d7-3258-4236-8fe4-06e33aebbf8b] succeeded in 1.3534340569999586s: None 2024-04-05T23:03:02.826110653Z [2024-04-05 23:03:02,825: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-05T23:03:02.829403949Z [2024-04-05 23:03:02,828: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:03:02.851939028Z [2024-04-05 23:03:02,851: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-05T23:03:02.853534521Z [2024-04-05 23:03:02,853: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:03:02.853547034Z [2024-04-05 23:03:02,853: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:03:02.853695653Z [2024-04-05 23:03:02,853: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:03:02.853704628Z [2024-04-05 23:03:02,853: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-05T23:03:02.854011972Z [2024-04-05 23:03:02,853: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-05T23:03:02.854045744Z [2024-04-05 23:03:02,853: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:03:02.862215950Z [2024-04-05 23:03:02,861: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T23:03:02.866509206Z [2024-04-05 23:03:02,865: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:03:02.891909205Z [2024-04-05 23:03:02,891: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T23:03:02.893576599Z [2024-04-05 23:03:02,893: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:03:02.893595350Z [2024-04-05 23:03:02,893: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:03:02.893947655Z [2024-04-05 23:03:02,893: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:03:02.893990246Z [2024-04-05 23:03:02,893: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T23:03:02.894347910Z [2024-04-05 23:03:02,894: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T23:03:02.894831962Z [2024-04-05 23:03:02,894: INFO/ForkPoolWorker-15] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:03:02.967489312Z [2024-04-05 23:03:02,966: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:03:02.988266240Z [2024-04-05 23:03:02,987: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:03:04.465434262Z [2024-04-05 23:03:04,464: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[358c191c-5fbd-48fd-931b-06f86a0c4fa4] succeeded in 3.2808122659998844s: None 2024-04-05T23:03:04.786739466Z [2024-04-05 23:03:04,786: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[066aeded-573d-4a39-b7a3-dcb5e62b86a1] succeeded in 3.5555051260002983s: None 2024-04-05T23:04:01.315460965Z [2024-04-05 23:04:01,314: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0853a878-2068-4c1a-b80c-5d6dd1a126b7] received 2024-04-05T23:04:01.323757939Z [2024-04-05 23:04:01,323: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c4dd8ecd-677a-42bd-8800-48ebfc709c70] received 2024-04-05T23:04:01.332108016Z [2024-04-05 23:04:01,331: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6a6f6df5-038d-431d-8ce4-870ffce7ff99] received 2024-04-05T23:04:01.362534243Z [2024-04-05 23:04:01,362: INFO/ForkPoolWorker-1] [6a6f6df5-038d-431d-8ce4-870ffce7ff99] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T23:04:01.371604575Z [2024-04-05 23:04:01,371: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1f81134b-fe21-4d6f-aaa5-b1039cb29962] received 2024-04-05T23:04:01.379462713Z [2024-04-05 23:04:01,378: INFO/ForkPoolWorker-15] [0853a878-2068-4c1a-b80c-5d6dd1a126b7] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T23:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T23:04:01.400165546Z [2024-04-05 23:04:01,399: INFO/ForkPoolWorker-16] [c4dd8ecd-677a-42bd-8800-48ebfc709c70] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T23:04:01.408005048Z [2024-04-05 23:04:01,407: INFO/ForkPoolWorker-2] [1f81134b-fe21-4d6f-aaa5-b1039cb29962] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T23:04:02.347259993Z [2024-04-05 23:04:02,343: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T23:04:02.794259838Z [2024-04-05 23:04:02,789: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T23:04:02.827994923Z [2024-04-05 23:04:02,813: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-05T23:04:02.950208016Z [2024-04-05 23:04:02,925: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-05T23:04:03.672690774Z [2024-04-05 23:04:03,672: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:04:04.130129056Z [2024-04-05 23:04:04,129: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-05T23:04:04.241409913Z [2024-04-05 23:04:04,220: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:04:04.428733863Z [2024-04-05 23:04:04,424: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-05T23:04:04.453198990Z [2024-04-05 23:04:04,451: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-05T23:04:04.453222854Z [2024-04-05 23:04:04,451: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-05T23:04:04.453228904Z [2024-04-05 23:04:04,451: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-05T23:04:04.453233879Z [2024-04-05 23:04:04,452: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-05T23:04:04.875068870Z [2024-04-05 23:04:04,874: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:04:06.045878595Z [2024-04-05 23:04:06,045: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0853a878-2068-4c1a-b80c-5d6dd1a126b7] succeeded in 4.718774059000225s: None 2024-04-05T23:04:06.453963958Z [2024-04-05 23:04:06,453: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6a6f6df5-038d-431d-8ce4-870ffce7ff99] succeeded in 5.116346998999688s: None 2024-04-05T23:04:06.561906886Z [2024-04-05 23:04:06,561: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-05T23:04:06.565601310Z [2024-04-05 23:04:06,565: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:04:06.611337500Z [2024-04-05 23:04:06,611: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-05T23:04:06.614846081Z [2024-04-05 23:04:06,612: INFO/ForkPoolWorker-2] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:04:06.614871850Z [2024-04-05 23:04:06,612: INFO/ForkPoolWorker-2] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:04:06.614894133Z [2024-04-05 23:04:06,612: INFO/ForkPoolWorker-2] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:04:06.614898827Z [2024-04-05 23:04:06,613: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-05T23:04:06.614901978Z [2024-04-05 23:04:06,613: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T23:04:06.614905264Z [2024-04-05 23:04:06,613: INFO/ForkPoolWorker-2] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:04:06.739792794Z [2024-04-05 23:04:06,739: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-05T23:04:06.743198957Z [2024-04-05 23:04:06,742: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:04:06.776443614Z [2024-04-05 23:04:06,776: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:04:06.777966903Z [2024-04-05 23:04:06,777: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T23:04:06.782005068Z [2024-04-05 23:04:06,779: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:04:06.782020727Z [2024-04-05 23:04:06,779: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:04:06.782025105Z [2024-04-05 23:04:06,779: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:04:06.782029586Z [2024-04-05 23:04:06,779: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-05T23:04:06.782033084Z [2024-04-05 23:04:06,779: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-05T23:04:06.782036428Z [2024-04-05 23:04:06,779: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:04:06.934000866Z [2024-04-05 23:04:06,933: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:04:08.810319208Z [2024-04-05 23:04:08,809: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[1f81134b-fe21-4d6f-aaa5-b1039cb29962] succeeded in 7.435740712999632s: None 2024-04-05T23:04:09.197789855Z [2024-04-05 23:04:09,197: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c4dd8ecd-677a-42bd-8800-48ebfc709c70] succeeded in 7.870309754999653s: None 2024-04-05T23:05:00.604750977Z [2024-04-05 23:05:00,603: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c3fd0532-2200-435c-928c-f7adb12d3226] received 2024-04-05T23:05:00.609150082Z [2024-04-05 23:05:00,608: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cbcb95f9-1c68-4fbf-afdd-be3ecf6aabb8] received 2024-04-05T23:05:00.617100768Z [2024-04-05 23:05:00,616: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[24912701-6daa-40f5-b181-4ff78349acb6] received 2024-04-05T23:05:00.626417605Z [2024-04-05 23:05:00,626: INFO/ForkPoolWorker-16] [cbcb95f9-1c68-4fbf-afdd-be3ecf6aabb8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T23:05:00.632219815Z [2024-04-05 23:05:00,630: INFO/ForkPoolWorker-15] [c3fd0532-2200-435c-928c-f7adb12d3226] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T23:05:00.642234769Z [2024-04-05 23:05:00,641: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1abd0d32-7fbb-454a-8b17-cdde73fb1385] received 2024-04-05T23:05:00.646109204Z [2024-04-05 23:05:00,645: INFO/ForkPoolWorker-1] [24912701-6daa-40f5-b181-4ff78349acb6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T23:05:00.697162676Z [2024-04-05 23:05:00,696: INFO/ForkPoolWorker-2] [1abd0d32-7fbb-454a-8b17-cdde73fb1385] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T23:05:01.102075160Z [2024-04-05 23:05:01,096: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T23:05:01.274377888Z [2024-04-05 23:05:01,269: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T23:05:01.605881228Z [2024-04-05 23:05:01,601: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T23:05:02.316887987Z [2024-04-05 23:05:02,298: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-05T23:05:02.665520035Z [2024-04-05 23:05:02,664: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-05T23:05:02.675694601Z [2024-04-05 23:05:02,673: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:05:02.769897780Z [2024-04-05 23:05:02,769: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-05T23:05:02.774936665Z [2024-04-05 23:05:02,774: INFO/ForkPoolWorker-2] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-05T23:05:02.775127043Z [2024-04-05 23:05:02,774: INFO/ForkPoolWorker-2] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-05T23:05:02.775273282Z [2024-04-05 23:05:02,775: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-05T23:05:02.775663402Z [2024-04-05 23:05:02,775: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-05T23:05:02.953461334Z [2024-04-05 23:05:02,953: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:05:03.765520706Z [2024-04-05 23:05:03,757: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-05T23:05:03.787777686Z [2024-04-05 23:05:03,786: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:05:03.897018700Z [2024-04-05 23:05:03,896: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-05T23:05:03.901253455Z [2024-04-05 23:05:03,900: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:05:03.906159809Z [2024-04-05 23:05:03,901: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:05:03.906392802Z [2024-04-05 23:05:03,906: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:05:03.906525885Z [2024-04-05 23:05:03,906: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-05T23:05:03.907010230Z [2024-04-05 23:05:03,906: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-05T23:05:03.907588758Z [2024-04-05 23:05:03,907: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:05:04.128999249Z [2024-04-05 23:05:04,128: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:05:04.158544388Z [2024-04-05 23:05:04,157: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[1abd0d32-7fbb-454a-8b17-cdde73fb1385] succeeded in 3.503515370000059s: None 2024-04-05T23:05:04.605008809Z [2024-04-05 23:05:04,602: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T23:05:04.622357643Z [2024-04-05 23:05:04,621: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:05:04.675223288Z [2024-04-05 23:05:04,674: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T23:05:04.677057430Z [2024-04-05 23:05:04,676: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:05:04.677183189Z [2024-04-05 23:05:04,677: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:05:04.677334280Z [2024-04-05 23:05:04,677: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:05:04.677414859Z [2024-04-05 23:05:04,677: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T23:05:04.677772270Z [2024-04-05 23:05:04,677: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T23:05:04.677880414Z [2024-04-05 23:05:04,677: INFO/ForkPoolWorker-15] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:05:04.845983925Z [2024-04-05 23:05:04,845: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:05:04.903912331Z [2024-04-05 23:05:04,903: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-05T23:05:04.908922836Z [2024-04-05 23:05:04,908: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:05:04.943126559Z [2024-04-05 23:05:04,942: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T23:05:04.946296957Z [2024-04-05 23:05:04,946: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:05:04.946415329Z [2024-04-05 23:05:04,946: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:05:04.946562832Z [2024-04-05 23:05:04,946: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:05:04.946622602Z [2024-04-05 23:05:04,946: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-05T23:05:04.947004319Z [2024-04-05 23:05:04,946: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T23:05:04.947110758Z [2024-04-05 23:05:04,947: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:05:05.080072964Z [2024-04-05 23:05:05,079: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:05:05.738428765Z [2024-04-05 23:05:05,737: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[cbcb95f9-1c68-4fbf-afdd-be3ecf6aabb8] succeeded in 5.123743208000178s: None 2024-04-05T23:05:05.819771468Z [2024-04-05 23:05:05,819: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4b399c36-cca1-4065-b839-be90598f54ea] received 2024-04-05T23:05:05.830364788Z [2024-04-05 23:05:05,829: INFO/ForkPoolWorker-16] [4b399c36-cca1-4065-b839-be90598f54ea] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'split_metrics', 'scheduled__2024-04-05T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T23:05:06.131341582Z [2024-04-05 23:05:06,128: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T23:05:06.465038798Z [2024-04-05 23:05:06,464: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[24912701-6daa-40f5-b181-4ff78349acb6] succeeded in 5.83906489500032s: None 2024-04-05T23:05:06.890218478Z [2024-04-05 23:05:06,888: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c3fd0532-2200-435c-928c-f7adb12d3226] succeeded in 6.279324440999972s: None 2024-04-05T23:05:07.331598620Z [2024-04-05 23:05:07,331: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-05T23:05:07.335124475Z [2024-04-05 23:05:07,334: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:05:07.372328890Z [2024-04-05 23:05:07,372: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T23:05:07.378772198Z [2024-04-05 23:05:07,378: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:05:07.378857692Z [2024-04-05 23:05:07,378: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:05:07.379017989Z [2024-04-05 23:05:07,378: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:05:07.379104738Z [2024-04-05 23:05:07,379: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-05T23:05:07.379421196Z [2024-04-05 23:05:07,379: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T23:05:07.379497335Z [2024-04-05 23:05:07,379: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:05:07.470776398Z [2024-04-05 23:05:07,470: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:05:08.165952551Z [2024-04-05 23:05:08,165: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4b399c36-cca1-4065-b839-be90598f54ea] succeeded in 2.34318765099988s: None 2024-04-05T23:05:08.483925413Z [2024-04-05 23:05:08,483: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[de05d797-d897-4db3-941c-a4436f47f27b] received 2024-04-05T23:05:08.491638944Z [2024-04-05 23:05:08,491: INFO/ForkPoolWorker-15] [de05d797-d897-4db3-941c-a4436f47f27b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'collect_metrics', 'scheduled__2024-04-05T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T23:05:08.837278671Z [2024-04-05 23:05:08,832: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T23:05:10.111814752Z [2024-04-05 23:05:10,111: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T23:05:10.115898732Z [2024-04-05 23:05:10,115: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:05:10.181180444Z [2024-04-05 23:05:10,180: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T23:05:10.186316479Z [2024-04-05 23:05:10,186: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:05:10.194762889Z [2024-04-05 23:05:10,186: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:05:10.195748719Z [2024-04-05 23:05:10,194: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:05:10.195767106Z [2024-04-05 23:05:10,195: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T23:05:10.196048954Z [2024-04-05 23:05:10,195: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T23:05:10.196245346Z [2024-04-05 23:05:10,195: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:05:10.299589258Z [2024-04-05 23:05:10,299: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:05:10.816702676Z [2024-04-05 23:05:10,816: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a89a8544-39b7-486b-870a-46918ca27b2a] received 2024-04-05T23:05:10.825565851Z [2024-04-05 23:05:10,825: INFO/ForkPoolWorker-16] [a89a8544-39b7-486b-870a-46918ca27b2a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'send_prometheus', 'scheduled__2024-04-05T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T23:05:10.925943299Z [2024-04-05 23:05:10,925: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[de05d797-d897-4db3-941c-a4436f47f27b] succeeded in 2.440567686000122s: None 2024-04-05T23:05:11.174239442Z [2024-04-05 23:05:11,170: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T23:05:12.520472638Z [2024-04-05 23:05:12,520: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-05T23:05:12.524138596Z [2024-04-05 23:05:12,523: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:05:12.563878641Z [2024-04-05 23:05:12,563: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T23:05:12.568381867Z [2024-04-05 23:05:12,568: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:05:12.568469808Z [2024-04-05 23:05:12,568: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:05:12.568736907Z [2024-04-05 23:05:12,568: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:05:12.568811448Z [2024-04-05 23:05:12,568: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-05T23:05:12.569126480Z [2024-04-05 23:05:12,568: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T23:05:12.569176220Z [2024-04-05 23:05:12,569: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:05:12.709392745Z [2024-04-05 23:05:12,709: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:05:13.485833425Z [2024-04-05 23:05:13,485: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a89a8544-39b7-486b-870a-46918ca27b2a] succeeded in 2.6658791810000366s: None 2024-04-05T23:06:00.480964024Z [2024-04-05 23:06:00,480: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d2820b65-a8ea-407f-9945-8e16953d9f11] received 2024-04-05T23:06:00.485653074Z [2024-04-05 23:06:00,485: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cfae0a0d-1226-4a3a-8a67-3496f8fa67f3] received 2024-04-05T23:06:00.496648184Z [2024-04-05 23:06:00,496: INFO/ForkPoolWorker-16] [cfae0a0d-1226-4a3a-8a67-3496f8fa67f3] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T23:06:00.501126904Z [2024-04-05 23:06:00,500: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[328535c0-5a4e-4bf3-ba67-9a7309a34755] received 2024-04-05T23:06:00.503657962Z [2024-04-05 23:06:00,503: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e14eabbe-c23b-46a3-86f8-407b8d798290] received 2024-04-05T23:06:00.504199785Z [2024-04-05 23:06:00,503: INFO/ForkPoolWorker-15] [d2820b65-a8ea-407f-9945-8e16953d9f11] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T23:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T23:06:00.515725781Z [2024-04-05 23:06:00,515: INFO/ForkPoolWorker-1] [328535c0-5a4e-4bf3-ba67-9a7309a34755] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T23:06:00.524255098Z [2024-04-05 23:06:00,523: INFO/ForkPoolWorker-2] [e14eabbe-c23b-46a3-86f8-407b8d798290] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T23:06:00.816226261Z [2024-04-05 23:06:00,812: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-05T23:06:00.910520211Z [2024-04-05 23:06:00,906: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T23:06:00.950460197Z [2024-04-05 23:06:00,946: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-05T23:06:01.040509495Z [2024-04-05 23:06:01,036: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T23:06:01.088954398Z [2024-04-05 23:06:01,088: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:06:01.173980376Z [2024-04-05 23:06:01,173: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-05T23:06:01.178185262Z [2024-04-05 23:06:01,177: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:06:01.216576758Z [2024-04-05 23:06:01,216: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T23:06:01.219025997Z [2024-04-05 23:06:01,218: INFO/ForkPoolWorker-16] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-05T23:06:01.219913061Z [2024-04-05 23:06:01,218: INFO/ForkPoolWorker-16] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-05T23:06:01.220254601Z [2024-04-05 23:06:01,219: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-05T23:06:01.220647425Z [2024-04-05 23:06:01,220: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-05T23:06:01.325086213Z [2024-04-05 23:06:01,323: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:06:01.755188157Z [2024-04-05 23:06:01,754: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d2820b65-a8ea-407f-9945-8e16953d9f11] succeeded in 1.2675818980001168s: None 2024-04-05T23:06:02.093830876Z [2024-04-05 23:06:02,093: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[cfae0a0d-1226-4a3a-8a67-3496f8fa67f3] succeeded in 1.606493915000101s: None 2024-04-05T23:06:02.499926023Z [2024-04-05 23:06:02,499: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-05T23:06:02.503667274Z [2024-04-05 23:06:02,502: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:06:02.534431864Z [2024-04-05 23:06:02,534: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-05T23:06:02.536788540Z [2024-04-05 23:06:02,536: INFO/ForkPoolWorker-2] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:06:02.536810270Z [2024-04-05 23:06:02,536: INFO/ForkPoolWorker-2] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:06:02.536829326Z [2024-04-05 23:06:02,536: INFO/ForkPoolWorker-2] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:06:02.536836833Z [2024-04-05 23:06:02,536: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-05T23:06:02.536843129Z [2024-04-05 23:06:02,536: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-05T23:06:02.536858869Z [2024-04-05 23:06:02,536: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:06:02.556336491Z [2024-04-05 23:06:02,555: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-05T23:06:02.560595010Z [2024-04-05 23:06:02,559: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:06:02.594731900Z [2024-04-05 23:06:02,594: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-05T23:06:02.596408652Z [2024-04-05 23:06:02,596: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:06:02.596425510Z [2024-04-05 23:06:02,596: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:06:02.596448936Z [2024-04-05 23:06:02,596: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:06:02.596639550Z [2024-04-05 23:06:02,596: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-05T23:06:02.596961785Z [2024-04-05 23:06:02,596: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T23:06:02.596975616Z [2024-04-05 23:06:02,596: INFO/ForkPoolWorker-1] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:06:02.664773180Z [2024-04-05 23:06:02,664: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:06:02.728249329Z [2024-04-05 23:06:02,727: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:06:05.213087387Z [2024-04-05 23:06:05,212: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[328535c0-5a4e-4bf3-ba67-9a7309a34755] succeeded in 4.7093093989997215s: None 2024-04-05T23:06:05.906853559Z [2024-04-05 23:06:05,906: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[e14eabbe-c23b-46a3-86f8-407b8d798290] succeeded in 5.400410453999939s: None 2024-04-05T23:07:00.320375666Z [2024-04-05 23:07:00,319: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[979242cf-89e1-4102-9bfd-74ea8cf16c5d] received 2024-04-05T23:07:00.322162042Z [2024-04-05 23:07:00,321: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7be5d4e6-5f34-4e76-9b63-942eb21062cc] received 2024-04-05T23:07:00.331515527Z [2024-04-05 23:07:00,331: INFO/ForkPoolWorker-15] [979242cf-89e1-4102-9bfd-74ea8cf16c5d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T23:07:00.334604813Z [2024-04-05 23:07:00,334: INFO/ForkPoolWorker-16] [7be5d4e6-5f34-4e76-9b63-942eb21062cc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T23:07:00.354150764Z [2024-04-05 23:07:00,353: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[674b73a6-a6f7-46ee-8288-e783bfaf8ba6] received 2024-04-05T23:07:00.379687534Z [2024-04-05 23:07:00,379: INFO/ForkPoolWorker-1] [674b73a6-a6f7-46ee-8288-e783bfaf8ba6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T23:07:00.620736989Z [2024-04-05 23:07:00,617: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T23:07:00.661701960Z [2024-04-05 23:07:00,658: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-05T23:07:00.756297235Z [2024-04-05 23:07:00,750: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T23:07:00.822111867Z [2024-04-05 23:07:00,821: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-05T23:07:00.826261869Z [2024-04-05 23:07:00,825: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:07:00.852471649Z [2024-04-05 23:07:00,852: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T23:07:00.854130719Z [2024-04-05 23:07:00,853: INFO/ForkPoolWorker-15] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-05T23:07:00.854299538Z [2024-04-05 23:07:00,854: INFO/ForkPoolWorker-15] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-05T23:07:00.854404308Z [2024-04-05 23:07:00,854: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-05T23:07:00.854672257Z [2024-04-05 23:07:00,854: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-05T23:07:00.947725411Z [2024-04-05 23:07:00,947: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:07:01.504334354Z [2024-04-05 23:07:01,503: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[979242cf-89e1-4102-9bfd-74ea8cf16c5d] succeeded in 1.1805063289998543s: None 2024-04-05T23:07:01.863081327Z [2024-04-05 23:07:01,862: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-05T23:07:01.867352910Z [2024-04-05 23:07:01,866: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:07:01.893118240Z [2024-04-05 23:07:01,892: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T23:07:01.895125353Z [2024-04-05 23:07:01,894: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:07:01.895411192Z [2024-04-05 23:07:01,895: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:07:01.895588899Z [2024-04-05 23:07:01,895: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:07:01.895751385Z [2024-04-05 23:07:01,895: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-05T23:07:01.896141408Z [2024-04-05 23:07:01,895: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T23:07:01.896153005Z [2024-04-05 23:07:01,896: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:07:01.991420247Z [2024-04-05 23:07:01,991: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:07:02.145338666Z [2024-04-05 23:07:02,144: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-05T23:07:02.148560947Z [2024-04-05 23:07:02,148: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:07:02.184231387Z [2024-04-05 23:07:02,183: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-05T23:07:02.186204055Z [2024-04-05 23:07:02,185: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:07:02.186435647Z [2024-04-05 23:07:02,186: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:07:02.186698711Z [2024-04-05 23:07:02,186: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:07:02.186878624Z [2024-04-05 23:07:02,186: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-05T23:07:02.187572352Z [2024-04-05 23:07:02,187: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-05T23:07:02.187813609Z [2024-04-05 23:07:02,187: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:07:02.284143443Z [2024-04-05 23:07:02,283: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:07:03.505650462Z [2024-04-05 23:07:03,505: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7be5d4e6-5f34-4e76-9b63-942eb21062cc] succeeded in 3.1787160109997785s: None 2024-04-05T23:07:04.264504101Z [2024-04-05 23:07:04,264: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[674b73a6-a6f7-46ee-8288-e783bfaf8ba6] succeeded in 3.905400417000237s: None 2024-04-05T23:08:00.204974369Z [2024-04-05 23:08:00,204: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[73e3aad7-abde-4ba2-a017-b0cad7115392] received 2024-04-05T23:08:00.208517815Z [2024-04-05 23:08:00,208: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d5e6899d-0e4d-46bd-8f09-c878ab7be2af] received 2024-04-05T23:08:00.210369525Z [2024-04-05 23:08:00,210: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[935dd9ec-7ac0-4d91-8aa6-cf661d01c7c7] received 2024-04-05T23:08:00.212735829Z [2024-04-05 23:08:00,212: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c062a8a7-4ffa-4bf6-8925-b7d0d0cd7848] received 2024-04-05T23:08:00.225237996Z [2024-04-05 23:08:00,224: INFO/ForkPoolWorker-15] [73e3aad7-abde-4ba2-a017-b0cad7115392] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T23:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T23:08:00.226464863Z [2024-04-05 23:08:00,226: INFO/ForkPoolWorker-16] [d5e6899d-0e4d-46bd-8f09-c878ab7be2af] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T23:08:00.227959214Z [2024-04-05 23:08:00,227: INFO/ForkPoolWorker-1] [935dd9ec-7ac0-4d91-8aa6-cf661d01c7c7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T23:08:00.233571592Z [2024-04-05 23:08:00,233: INFO/ForkPoolWorker-2] [c062a8a7-4ffa-4bf6-8925-b7d0d0cd7848] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T23:08:00.543683438Z [2024-04-05 23:08:00,538: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T23:08:00.595442738Z [2024-04-05 23:08:00,588: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-05T23:08:00.617353196Z [2024-04-05 23:08:00,605: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-05T23:08:00.660136219Z [2024-04-05 23:08:00,656: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T23:08:00.759320279Z [2024-04-05 23:08:00,758: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-05T23:08:00.763652053Z [2024-04-05 23:08:00,763: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:08:00.785542067Z [2024-04-05 23:08:00,785: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T23:08:00.786767222Z [2024-04-05 23:08:00,786: INFO/ForkPoolWorker-16] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-05T23:08:00.787004029Z [2024-04-05 23:08:00,786: INFO/ForkPoolWorker-16] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-05T23:08:00.787167978Z [2024-04-05 23:08:00,787: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-05T23:08:00.787912789Z [2024-04-05 23:08:00,787: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-05T23:08:00.892734326Z [2024-04-05 23:08:00,892: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:08:01.063456221Z [2024-04-05 23:08:01,063: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:08:01.509136585Z [2024-04-05 23:08:01,508: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d5e6899d-0e4d-46bd-8f09-c878ab7be2af] succeeded in 1.2981622839997726s: None 2024-04-05T23:08:01.736719294Z [2024-04-05 23:08:01,736: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[73e3aad7-abde-4ba2-a017-b0cad7115392] succeeded in 1.5241417080001156s: None 2024-04-05T23:08:02.016949946Z [2024-04-05 23:08:02,016: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-05T23:08:02.020280408Z [2024-04-05 23:08:02,019: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:08:02.045774323Z [2024-04-05 23:08:02,045: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-05T23:08:02.047336963Z [2024-04-05 23:08:02,046: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:08:02.047354232Z [2024-04-05 23:08:02,047: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:08:02.047616901Z [2024-04-05 23:08:02,047: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:08:02.047639358Z [2024-04-05 23:08:02,047: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-05T23:08:02.047958320Z [2024-04-05 23:08:02,047: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-05T23:08:02.047971015Z [2024-04-05 23:08:02,047: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:08:02.132257144Z [2024-04-05 23:08:02,131: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:08:02.165350595Z [2024-04-05 23:08:02,164: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-05T23:08:02.168749689Z [2024-04-05 23:08:02,168: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:08:02.193747452Z [2024-04-05 23:08:02,193: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-05T23:08:02.195719084Z [2024-04-05 23:08:02,195: INFO/ForkPoolWorker-2] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:08:02.195738746Z [2024-04-05 23:08:02,195: INFO/ForkPoolWorker-2] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:08:02.195760060Z [2024-04-05 23:08:02,195: INFO/ForkPoolWorker-2] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:08:02.196027904Z [2024-04-05 23:08:02,195: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-05T23:08:02.196928977Z [2024-04-05 23:08:02,196: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T23:08:02.197071174Z [2024-04-05 23:08:02,196: INFO/ForkPoolWorker-2] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:08:02.303699608Z [2024-04-05 23:08:02,303: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:08:03.868033993Z [2024-04-05 23:08:03,867: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[c062a8a7-4ffa-4bf6-8925-b7d0d0cd7848] succeeded in 3.6500855009999214s: None 2024-04-05T23:08:03.933944919Z [2024-04-05 23:08:03,933: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[935dd9ec-7ac0-4d91-8aa6-cf661d01c7c7] succeeded in 3.7195464979999997s: None 2024-04-05T23:09:00.913084768Z [2024-04-05 23:09:00,910: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[05dba551-e61f-4604-ba17-a85f2fa79cf2] received 2024-04-05T23:09:00.914800466Z [2024-04-05 23:09:00,914: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ff0e2813-ad8f-470f-b0e1-ebf813f6306a] received 2024-04-05T23:09:00.918747955Z [2024-04-05 23:09:00,918: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[27b2504d-e37d-4352-ac8d-e4e005468a3c] received 2024-04-05T23:09:00.928339246Z [2024-04-05 23:09:00,928: INFO/ForkPoolWorker-15] [05dba551-e61f-4604-ba17-a85f2fa79cf2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T23:09:00.934557765Z [2024-04-05 23:09:00,934: INFO/ForkPoolWorker-16] [ff0e2813-ad8f-470f-b0e1-ebf813f6306a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T23:09:00.936862230Z [2024-04-05 23:09:00,936: INFO/ForkPoolWorker-1] [27b2504d-e37d-4352-ac8d-e4e005468a3c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T23:09:01.217617052Z [2024-04-05 23:09:01,213: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T23:09:01.248694437Z [2024-04-05 23:09:01,245: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T23:09:01.254026379Z [2024-04-05 23:09:01,250: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-05T23:09:01.423058485Z [2024-04-05 23:09:01,422: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-05T23:09:01.427244150Z [2024-04-05 23:09:01,426: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:09:01.449540014Z [2024-04-05 23:09:01,449: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T23:09:01.451214158Z [2024-04-05 23:09:01,450: INFO/ForkPoolWorker-16] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-05T23:09:01.451480156Z [2024-04-05 23:09:01,451: INFO/ForkPoolWorker-16] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-05T23:09:01.451564093Z [2024-04-05 23:09:01,451: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-05T23:09:01.451815317Z [2024-04-05 23:09:01,451: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-05T23:09:01.543855907Z [2024-04-05 23:09:01,543: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:09:02.135221258Z [2024-04-05 23:09:02,134: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ff0e2813-ad8f-470f-b0e1-ebf813f6306a] succeeded in 1.2173948140002722s: None 2024-04-05T23:09:02.449135921Z [2024-04-05 23:09:02,448: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-05T23:09:02.452602462Z [2024-04-05 23:09:02,452: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:09:02.481050911Z [2024-04-05 23:09:02,480: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-05T23:09:02.482848953Z [2024-04-05 23:09:02,482: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:09:02.483073647Z [2024-04-05 23:09:02,482: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:09:02.483360115Z [2024-04-05 23:09:02,483: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:09:02.483605865Z [2024-04-05 23:09:02,483: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-05T23:09:02.484002142Z [2024-04-05 23:09:02,483: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-05T23:09:02.484182574Z [2024-04-05 23:09:02,484: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:09:02.535850537Z [2024-04-05 23:09:02,535: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T23:09:02.539414045Z [2024-04-05 23:09:02,538: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:09:02.563921962Z [2024-04-05 23:09:02,563: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T23:09:02.566642982Z [2024-04-05 23:09:02,566: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:09:02.566922750Z [2024-04-05 23:09:02,566: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:09:02.567594480Z [2024-04-05 23:09:02,566: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:09:02.567907324Z [2024-04-05 23:09:02,567: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T23:09:02.568815574Z [2024-04-05 23:09:02,568: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T23:09:02.569141664Z [2024-04-05 23:09:02,568: INFO/ForkPoolWorker-15] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:09:02.572033084Z [2024-04-05 23:09:02,571: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:09:02.678490826Z [2024-04-05 23:09:02,678: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:09:04.243579279Z [2024-04-05 23:09:04,242: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[05dba551-e61f-4604-ba17-a85f2fa79cf2] succeeded in 3.3286235559999113s: None 2024-04-05T23:09:04.509337746Z [2024-04-05 23:09:04,508: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[27b2504d-e37d-4352-ac8d-e4e005468a3c] succeeded in 3.5885810220001986s: None 2024-04-05T23:10:00.850936686Z [2024-04-05 23:10:00,850: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d5798ee9-f36b-4f07-a4bd-81545d9dec5c] received 2024-04-05T23:10:00.859085571Z [2024-04-05 23:10:00,858: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6d21ffc5-82ad-4338-80ea-e8c7af3d4881] received 2024-04-05T23:10:00.867844001Z [2024-04-05 23:10:00,867: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[23fb5b5b-0ba5-491e-9199-a8611bd6a358] received 2024-04-05T23:10:00.873966520Z [2024-04-05 23:10:00,873: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f609df3c-1f53-43e9-9677-f2f27fe7c4bd] received 2024-04-05T23:10:00.880964353Z [2024-04-05 23:10:00,880: INFO/ForkPoolWorker-1] [23fb5b5b-0ba5-491e-9199-a8611bd6a358] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T23:10:00.882796406Z [2024-04-05 23:10:00,882: INFO/ForkPoolWorker-16] [6d21ffc5-82ad-4338-80ea-e8c7af3d4881] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T23:10:00.882945745Z [2024-04-05 23:10:00,881: INFO/ForkPoolWorker-15] [d5798ee9-f36b-4f07-a4bd-81545d9dec5c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T23:10:00.886275398Z [2024-04-05 23:10:00,886: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dcdcf818-63e5-478e-84f5-b48d827f403b] received 2024-04-05T23:10:00.893966141Z [2024-04-05 23:10:00,893: INFO/ForkPoolWorker-2] [f609df3c-1f53-43e9-9677-f2f27fe7c4bd] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T23:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T23:10:00.907720659Z [2024-04-05 23:10:00,907: INFO/ForkPoolWorker-3] [dcdcf818-63e5-478e-84f5-b48d827f403b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T23:10:01.207431333Z [2024-04-05 23:10:01,203: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-05T23:10:01.262306075Z [2024-04-05 23:10:01,258: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T23:10:01.271826063Z [2024-04-05 23:10:01,267: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T23:10:01.468065121Z [2024-04-05 23:10:01,467: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:10:01.480609110Z [2024-04-05 23:10:01,476: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T23:10:01.633603106Z [2024-04-05 23:10:01,622: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-05T23:10:01.980313306Z [2024-04-05 23:10:01,979: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[f609df3c-1f53-43e9-9677-f2f27fe7c4bd] succeeded in 1.1017061399998056s: None 2024-04-05T23:10:02.093885700Z [2024-04-05 23:10:02,093: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-05T23:10:02.109179435Z [2024-04-05 23:10:02,106: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:10:02.156413716Z [2024-04-05 23:10:02,156: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T23:10:02.160330054Z [2024-04-05 23:10:02,160: INFO/ForkPoolWorker-15] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-05T23:10:02.160429815Z [2024-04-05 23:10:02,160: INFO/ForkPoolWorker-15] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-05T23:10:02.160493368Z [2024-04-05 23:10:02,160: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-05T23:10:02.160815289Z [2024-04-05 23:10:02,160: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-05T23:10:02.278841605Z [2024-04-05 23:10:02,278: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:10:02.964492219Z [2024-04-05 23:10:02,962: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d5798ee9-f36b-4f07-a4bd-81545d9dec5c] succeeded in 2.1052493909996883s: None 2024-04-05T23:10:03.092975699Z [2024-04-05 23:10:03,092: INFO/ForkPoolWorker-3] Getting VIM list 2024-04-05T23:10:03.102934115Z [2024-04-05 23:10:03,102: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-05T23:10:03.106183859Z [2024-04-05 23:10:03,105: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:10:03.106268310Z [2024-04-05 23:10:03,105: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:10:03.133163525Z [2024-04-05 23:10:03,132: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-05T23:10:03.135629004Z [2024-04-05 23:10:03,135: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:10:03.135667677Z [2024-04-05 23:10:03,135: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:10:03.135815958Z [2024-04-05 23:10:03,135: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:10:03.135829160Z [2024-04-05 23:10:03,135: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-05T23:10:03.136170523Z [2024-04-05 23:10:03,136: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-05T23:10:03.136184195Z [2024-04-05 23:10:03,136: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:10:03.144356683Z [2024-04-05 23:10:03,144: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-05T23:10:03.145724939Z [2024-04-05 23:10:03,145: INFO/ForkPoolWorker-3] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:10:03.145738534Z [2024-04-05 23:10:03,145: INFO/ForkPoolWorker-3] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:10:03.145936485Z [2024-04-05 23:10:03,145: INFO/ForkPoolWorker-3] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:10:03.146006004Z [2024-04-05 23:10:03,145: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-04-05T23:10:03.146304870Z [2024-04-05 23:10:03,146: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T23:10:03.146313060Z [2024-04-05 23:10:03,146: INFO/ForkPoolWorker-3] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:10:03.224664150Z [2024-04-05 23:10:03,224: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:10:03.227060896Z [2024-04-05 23:10:03,226: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:10:03.365344340Z [2024-04-05 23:10:03,364: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-05T23:10:03.368829549Z [2024-04-05 23:10:03,368: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:10:03.396703961Z [2024-04-05 23:10:03,396: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T23:10:03.400723976Z [2024-04-05 23:10:03,400: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:10:03.400791852Z [2024-04-05 23:10:03,400: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:10:03.400974095Z [2024-04-05 23:10:03,400: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:10:03.401045426Z [2024-04-05 23:10:03,400: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-05T23:10:03.401362686Z [2024-04-05 23:10:03,401: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T23:10:03.401553939Z [2024-04-05 23:10:03,401: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:10:03.525166824Z [2024-04-05 23:10:03,524: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:10:04.185168142Z [2024-04-05 23:10:04,184: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f70586fc-6aff-494e-b404-019c559418e3] received 2024-04-05T23:10:04.201817077Z [2024-04-05 23:10:04,201: INFO/ForkPoolWorker-15] [f70586fc-6aff-494e-b404-019c559418e3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'split_metrics', 'scheduled__2024-04-05T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T23:10:04.298011873Z [2024-04-05 23:10:04,297: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6d21ffc5-82ad-4338-80ea-e8c7af3d4881] succeeded in 3.431298711999716s: None 2024-04-05T23:10:04.628354410Z [2024-04-05 23:10:04,623: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T23:10:04.894799232Z [2024-04-05 23:10:04,894: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[dcdcf818-63e5-478e-84f5-b48d827f403b] succeeded in 4.00113455499968s: None 2024-04-05T23:10:05.262406646Z [2024-04-05 23:10:05,261: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[23fb5b5b-0ba5-491e-9199-a8611bd6a358] succeeded in 4.389837010999599s: None 2024-04-05T23:10:05.981232841Z [2024-04-05 23:10:05,980: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T23:10:05.985456323Z [2024-04-05 23:10:05,984: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:10:06.010860693Z [2024-04-05 23:10:06,010: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T23:10:06.013591561Z [2024-04-05 23:10:06,013: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:10:06.013699881Z [2024-04-05 23:10:06,013: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:10:06.013986505Z [2024-04-05 23:10:06,013: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:10:06.014061904Z [2024-04-05 23:10:06,013: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T23:10:06.014595107Z [2024-04-05 23:10:06,014: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T23:10:06.014737578Z [2024-04-05 23:10:06,014: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:10:06.118443956Z [2024-04-05 23:10:06,118: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:10:06.838755224Z [2024-04-05 23:10:06,838: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f70586fc-6aff-494e-b404-019c559418e3] succeeded in 2.650663843000075s: None 2024-04-05T23:10:07.647576771Z [2024-04-05 23:10:07,647: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0ed882ae-76f3-4d98-bf8e-620b6627c508] received 2024-04-05T23:10:07.655403670Z [2024-04-05 23:10:07,655: INFO/ForkPoolWorker-15] [0ed882ae-76f3-4d98-bf8e-620b6627c508] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'collect_metrics', 'scheduled__2024-04-05T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T23:10:07.960360503Z [2024-04-05 23:10:07,956: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T23:10:09.189766242Z [2024-04-05 23:10:09,189: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T23:10:09.193283808Z [2024-04-05 23:10:09,192: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:10:09.219360355Z [2024-04-05 23:10:09,218: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T23:10:09.221070297Z [2024-04-05 23:10:09,220: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:10:09.221092473Z [2024-04-05 23:10:09,220: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:10:09.221179517Z [2024-04-05 23:10:09,220: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:10:09.221266655Z [2024-04-05 23:10:09,221: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T23:10:09.221684242Z [2024-04-05 23:10:09,221: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T23:10:09.221747142Z [2024-04-05 23:10:09,221: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:10:09.338489333Z [2024-04-05 23:10:09,338: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:10:09.984009244Z [2024-04-05 23:10:09,983: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[855637b2-d981-4ec1-b762-0e5b39487f0a] received 2024-04-05T23:10:09.984870775Z [2024-04-05 23:10:09,984: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0ed882ae-76f3-4d98-bf8e-620b6627c508] succeeded in 2.334512655999788s: None 2024-04-05T23:10:09.992502585Z [2024-04-05 23:10:09,992: INFO/ForkPoolWorker-16] [855637b2-d981-4ec1-b762-0e5b39487f0a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'send_prometheus', 'scheduled__2024-04-05T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T23:10:10.352997678Z [2024-04-05 23:10:10,349: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T23:10:11.564328007Z [2024-04-05 23:10:11,563: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-05T23:10:11.567983360Z [2024-04-05 23:10:11,567: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:10:11.596528585Z [2024-04-05 23:10:11,596: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T23:10:11.598459435Z [2024-04-05 23:10:11,598: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:10:11.598509875Z [2024-04-05 23:10:11,598: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:10:11.598777294Z [2024-04-05 23:10:11,598: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:10:11.598794050Z [2024-04-05 23:10:11,598: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-05T23:10:11.599222403Z [2024-04-05 23:10:11,598: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T23:10:11.599238250Z [2024-04-05 23:10:11,599: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:10:11.716925073Z [2024-04-05 23:10:11,716: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:10:12.386408259Z [2024-04-05 23:10:12,385: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[855637b2-d981-4ec1-b762-0e5b39487f0a] succeeded in 2.400243434999993s: None 2024-04-05T23:11:00.475814988Z [2024-04-05 23:11:00,475: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b315858c-7c9a-4f18-a12a-83e5b988e243] received 2024-04-05T23:11:00.481187373Z [2024-04-05 23:11:00,480: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0e1cba8f-c12f-4d1f-8a98-87d06067db06] received 2024-04-05T23:11:00.485276413Z [2024-04-05 23:11:00,484: INFO/ForkPoolWorker-15] [b315858c-7c9a-4f18-a12a-83e5b988e243] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T23:11:00.490334981Z [2024-04-05 23:11:00,490: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8bdaaf66-9d19-45d4-bd71-222db2a95746] received 2024-04-05T23:11:00.495921630Z [2024-04-05 23:11:00,495: INFO/ForkPoolWorker-16] [0e1cba8f-c12f-4d1f-8a98-87d06067db06] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T23:11:00.503652430Z [2024-04-05 23:11:00,503: INFO/ForkPoolWorker-1] [8bdaaf66-9d19-45d4-bd71-222db2a95746] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T23:11:00.781284502Z [2024-04-05 23:11:00,777: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T23:11:00.791976608Z [2024-04-05 23:11:00,788: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-05T23:11:00.802265771Z [2024-04-05 23:11:00,798: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T23:11:00.939450280Z [2024-04-05 23:11:00,938: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-05T23:11:00.943078618Z [2024-04-05 23:11:00,942: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:11:00.976112846Z [2024-04-05 23:11:00,975: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T23:11:00.977929311Z [2024-04-05 23:11:00,977: INFO/ForkPoolWorker-16] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-05T23:11:00.978120564Z [2024-04-05 23:11:00,977: INFO/ForkPoolWorker-16] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-05T23:11:00.978240765Z [2024-04-05 23:11:00,978: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-05T23:11:00.978618717Z [2024-04-05 23:11:00,978: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-05T23:11:01.082113371Z [2024-04-05 23:11:01,081: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:11:01.703770337Z [2024-04-05 23:11:01,703: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0e1cba8f-c12f-4d1f-8a98-87d06067db06] succeeded in 1.220266287999948s: None 2024-04-05T23:11:01.920649693Z [2024-04-05 23:11:01,920: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T23:11:01.925748729Z [2024-04-05 23:11:01,923: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:11:01.944803158Z [2024-04-05 23:11:01,944: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T23:11:01.946270518Z [2024-04-05 23:11:01,946: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:11:01.946294974Z [2024-04-05 23:11:01,946: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:11:01.946407831Z [2024-04-05 23:11:01,946: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:11:01.946413554Z [2024-04-05 23:11:01,946: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T23:11:01.946630900Z [2024-04-05 23:11:01,946: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T23:11:01.947137165Z [2024-04-05 23:11:01,946: INFO/ForkPoolWorker-15] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:11:02.049238827Z [2024-04-05 23:11:02,048: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-05T23:11:02.052407931Z [2024-04-05 23:11:02,052: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:11:02.052449473Z [2024-04-05 23:11:02,051: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:11:02.085489172Z [2024-04-05 23:11:02,085: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-05T23:11:02.087119796Z [2024-04-05 23:11:02,086: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:11:02.087308079Z [2024-04-05 23:11:02,087: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:11:02.087607148Z [2024-04-05 23:11:02,087: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:11:02.087734016Z [2024-04-05 23:11:02,087: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-05T23:11:02.088089695Z [2024-04-05 23:11:02,087: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-05T23:11:02.088201735Z [2024-04-05 23:11:02,088: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:11:02.196954336Z [2024-04-05 23:11:02,196: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:11:03.659771568Z [2024-04-05 23:11:03,659: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b315858c-7c9a-4f18-a12a-83e5b988e243] succeeded in 3.1818735329998162s: None 2024-04-05T23:11:04.372915433Z [2024-04-05 23:11:04,372: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8bdaaf66-9d19-45d4-bd71-222db2a95746] succeeded in 3.8805447439999625s: None 2024-04-05T23:12:00.940739413Z [2024-04-05 23:12:00,939: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b1e80ed6-8b83-4eb8-a026-203c65772957] received 2024-04-05T23:12:00.946721409Z [2024-04-05 23:12:00,946: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[115211bf-f459-44a4-9d9d-3d8c751c75ce] received 2024-04-05T23:12:00.950471170Z [2024-04-05 23:12:00,950: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4fad573b-5d9e-407b-8903-6c761bb7b143] received 2024-04-05T23:12:00.961207951Z [2024-04-05 23:12:00,960: INFO/ForkPoolWorker-15] [b1e80ed6-8b83-4eb8-a026-203c65772957] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T23:12:00.970074075Z [2024-04-05 23:12:00,969: INFO/ForkPoolWorker-16] [115211bf-f459-44a4-9d9d-3d8c751c75ce] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T23:12:00.972262168Z [2024-04-05 23:12:00,972: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ba1404d0-f83c-48ee-a401-59648c6a6c48] received 2024-04-05T23:12:00.986503156Z [2024-04-05 23:12:00,986: INFO/ForkPoolWorker-1] [4fad573b-5d9e-407b-8903-6c761bb7b143] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T23:12:00.992327380Z [2024-04-05 23:12:00,991: INFO/ForkPoolWorker-2] [ba1404d0-f83c-48ee-a401-59648c6a6c48] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T23:12:01.404738689Z [2024-04-05 23:12:01,397: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-05T23:12:01.405262268Z [2024-04-05 23:12:01,401: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T23:12:01.450937252Z [2024-04-05 23:12:01,445: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T23:12:01.501522540Z [2024-04-05 23:12:01,497: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-05T23:12:01.676678106Z [2024-04-05 23:12:01,676: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-05T23:12:01.681105532Z [2024-04-05 23:12:01,680: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:12:01.714421711Z [2024-04-05 23:12:01,714: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-05T23:12:01.719917495Z [2024-04-05 23:12:01,719: INFO/ForkPoolWorker-2] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-05T23:12:01.720229336Z [2024-04-05 23:12:01,719: INFO/ForkPoolWorker-2] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-05T23:12:01.720419067Z [2024-04-05 23:12:01,720: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-05T23:12:01.720790014Z [2024-04-05 23:12:01,720: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-05T23:12:01.774738161Z [2024-04-05 23:12:01,774: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:12:01.893054724Z [2024-04-05 23:12:01,892: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:12:02.592255538Z [2024-04-05 23:12:02,591: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[ba1404d0-f83c-48ee-a401-59648c6a6c48] succeeded in 1.6131228009999177s: None 2024-04-05T23:12:02.602274365Z [2024-04-05 23:12:02,601: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[115211bf-f459-44a4-9d9d-3d8c751c75ce] succeeded in 1.649901706000037s: None 2024-04-05T23:12:03.079197444Z [2024-04-05 23:12:03,078: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-05T23:12:03.082682809Z [2024-04-05 23:12:03,082: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:12:03.110577010Z [2024-04-05 23:12:03,110: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-05T23:12:03.112296246Z [2024-04-05 23:12:03,111: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:12:03.112347261Z [2024-04-05 23:12:03,112: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:12:03.112655280Z [2024-04-05 23:12:03,112: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:12:03.112674372Z [2024-04-05 23:12:03,112: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-05T23:12:03.113303262Z [2024-04-05 23:12:03,113: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-05T23:12:03.113503216Z [2024-04-05 23:12:03,113: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:12:03.121526460Z [2024-04-05 23:12:03,121: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T23:12:03.125525953Z [2024-04-05 23:12:03,125: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:12:03.148951080Z [2024-04-05 23:12:03,148: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T23:12:03.150464577Z [2024-04-05 23:12:03,149: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:12:03.150493436Z [2024-04-05 23:12:03,150: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:12:03.150503603Z [2024-04-05 23:12:03,150: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:12:03.150512473Z [2024-04-05 23:12:03,150: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T23:12:03.150631601Z [2024-04-05 23:12:03,150: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T23:12:03.150643145Z [2024-04-05 23:12:03,150: INFO/ForkPoolWorker-15] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:12:03.216005437Z [2024-04-05 23:12:03,215: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:12:03.233170305Z [2024-04-05 23:12:03,232: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:12:05.115631436Z [2024-04-05 23:12:05,115: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b1e80ed6-8b83-4eb8-a026-203c65772957] succeeded in 4.170325730000059s: None 2024-04-05T23:12:05.382121862Z [2024-04-05 23:12:05,381: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4fad573b-5d9e-407b-8903-6c761bb7b143] succeeded in 4.426797081000132s: None 2024-04-05T23:13:00.596508233Z [2024-04-05 23:13:00,596: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[99a30ca3-798c-4b94-a80b-5dc94993a045] received 2024-04-05T23:13:00.599986049Z [2024-04-05 23:13:00,599: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[554a8401-a3b6-44da-afa2-5d5dd6120c41] received 2024-04-05T23:13:00.628574889Z [2024-04-05 23:13:00,628: INFO/ForkPoolWorker-15] [99a30ca3-798c-4b94-a80b-5dc94993a045] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T23:13:00.632542347Z [2024-04-05 23:13:00,632: INFO/ForkPoolWorker-16] [554a8401-a3b6-44da-afa2-5d5dd6120c41] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T23:13:00.859898297Z [2024-04-05 23:13:00,859: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1e08af9d-ab03-4c39-8ec2-ba33a368940d] received 2024-04-05T23:13:00.880717290Z [2024-04-05 23:13:00,880: INFO/ForkPoolWorker-1] [1e08af9d-ab03-4c39-8ec2-ba33a368940d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T23:13:00.942535792Z [2024-04-05 23:13:00,938: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T23:13:01.068506892Z [2024-04-05 23:13:01,064: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T23:13:01.297969978Z [2024-04-05 23:13:01,294: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-05T23:13:01.497988815Z [2024-04-05 23:13:01,496: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-05T23:13:01.503410945Z [2024-04-05 23:13:01,500: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:13:01.525400030Z [2024-04-05 23:13:01,525: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-05T23:13:01.526369596Z [2024-04-05 23:13:01,526: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-05T23:13:01.526506640Z [2024-04-05 23:13:01,526: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-05T23:13:01.526617233Z [2024-04-05 23:13:01,526: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-05T23:13:01.527029003Z [2024-04-05 23:13:01,526: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-05T23:13:01.627204130Z [2024-04-05 23:13:01,626: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:13:02.290428158Z [2024-04-05 23:13:02,289: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1e08af9d-ab03-4c39-8ec2-ba33a368940d] succeeded in 1.4219164080000155s: None 2024-04-05T23:13:02.407660735Z [2024-04-05 23:13:02,407: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T23:13:02.411670087Z [2024-04-05 23:13:02,410: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:13:02.424187668Z [2024-04-05 23:13:02,423: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-05T23:13:02.427702789Z [2024-04-05 23:13:02,427: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:13:02.435591511Z [2024-04-05 23:13:02,435: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T23:13:02.437202588Z [2024-04-05 23:13:02,436: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:13:02.437394114Z [2024-04-05 23:13:02,437: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:13:02.438423702Z [2024-04-05 23:13:02,438: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:13:02.438596732Z [2024-04-05 23:13:02,438: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T23:13:02.439007813Z [2024-04-05 23:13:02,438: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T23:13:02.439077062Z [2024-04-05 23:13:02,438: INFO/ForkPoolWorker-15] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:13:02.449635007Z [2024-04-05 23:13:02,449: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T23:13:02.450816873Z [2024-04-05 23:13:02,450: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:13:02.450896352Z [2024-04-05 23:13:02,450: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:13:02.451037407Z [2024-04-05 23:13:02,450: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:13:02.451112230Z [2024-04-05 23:13:02,451: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-05T23:13:02.451407002Z [2024-04-05 23:13:02,451: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-05T23:13:02.451620767Z [2024-04-05 23:13:02,451: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:13:02.532563128Z [2024-04-05 23:13:02,532: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:13:02.535786095Z [2024-04-05 23:13:02,535: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:13:04.616171520Z [2024-04-05 23:13:04,615: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[99a30ca3-798c-4b94-a80b-5dc94993a045] succeeded in 4.015337651000209s: None 2024-04-05T23:13:04.865551969Z [2024-04-05 23:13:04,865: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[554a8401-a3b6-44da-afa2-5d5dd6120c41] succeeded in 4.263125700000273s: None 2024-04-05T23:14:00.659441293Z [2024-04-05 23:14:00,658: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ce8e868b-333b-45be-a8bf-da1a44569fb3] received 2024-04-05T23:14:00.661506529Z [2024-04-05 23:14:00,661: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a96a92d3-3dae-434d-8095-d10cd07ecac4] received 2024-04-05T23:14:00.676174152Z [2024-04-05 23:14:00,675: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[84ad8d1a-3e5b-413f-9aee-03398003f239] received 2024-04-05T23:14:00.677150746Z [2024-04-05 23:14:00,676: INFO/ForkPoolWorker-15] [ce8e868b-333b-45be-a8bf-da1a44569fb3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T23:14:00.680113887Z [2024-04-05 23:14:00,679: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0ca30e57-d07b-4101-96c4-1450d0765e90] received 2024-04-05T23:14:00.699819431Z [2024-04-05 23:14:00,699: INFO/ForkPoolWorker-16] [a96a92d3-3dae-434d-8095-d10cd07ecac4] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T23:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T23:14:00.701140167Z [2024-04-05 23:14:00,700: INFO/ForkPoolWorker-2] [0ca30e57-d07b-4101-96c4-1450d0765e90] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T23:14:00.704927249Z [2024-04-05 23:14:00,704: INFO/ForkPoolWorker-1] [84ad8d1a-3e5b-413f-9aee-03398003f239] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T23:14:01.081151749Z [2024-04-05 23:14:01,077: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-05T23:14:01.085780778Z [2024-04-05 23:14:01,082: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T23:14:01.101296167Z [2024-04-05 23:14:01,097: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T23:14:01.110049594Z [2024-04-05 23:14:01,105: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-05T23:14:01.300125351Z [2024-04-05 23:14:01,299: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-05T23:14:01.307793082Z [2024-04-05 23:14:01,307: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:14:01.372851105Z [2024-04-05 23:14:01,372: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-05T23:14:01.376358730Z [2024-04-05 23:14:01,376: INFO/ForkPoolWorker-2] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-05T23:14:01.376408464Z [2024-04-05 23:14:01,376: INFO/ForkPoolWorker-2] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-05T23:14:01.376444495Z [2024-04-05 23:14:01,376: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-05T23:14:01.376694773Z [2024-04-05 23:14:01,376: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-05T23:14:01.408259706Z [2024-04-05 23:14:01,407: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:14:01.529474998Z [2024-04-05 23:14:01,529: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:14:02.158957262Z [2024-04-05 23:14:02,158: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a96a92d3-3dae-434d-8095-d10cd07ecac4] succeeded in 1.4937188589997277s: None 2024-04-05T23:14:02.418156255Z [2024-04-05 23:14:02,417: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[0ca30e57-d07b-4101-96c4-1450d0765e90] succeeded in 1.7347628719999193s: None 2024-04-05T23:14:02.770051983Z [2024-04-05 23:14:02,769: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T23:14:02.773496974Z [2024-04-05 23:14:02,773: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:14:02.781056301Z [2024-04-05 23:14:02,780: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-05T23:14:02.785683320Z [2024-04-05 23:14:02,785: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:14:02.797663266Z [2024-04-05 23:14:02,797: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T23:14:02.799096505Z [2024-04-05 23:14:02,798: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:14:02.799280097Z [2024-04-05 23:14:02,799: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:14:02.799489955Z [2024-04-05 23:14:02,799: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:14:02.799590315Z [2024-04-05 23:14:02,799: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T23:14:02.800081297Z [2024-04-05 23:14:02,799: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-05T23:14:02.800128685Z [2024-04-05 23:14:02,800: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:14:02.809337461Z [2024-04-05 23:14:02,809: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-05T23:14:02.810973347Z [2024-04-05 23:14:02,810: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:14:02.811216223Z [2024-04-05 23:14:02,811: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:14:02.811709372Z [2024-04-05 23:14:02,811: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:14:02.811895688Z [2024-04-05 23:14:02,811: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-05T23:14:02.812239109Z [2024-04-05 23:14:02,812: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T23:14:02.812424464Z [2024-04-05 23:14:02,812: INFO/ForkPoolWorker-1] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:14:02.893150007Z [2024-04-05 23:14:02,892: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:14:02.909073234Z [2024-04-05 23:14:02,908: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:14:04.829172033Z [2024-04-05 23:14:04,828: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[84ad8d1a-3e5b-413f-9aee-03398003f239] succeeded in 4.149670084999798s: None 2024-04-05T23:14:04.883932077Z [2024-04-05 23:14:04,883: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ce8e868b-333b-45be-a8bf-da1a44569fb3] succeeded in 4.219940668000163s: None 2024-04-05T23:15:01.111762347Z [2024-04-05 23:15:01,111: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d9ef9695-cc40-40c5-b66b-b5417f3b87d9] received 2024-04-05T23:15:01.120779486Z [2024-04-05 23:15:01,119: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[36d66b37-0420-4e10-baf1-df2bb385e838] received 2024-04-05T23:15:01.129592446Z [2024-04-05 23:15:01,127: INFO/ForkPoolWorker-15] [d9ef9695-cc40-40c5-b66b-b5417f3b87d9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T23:15:01.132229205Z [2024-04-05 23:15:01,131: INFO/ForkPoolWorker-16] [36d66b37-0420-4e10-baf1-df2bb385e838] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T23:15:01.136742561Z [2024-04-05 23:15:01,135: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[305f1bc1-1090-49c0-8d11-ed1b31ef3733] received 2024-04-05T23:15:01.139953246Z [2024-04-05 23:15:01,139: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d3d3f997-34a4-4c43-9d4d-94b20eb7937b] received 2024-04-05T23:15:01.150200905Z [2024-04-05 23:15:01,149: INFO/ForkPoolWorker-2] [d3d3f997-34a4-4c43-9d4d-94b20eb7937b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T23:15:01.151889476Z [2024-04-05 23:15:01,151: INFO/ForkPoolWorker-1] [305f1bc1-1090-49c0-8d11-ed1b31ef3733] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T23:15:01.427707762Z [2024-04-05 23:15:01,424: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T23:15:01.499791404Z [2024-04-05 23:15:01,495: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T23:15:01.527299542Z [2024-04-05 23:15:01,521: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-05T23:15:01.644170340Z [2024-04-05 23:15:01,639: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T23:15:01.759088868Z [2024-04-05 23:15:01,758: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-05T23:15:01.763941500Z [2024-04-05 23:15:01,763: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:15:01.797318939Z [2024-04-05 23:15:01,797: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T23:15:01.799095750Z [2024-04-05 23:15:01,798: INFO/ForkPoolWorker-16] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-05T23:15:01.799364785Z [2024-04-05 23:15:01,799: INFO/ForkPoolWorker-16] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-05T23:15:01.799497971Z [2024-04-05 23:15:01,799: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-05T23:15:01.799814751Z [2024-04-05 23:15:01,799: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-05T23:15:01.935776482Z [2024-04-05 23:15:01,935: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:15:02.606491811Z [2024-04-05 23:15:02,606: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[36d66b37-0420-4e10-baf1-df2bb385e838] succeeded in 1.4835104550002143s: None 2024-04-05T23:15:02.857413700Z [2024-04-05 23:15:02,857: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-05T23:15:02.860990063Z [2024-04-05 23:15:02,860: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:15:02.880592160Z [2024-04-05 23:15:02,880: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T23:15:02.884688015Z [2024-04-05 23:15:02,884: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:15:02.885182697Z [2024-04-05 23:15:02,884: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-05T23:15:02.886538284Z [2024-04-05 23:15:02,886: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:15:02.886553265Z [2024-04-05 23:15:02,886: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:15:02.886685644Z [2024-04-05 23:15:02,886: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:15:02.886714998Z [2024-04-05 23:15:02,886: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-05T23:15:02.887019123Z [2024-04-05 23:15:02,886: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T23:15:02.887075258Z [2024-04-05 23:15:02,886: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:15:02.907066427Z [2024-04-05 23:15:02,906: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T23:15:02.912438050Z [2024-04-05 23:15:02,912: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:15:02.912538487Z [2024-04-05 23:15:02,912: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:15:02.912749988Z [2024-04-05 23:15:02,912: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:15:02.912864831Z [2024-04-05 23:15:02,912: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T23:15:02.913193984Z [2024-04-05 23:15:02,913: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T23:15:02.913824226Z [2024-04-05 23:15:02,913: INFO/ForkPoolWorker-15] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:15:02.969441402Z [2024-04-05 23:15:02,969: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:15:02.977520511Z [2024-04-05 23:15:02,977: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-05T23:15:02.980909732Z [2024-04-05 23:15:02,980: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:15:03.022568110Z [2024-04-05 23:15:03,022: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:15:03.026062590Z [2024-04-05 23:15:03,025: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-05T23:15:03.029271290Z [2024-04-05 23:15:03,029: INFO/ForkPoolWorker-2] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:15:03.029410322Z [2024-04-05 23:15:03,029: INFO/ForkPoolWorker-2] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:15:03.029580542Z [2024-04-05 23:15:03,029: INFO/ForkPoolWorker-2] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:15:03.029690017Z [2024-04-05 23:15:03,029: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-05T23:15:03.030005479Z [2024-04-05 23:15:03,029: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-05T23:15:03.030145950Z [2024-04-05 23:15:03,030: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:15:03.134751542Z [2024-04-05 23:15:03,134: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:15:03.597379145Z [2024-04-05 23:15:03,595: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[305f1bc1-1090-49c0-8d11-ed1b31ef3733] succeeded in 2.4559600219999993s: None 2024-04-05T23:15:04.251933827Z [2024-04-05 23:15:04,251: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[12cf270a-9c06-4858-9e8e-eb5ff54f496f] received 2024-04-05T23:15:04.272075946Z [2024-04-05 23:15:04,271: INFO/ForkPoolWorker-16] [12cf270a-9c06-4858-9e8e-eb5ff54f496f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'split_metrics', 'scheduled__2024-04-05T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T23:15:04.601191580Z [2024-04-05 23:15:04,597: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T23:15:04.735483527Z [2024-04-05 23:15:04,734: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d9ef9695-cc40-40c5-b66b-b5417f3b87d9] succeeded in 3.6201210379999793s: None 2024-04-05T23:15:05.108972737Z [2024-04-05 23:15:05,108: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d3d3f997-34a4-4c43-9d4d-94b20eb7937b] succeeded in 3.9666360829996847s: None 2024-04-05T23:15:05.898771283Z [2024-04-05 23:15:05,898: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-05T23:15:05.902484227Z [2024-04-05 23:15:05,901: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:15:05.933652509Z [2024-04-05 23:15:05,933: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T23:15:05.935136218Z [2024-04-05 23:15:05,934: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:15:05.935154525Z [2024-04-05 23:15:05,934: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:15:05.935337800Z [2024-04-05 23:15:05,935: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:15:05.935393164Z [2024-04-05 23:15:05,935: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-05T23:15:05.935777379Z [2024-04-05 23:15:05,935: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T23:15:05.935794607Z [2024-04-05 23:15:05,935: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:15:06.029735693Z [2024-04-05 23:15:06,029: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:15:06.658538443Z [2024-04-05 23:15:06,658: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[12cf270a-9c06-4858-9e8e-eb5ff54f496f] succeeded in 2.4048757040000055s: None 2024-04-05T23:15:06.682839952Z [2024-04-05 23:15:06,682: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[06b8438a-4c21-460b-97a9-776e729ecbd7] received 2024-04-05T23:15:06.705570794Z [2024-04-05 23:15:06,705: INFO/ForkPoolWorker-15] [06b8438a-4c21-460b-97a9-776e729ecbd7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'collect_metrics', 'scheduled__2024-04-05T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T23:15:06.999778645Z [2024-04-05 23:15:06,996: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T23:15:08.126130427Z [2024-04-05 23:15:08,125: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T23:15:08.129587847Z [2024-04-05 23:15:08,129: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:15:08.160842892Z [2024-04-05 23:15:08,160: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T23:15:08.171327319Z [2024-04-05 23:15:08,170: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:15:08.171591377Z [2024-04-05 23:15:08,171: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:15:08.172434105Z [2024-04-05 23:15:08,171: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:15:08.172567902Z [2024-04-05 23:15:08,172: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T23:15:08.172956516Z [2024-04-05 23:15:08,172: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T23:15:08.173080175Z [2024-04-05 23:15:08,172: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:15:08.302847403Z [2024-04-05 23:15:08,302: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:15:09.011777401Z [2024-04-05 23:15:09,011: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[06b8438a-4c21-460b-97a9-776e729ecbd7] succeeded in 2.32707527499997s: None 2024-04-05T23:15:09.101951955Z [2024-04-05 23:15:09,101: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c3bbca73-c980-4fe1-b4e0-7d7922e5b090] received 2024-04-05T23:15:09.113693623Z [2024-04-05 23:15:09,112: INFO/ForkPoolWorker-15] [c3bbca73-c980-4fe1-b4e0-7d7922e5b090] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'send_prometheus', 'scheduled__2024-04-05T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T23:15:09.384830110Z [2024-04-05 23:15:09,381: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T23:15:10.569670176Z [2024-04-05 23:15:10,568: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T23:15:10.573254773Z [2024-04-05 23:15:10,572: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:15:10.597488064Z [2024-04-05 23:15:10,597: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T23:15:10.598759239Z [2024-04-05 23:15:10,598: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:15:10.598807606Z [2024-04-05 23:15:10,598: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:15:10.599040663Z [2024-04-05 23:15:10,598: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:15:10.599106735Z [2024-04-05 23:15:10,599: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T23:15:10.599417845Z [2024-04-05 23:15:10,599: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T23:15:10.599506272Z [2024-04-05 23:15:10,599: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:15:10.685920468Z [2024-04-05 23:15:10,685: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:15:11.285653534Z [2024-04-05 23:15:11,285: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c3bbca73-c980-4fe1-b4e0-7d7922e5b090] succeeded in 2.180658488000063s: None 2024-04-05T23:16:00.451842486Z [2024-04-05 23:16:00,451: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2b64dc86-1e44-4b24-8cc9-bbeca7df7fa9] received 2024-04-05T23:16:00.454092212Z [2024-04-05 23:16:00,453: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4543abef-f716-401c-83f0-62e65c25a7c1] received 2024-04-05T23:16:00.458424564Z [2024-04-05 23:16:00,458: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3ba719f1-f5e5-447e-a652-b87e6e9a0e47] received 2024-04-05T23:16:00.466848168Z [2024-04-05 23:16:00,466: INFO/ForkPoolWorker-1] [3ba719f1-f5e5-447e-a652-b87e6e9a0e47] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T23:16:00.469981356Z [2024-04-05 23:16:00,469: INFO/ForkPoolWorker-16] [4543abef-f716-401c-83f0-62e65c25a7c1] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T23:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T23:16:00.475159697Z [2024-04-05 23:16:00,474: INFO/ForkPoolWorker-15] [2b64dc86-1e44-4b24-8cc9-bbeca7df7fa9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T23:16:00.478390028Z [2024-04-05 23:16:00,478: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dc059393-05a3-46a0-ab62-a031775450ef] received 2024-04-05T23:16:00.485977869Z [2024-04-05 23:16:00,485: INFO/ForkPoolWorker-2] [dc059393-05a3-46a0-ab62-a031775450ef] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T23:16:00.786952712Z [2024-04-05 23:16:00,783: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-05T23:16:00.815551773Z [2024-04-05 23:16:00,811: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-05T23:16:00.874830667Z [2024-04-05 23:16:00,870: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T23:16:00.900745545Z [2024-04-05 23:16:00,897: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T23:16:00.991931234Z [2024-04-05 23:16:00,991: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-05T23:16:00.996042334Z [2024-04-05 23:16:00,995: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:16:01.047195888Z [2024-04-05 23:16:01,046: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-05T23:16:01.051803556Z [2024-04-05 23:16:01,051: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-05T23:16:01.051939668Z [2024-04-05 23:16:01,051: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-05T23:16:01.052009587Z [2024-04-05 23:16:01,051: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-05T23:16:01.052345043Z [2024-04-05 23:16:01,052: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-05T23:16:01.115921662Z [2024-04-05 23:16:01,115: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:16:01.170425891Z [2024-04-05 23:16:01,170: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:16:01.789050614Z [2024-04-05 23:16:01,788: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4543abef-f716-401c-83f0-62e65c25a7c1] succeeded in 1.330027532999793s: None 2024-04-05T23:16:01.863045540Z [2024-04-05 23:16:01,862: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3ba719f1-f5e5-447e-a652-b87e6e9a0e47] succeeded in 1.4024082760001875s: None 2024-04-05T23:16:02.224486465Z [2024-04-05 23:16:02,224: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T23:16:02.228222618Z [2024-04-05 23:16:02,227: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:16:02.245707467Z [2024-04-05 23:16:02,245: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T23:16:02.247115668Z [2024-04-05 23:16:02,246: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:16:02.247210407Z [2024-04-05 23:16:02,247: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:16:02.247458944Z [2024-04-05 23:16:02,247: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:16:02.247733421Z [2024-04-05 23:16:02,247: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T23:16:02.248026672Z [2024-04-05 23:16:02,247: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T23:16:02.248161804Z [2024-04-05 23:16:02,248: INFO/ForkPoolWorker-15] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:16:02.338316431Z [2024-04-05 23:16:02,338: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:16:02.402562070Z [2024-04-05 23:16:02,402: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-05T23:16:02.406019878Z [2024-04-05 23:16:02,405: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:16:02.445337517Z [2024-04-05 23:16:02,445: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-05T23:16:02.447327065Z [2024-04-05 23:16:02,446: INFO/ForkPoolWorker-2] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:16:02.447456366Z [2024-04-05 23:16:02,447: INFO/ForkPoolWorker-2] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:16:02.447684967Z [2024-04-05 23:16:02,447: INFO/ForkPoolWorker-2] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:16:02.447806982Z [2024-04-05 23:16:02,447: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-05T23:16:02.448140466Z [2024-04-05 23:16:02,447: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-05T23:16:02.448597669Z [2024-04-05 23:16:02,448: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:16:02.542338317Z [2024-04-05 23:16:02,541: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:16:03.925693422Z [2024-04-05 23:16:03,924: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2b64dc86-1e44-4b24-8cc9-bbeca7df7fa9] succeeded in 3.4704557509999177s: None 2024-04-05T23:16:04.480482535Z [2024-04-05 23:16:04,480: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[dc059393-05a3-46a0-ab62-a031775450ef] succeeded in 4.000045838999995s: None 2024-04-05T23:17:01.161804367Z [2024-04-05 23:17:01,161: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6f51c843-a95f-48c7-ba85-e0703e3e187c] received 2024-04-05T23:17:01.165923339Z [2024-04-05 23:17:01,165: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5b0e170e-b2b2-4701-a497-6465f9fd9ebc] received 2024-04-05T23:17:01.169193485Z [2024-04-05 23:17:01,168: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2043f5a9-7528-4980-8d2a-caa90fd26ac4] received 2024-04-05T23:17:01.171864991Z [2024-04-05 23:17:01,171: INFO/ForkPoolWorker-15] [6f51c843-a95f-48c7-ba85-e0703e3e187c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T23:17:01.181983711Z [2024-04-05 23:17:01,181: INFO/ForkPoolWorker-1] [2043f5a9-7528-4980-8d2a-caa90fd26ac4] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T23:17:01.182246144Z [2024-04-05 23:17:01,181: INFO/ForkPoolWorker-16] [5b0e170e-b2b2-4701-a497-6465f9fd9ebc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T23:17:01.459693001Z [2024-04-05 23:17:01,455: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T23:17:01.475214222Z [2024-04-05 23:17:01,471: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T23:17:01.518859395Z [2024-04-05 23:17:01,514: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-05T23:17:01.715033880Z [2024-04-05 23:17:01,714: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-05T23:17:01.720514879Z [2024-04-05 23:17:01,719: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:17:01.746553530Z [2024-04-05 23:17:01,746: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-05T23:17:01.747768806Z [2024-04-05 23:17:01,747: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-05T23:17:01.747897554Z [2024-04-05 23:17:01,747: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-05T23:17:01.747934429Z [2024-04-05 23:17:01,747: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-05T23:17:01.748174149Z [2024-04-05 23:17:01,748: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-05T23:17:01.860363779Z [2024-04-05 23:17:01,860: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:17:02.566833968Z [2024-04-05 23:17:02,566: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2043f5a9-7528-4980-8d2a-caa90fd26ac4] succeeded in 1.3921463259998745s: None 2024-04-05T23:17:02.859766949Z [2024-04-05 23:17:02,858: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T23:17:02.874466480Z [2024-04-05 23:17:02,873: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:17:02.916064974Z [2024-04-05 23:17:02,915: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T23:17:02.917685620Z [2024-04-05 23:17:02,917: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:17:02.917716009Z [2024-04-05 23:17:02,917: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:17:02.917872989Z [2024-04-05 23:17:02,917: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:17:02.917929234Z [2024-04-05 23:17:02,917: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T23:17:02.918196225Z [2024-04-05 23:17:02,918: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-05T23:17:02.918366882Z [2024-04-05 23:17:02,918: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:17:03.014662021Z [2024-04-05 23:17:03,014: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-05T23:17:03.019044571Z [2024-04-05 23:17:03,018: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:17:03.042414131Z [2024-04-05 23:17:03,042: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:17:03.057047383Z [2024-04-05 23:17:03,056: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T23:17:03.060816456Z [2024-04-05 23:17:03,060: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:17:03.060893324Z [2024-04-05 23:17:03,060: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:17:03.061138380Z [2024-04-05 23:17:03,060: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:17:03.061305061Z [2024-04-05 23:17:03,061: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-05T23:17:03.061788884Z [2024-04-05 23:17:03,061: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T23:17:03.061875900Z [2024-04-05 23:17:03,061: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:17:03.180514671Z [2024-04-05 23:17:03,180: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:17:04.706194832Z [2024-04-05 23:17:04,705: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5b0e170e-b2b2-4701-a497-6465f9fd9ebc] succeeded in 3.537194193000232s: None 2024-04-05T23:17:05.022137026Z [2024-04-05 23:17:05,021: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6f51c843-a95f-48c7-ba85-e0703e3e187c] succeeded in 3.858167623999634s: None 2024-04-05T23:18:01.029977542Z [2024-04-05 23:18:01,029: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fa662a7a-e6a6-4982-8e2b-af4d892ff50d] received 2024-04-05T23:18:01.033537425Z [2024-04-05 23:18:01,033: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a7a7b199-ea87-4813-a2dc-8708832639d9] received 2024-04-05T23:18:01.039385742Z [2024-04-05 23:18:01,038: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a4140e56-66c7-4aff-97e6-933c7486a142] received 2024-04-05T23:18:01.047425835Z [2024-04-05 23:18:01,047: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[38416bac-6585-474b-8229-c9eb4bfb354a] received 2024-04-05T23:18:01.047597782Z [2024-04-05 23:18:01,047: INFO/ForkPoolWorker-15] [fa662a7a-e6a6-4982-8e2b-af4d892ff50d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T23:18:01.056600100Z [2024-04-05 23:18:01,056: INFO/ForkPoolWorker-1] [a4140e56-66c7-4aff-97e6-933c7486a142] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T23:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T23:18:01.057236134Z [2024-04-05 23:18:01,056: INFO/ForkPoolWorker-16] [a7a7b199-ea87-4813-a2dc-8708832639d9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T23:18:01.065678065Z [2024-04-05 23:18:01,065: INFO/ForkPoolWorker-2] [38416bac-6585-474b-8229-c9eb4bfb354a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T23:18:01.411708730Z [2024-04-05 23:18:01,407: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T23:18:01.445045326Z [2024-04-05 23:18:01,440: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-05T23:18:01.500122963Z [2024-04-05 23:18:01,496: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-05T23:18:01.529158353Z [2024-04-05 23:18:01,525: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T23:18:01.687866036Z [2024-04-05 23:18:01,687: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-05T23:18:01.692686030Z [2024-04-05 23:18:01,692: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:18:01.710903413Z [2024-04-05 23:18:01,710: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:18:01.732334159Z [2024-04-05 23:18:01,731: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T23:18:01.736041411Z [2024-04-05 23:18:01,735: INFO/ForkPoolWorker-16] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-05T23:18:01.736177085Z [2024-04-05 23:18:01,736: INFO/ForkPoolWorker-16] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-05T23:18:01.736266619Z [2024-04-05 23:18:01,736: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-05T23:18:01.736532459Z [2024-04-05 23:18:01,736: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-05T23:18:01.905718549Z [2024-04-05 23:18:01,905: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:18:02.333352157Z [2024-04-05 23:18:02,332: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a4140e56-66c7-4aff-97e6-933c7486a142] succeeded in 1.2910810399998809s: None 2024-04-05T23:18:02.536669423Z [2024-04-05 23:18:02,536: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a7a7b199-ea87-4813-a2dc-8708832639d9] succeeded in 1.500961123000252s: None 2024-04-05T23:18:02.908760743Z [2024-04-05 23:18:02,908: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T23:18:02.912675316Z [2024-04-05 23:18:02,911: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:18:02.940269678Z [2024-04-05 23:18:02,940: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T23:18:02.941589994Z [2024-04-05 23:18:02,941: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:18:02.941737493Z [2024-04-05 23:18:02,941: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:18:02.941965602Z [2024-04-05 23:18:02,941: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:18:02.942091823Z [2024-04-05 23:18:02,941: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T23:18:02.942378100Z [2024-04-05 23:18:02,942: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T23:18:02.942901724Z [2024-04-05 23:18:02,942: INFO/ForkPoolWorker-15] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:18:03.069878569Z [2024-04-05 23:18:03,069: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:18:03.102302979Z [2024-04-05 23:18:03,101: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-05T23:18:03.106082429Z [2024-04-05 23:18:03,105: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:18:03.125072242Z [2024-04-05 23:18:03,124: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-05T23:18:03.126506794Z [2024-04-05 23:18:03,126: INFO/ForkPoolWorker-2] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:18:03.126536232Z [2024-04-05 23:18:03,126: INFO/ForkPoolWorker-2] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:18:03.126686840Z [2024-04-05 23:18:03,126: INFO/ForkPoolWorker-2] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:18:03.126804451Z [2024-04-05 23:18:03,126: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-05T23:18:03.127146632Z [2024-04-05 23:18:03,126: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-05T23:18:03.127297980Z [2024-04-05 23:18:03,127: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:18:03.208814215Z [2024-04-05 23:18:03,208: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:18:04.601214316Z [2024-04-05 23:18:04,600: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fa662a7a-e6a6-4982-8e2b-af4d892ff50d] succeeded in 3.567905612999766s: None 2024-04-05T23:18:05.182867152Z [2024-04-05 23:18:05,182: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[38416bac-6585-474b-8229-c9eb4bfb354a] succeeded in 4.130793454000013s: None 2024-04-05T23:19:00.912856863Z [2024-04-05 23:19:00,912: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4d3ac3c4-438a-4446-a467-49960271d2d1] received 2024-04-05T23:19:00.921121538Z [2024-04-05 23:19:00,920: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9182336c-a1f0-424f-bc27-6062a64d0856] received 2024-04-05T23:19:00.932896131Z [2024-04-05 23:19:00,932: INFO/ForkPoolWorker-15] [4d3ac3c4-438a-4446-a467-49960271d2d1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T23:19:00.933196864Z [2024-04-05 23:19:00,932: INFO/ForkPoolWorker-16] [9182336c-a1f0-424f-bc27-6062a64d0856] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T23:19:00.933945046Z [2024-04-05 23:19:00,933: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a1ae5c78-de91-4188-9209-b35084e1e433] received 2024-04-05T23:19:00.951198014Z [2024-04-05 23:19:00,950: INFO/ForkPoolWorker-1] [a1ae5c78-de91-4188-9209-b35084e1e433] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T23:19:01.241122782Z [2024-04-05 23:19:01,237: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T23:19:01.255222103Z [2024-04-05 23:19:01,251: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T23:19:01.331818219Z [2024-04-05 23:19:01,328: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-05T23:19:01.501041262Z [2024-04-05 23:19:01,500: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-05T23:19:01.505331262Z [2024-04-05 23:19:01,504: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:19:01.533166813Z [2024-04-05 23:19:01,532: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-05T23:19:01.534279670Z [2024-04-05 23:19:01,534: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-05T23:19:01.534463941Z [2024-04-05 23:19:01,534: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-05T23:19:01.534562373Z [2024-04-05 23:19:01,534: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-05T23:19:01.534836789Z [2024-04-05 23:19:01,534: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-05T23:19:01.659288916Z [2024-04-05 23:19:01,658: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:19:02.460084386Z [2024-04-05 23:19:02,459: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a1ae5c78-de91-4188-9209-b35084e1e433] succeeded in 1.522144365999793s: None 2024-04-05T23:19:02.632762851Z [2024-04-05 23:19:02,632: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T23:19:02.636388492Z [2024-04-05 23:19:02,635: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:19:02.658114799Z [2024-04-05 23:19:02,657: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T23:19:02.659833825Z [2024-04-05 23:19:02,659: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:19:02.660034506Z [2024-04-05 23:19:02,659: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:19:02.660227833Z [2024-04-05 23:19:02,660: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:19:02.660368339Z [2024-04-05 23:19:02,660: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T23:19:02.660726522Z [2024-04-05 23:19:02,660: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-05T23:19:02.660841115Z [2024-04-05 23:19:02,660: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:19:02.690955451Z [2024-04-05 23:19:02,690: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-05T23:19:02.694427358Z [2024-04-05 23:19:02,694: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:19:02.722280638Z [2024-04-05 23:19:02,722: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T23:19:02.724207255Z [2024-04-05 23:19:02,723: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:19:02.724417647Z [2024-04-05 23:19:02,724: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:19:02.724695953Z [2024-04-05 23:19:02,724: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:19:02.724899931Z [2024-04-05 23:19:02,724: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-05T23:19:02.725317387Z [2024-04-05 23:19:02,725: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T23:19:02.725731688Z [2024-04-05 23:19:02,725: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:19:02.755562597Z [2024-04-05 23:19:02,755: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:19:02.831120179Z [2024-04-05 23:19:02,830: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:19:04.696043707Z [2024-04-05 23:19:04,695: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9182336c-a1f0-424f-bc27-6062a64d0856] succeeded in 3.771867829000257s: None 2024-04-05T23:19:05.309202950Z [2024-04-05 23:19:05,308: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4d3ac3c4-438a-4446-a467-49960271d2d1] succeeded in 4.389347652000197s: None 2024-04-05T23:20:00.492532895Z [2024-04-05 23:20:00,492: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[21639cc2-5ed9-40b5-8cf4-5bb2e7b2ffd5] received 2024-04-05T23:20:00.497201995Z [2024-04-05 23:20:00,496: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[77572abe-bbe1-4126-b5d8-2b404c8641bd] received 2024-04-05T23:20:00.501086995Z [2024-04-05 23:20:00,500: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a6758bd2-553b-4954-a47e-bb619aec3799] received 2024-04-05T23:20:00.503315590Z [2024-04-05 23:20:00,503: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6685b410-b4d8-4180-8e6f-3074797c9372] received 2024-04-05T23:20:00.505132569Z [2024-04-05 23:20:00,504: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[af69fad1-6fa9-4e37-9a87-c59f393d9da5] received 2024-04-05T23:20:00.519990295Z [2024-04-05 23:20:00,517: INFO/ForkPoolWorker-1] [a6758bd2-553b-4954-a47e-bb619aec3799] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T23:20:00.525873243Z [2024-04-05 23:20:00,519: INFO/ForkPoolWorker-15] [21639cc2-5ed9-40b5-8cf4-5bb2e7b2ffd5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T23:20:00.534204977Z [2024-04-05 23:20:00,533: INFO/ForkPoolWorker-2] [6685b410-b4d8-4180-8e6f-3074797c9372] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T23:20:00.539557053Z [2024-04-05 23:20:00,539: INFO/ForkPoolWorker-16] [77572abe-bbe1-4126-b5d8-2b404c8641bd] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T23:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T23:20:00.546886340Z [2024-04-05 23:20:00,546: INFO/ForkPoolWorker-3] [af69fad1-6fa9-4e37-9a87-c59f393d9da5] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T23:20:00.852707571Z [2024-04-05 23:20:00,846: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-05T23:20:00.935697321Z [2024-04-05 23:20:00,931: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T23:20:00.990399496Z [2024-04-05 23:20:00,986: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T23:20:01.048383789Z [2024-04-05 23:20:01,047: INFO/ForkPoolWorker-3] Getting SDNC list 2024-04-05T23:20:01.052586132Z [2024-04-05 23:20:01,052: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:20:01.062903070Z [2024-04-05 23:20:01,057: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-05T23:20:01.064712922Z [2024-04-05 23:20:01,060: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T23:20:01.124993849Z [2024-04-05 23:20:01,124: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-05T23:20:01.128040660Z [2024-04-05 23:20:01,127: INFO/ForkPoolWorker-3] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-05T23:20:01.128191509Z [2024-04-05 23:20:01,128: INFO/ForkPoolWorker-3] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-05T23:20:01.128252622Z [2024-04-05 23:20:01,128: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-04-05T23:20:01.128482495Z [2024-04-05 23:20:01,128: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-05T23:20:01.304064847Z [2024-04-05 23:20:01,303: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:20:01.472894164Z [2024-04-05 23:20:01,472: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:20:02.044772458Z [2024-04-05 23:20:02,044: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[af69fad1-6fa9-4e37-9a87-c59f393d9da5] succeeded in 1.5324138360001598s: None 2024-04-05T23:20:02.117925797Z [2024-04-05 23:20:02,117: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[77572abe-bbe1-4126-b5d8-2b404c8641bd] succeeded in 1.61882965399991s: None 2024-04-05T23:20:02.701193447Z [2024-04-05 23:20:02,700: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-05T23:20:02.705367044Z [2024-04-05 23:20:02,704: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:20:02.746451787Z [2024-04-05 23:20:02,746: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-05T23:20:02.749402081Z [2024-04-05 23:20:02,749: INFO/ForkPoolWorker-2] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:20:02.749638808Z [2024-04-05 23:20:02,749: INFO/ForkPoolWorker-2] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:20:02.749863638Z [2024-04-05 23:20:02,749: INFO/ForkPoolWorker-2] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:20:02.750025103Z [2024-04-05 23:20:02,749: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-05T23:20:02.750384442Z [2024-04-05 23:20:02,750: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-05T23:20:02.751520244Z [2024-04-05 23:20:02,751: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:20:02.794525131Z [2024-04-05 23:20:02,794: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-05T23:20:02.802001041Z [2024-04-05 23:20:02,801: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:20:02.841139984Z [2024-04-05 23:20:02,840: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-05T23:20:02.843367948Z [2024-04-05 23:20:02,843: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:20:02.848260223Z [2024-04-05 23:20:02,847: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:20:02.849186476Z [2024-04-05 23:20:02,848: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:20:02.849335866Z [2024-04-05 23:20:02,849: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-05T23:20:02.849923904Z [2024-04-05 23:20:02,849: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T23:20:02.850058277Z [2024-04-05 23:20:02,849: INFO/ForkPoolWorker-1] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:20:02.871772714Z [2024-04-05 23:20:02,871: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:20:02.887881732Z [2024-04-05 23:20:02,887: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T23:20:02.891797588Z [2024-04-05 23:20:02,891: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:20:02.919182351Z [2024-04-05 23:20:02,918: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T23:20:02.923886031Z [2024-04-05 23:20:02,923: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:20:02.923907636Z [2024-04-05 23:20:02,923: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:20:02.924259884Z [2024-04-05 23:20:02,923: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:20:02.924527691Z [2024-04-05 23:20:02,924: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T23:20:02.925113172Z [2024-04-05 23:20:02,924: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T23:20:02.925124634Z [2024-04-05 23:20:02,925: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:20:02.980284728Z [2024-04-05 23:20:02,979: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:20:03.063455897Z [2024-04-05 23:20:03,062: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:20:03.866188648Z [2024-04-05 23:20:03,865: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[21639cc2-5ed9-40b5-8cf4-5bb2e7b2ffd5] succeeded in 3.3715376380000635s: None 2024-04-05T23:20:03.962896320Z [2024-04-05 23:20:03,962: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4fdab474-a319-43ce-b0a4-51da542cde6b] received 2024-04-05T23:20:03.978114663Z [2024-04-05 23:20:03,977: INFO/ForkPoolWorker-15] [4fdab474-a319-43ce-b0a4-51da542cde6b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'split_metrics', 'scheduled__2024-04-05T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T23:20:04.322641079Z [2024-04-05 23:20:04,318: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T23:20:04.691228505Z [2024-04-05 23:20:04,690: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a6758bd2-553b-4954-a47e-bb619aec3799] succeeded in 4.187077209000108s: None 2024-04-05T23:20:04.852466030Z [2024-04-05 23:20:04,851: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[6685b410-b4d8-4180-8e6f-3074797c9372] succeeded in 4.346852591000243s: None 2024-04-05T23:20:05.474200865Z [2024-04-05 23:20:05,473: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T23:20:05.477405971Z [2024-04-05 23:20:05,476: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:20:05.498916517Z [2024-04-05 23:20:05,498: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T23:20:05.502501254Z [2024-04-05 23:20:05,502: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:20:05.502542169Z [2024-04-05 23:20:05,502: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:20:05.502591985Z [2024-04-05 23:20:05,502: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:20:05.502610688Z [2024-04-05 23:20:05,502: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T23:20:05.502802592Z [2024-04-05 23:20:05,502: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T23:20:05.502859472Z [2024-04-05 23:20:05,502: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:20:05.605767952Z [2024-04-05 23:20:05,605: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:20:06.426148862Z [2024-04-05 23:20:06,424: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[08f88c7d-003b-497e-a1d9-18259388cfcf] received 2024-04-05T23:20:06.435019697Z [2024-04-05 23:20:06,434: INFO/ForkPoolWorker-16] [08f88c7d-003b-497e-a1d9-18259388cfcf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'collect_metrics', 'scheduled__2024-04-05T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T23:20:06.446469346Z [2024-04-05 23:20:06,446: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4fdab474-a319-43ce-b0a4-51da542cde6b] succeeded in 2.481839960000343s: None 2024-04-05T23:20:06.764671450Z [2024-04-05 23:20:06,761: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T23:20:07.881666651Z [2024-04-05 23:20:07,881: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-05T23:20:07.884985449Z [2024-04-05 23:20:07,884: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:20:07.907663252Z [2024-04-05 23:20:07,907: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T23:20:07.909134203Z [2024-04-05 23:20:07,908: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:20:07.909158822Z [2024-04-05 23:20:07,908: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:20:07.909208350Z [2024-04-05 23:20:07,909: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:20:07.909232900Z [2024-04-05 23:20:07,909: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-05T23:20:07.909684909Z [2024-04-05 23:20:07,909: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T23:20:07.909705452Z [2024-04-05 23:20:07,909: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:20:08.015408231Z [2024-04-05 23:20:08,014: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:20:08.652379667Z [2024-04-05 23:20:08,651: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[08f88c7d-003b-497e-a1d9-18259388cfcf] succeeded in 2.224719759999971s: None 2024-04-05T23:20:08.676132879Z [2024-04-05 23:20:08,675: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a1e87384-4cc2-4cbf-af5c-37142ee9b042] received 2024-04-05T23:20:08.690342681Z [2024-04-05 23:20:08,689: INFO/ForkPoolWorker-15] [a1e87384-4cc2-4cbf-af5c-37142ee9b042] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'send_prometheus', 'scheduled__2024-04-05T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T23:20:09.010489689Z [2024-04-05 23:20:09,007: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T23:20:10.173177881Z [2024-04-05 23:20:10,172: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T23:20:10.177608682Z [2024-04-05 23:20:10,177: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:20:10.202341060Z [2024-04-05 23:20:10,202: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T23:20:10.203905021Z [2024-04-05 23:20:10,203: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:20:10.204017132Z [2024-04-05 23:20:10,203: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:20:10.204238864Z [2024-04-05 23:20:10,203: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:20:10.204338896Z [2024-04-05 23:20:10,204: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T23:20:10.204642419Z [2024-04-05 23:20:10,204: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T23:20:10.204750285Z [2024-04-05 23:20:10,204: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:20:10.302725382Z [2024-04-05 23:20:10,302: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:20:10.971776962Z [2024-04-05 23:20:10,971: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a1e87384-4cc2-4cbf-af5c-37142ee9b042] succeeded in 2.292804164000245s: None 2024-04-05T23:21:00.604473457Z [2024-04-05 23:21:00,603: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[29f28196-05de-42b2-999a-4b175a38a4f1] received 2024-04-05T23:21:00.612237735Z [2024-04-05 23:21:00,611: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0b2f4d3f-cbd0-41a2-8899-49bb914d9898] received 2024-04-05T23:21:00.616627701Z [2024-04-05 23:21:00,616: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[67d67420-2516-4ee8-874e-91745482269c] received 2024-04-05T23:21:00.625174654Z [2024-04-05 23:21:00,624: INFO/ForkPoolWorker-15] [29f28196-05de-42b2-999a-4b175a38a4f1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T23:21:00.632218250Z [2024-04-05 23:21:00,631: INFO/ForkPoolWorker-1] [67d67420-2516-4ee8-874e-91745482269c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T23:21:00.633133098Z [2024-04-05 23:21:00,632: INFO/ForkPoolWorker-16] [0b2f4d3f-cbd0-41a2-8899-49bb914d9898] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T23:21:00.961766056Z [2024-04-05 23:21:00,957: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T23:21:00.966778620Z [2024-04-05 23:21:00,963: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T23:21:00.967157665Z [2024-04-05 23:21:00,963: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-05T23:21:01.153820943Z [2024-04-05 23:21:01,153: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-05T23:21:01.158024900Z [2024-04-05 23:21:01,157: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:21:01.186278522Z [2024-04-05 23:21:01,186: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T23:21:01.187885553Z [2024-04-05 23:21:01,187: INFO/ForkPoolWorker-16] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-05T23:21:01.188149892Z [2024-04-05 23:21:01,187: INFO/ForkPoolWorker-16] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-05T23:21:01.188288842Z [2024-04-05 23:21:01,188: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-05T23:21:01.188591279Z [2024-04-05 23:21:01,188: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-05T23:21:01.301092490Z [2024-04-05 23:21:01,300: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:21:01.973332897Z [2024-04-05 23:21:01,972: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0b2f4d3f-cbd0-41a2-8899-49bb914d9898] succeeded in 1.358743764999872s: None 2024-04-05T23:21:02.175876500Z [2024-04-05 23:21:02,175: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T23:21:02.179424470Z [2024-04-05 23:21:02,178: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:21:02.204506296Z [2024-04-05 23:21:02,204: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T23:21:02.206102908Z [2024-04-05 23:21:02,205: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:21:02.206205940Z [2024-04-05 23:21:02,206: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:21:02.206404218Z [2024-04-05 23:21:02,206: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:21:02.206495863Z [2024-04-05 23:21:02,206: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T23:21:02.206813458Z [2024-04-05 23:21:02,206: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T23:21:02.206924912Z [2024-04-05 23:21:02,206: INFO/ForkPoolWorker-15] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:21:02.297307904Z [2024-04-05 23:21:02,296: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-05T23:21:02.300722402Z [2024-04-05 23:21:02,300: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:21:02.312758612Z [2024-04-05 23:21:02,312: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:21:02.326861693Z [2024-04-05 23:21:02,326: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-05T23:21:02.328445081Z [2024-04-05 23:21:02,328: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:21:02.328660529Z [2024-04-05 23:21:02,328: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:21:02.328868309Z [2024-04-05 23:21:02,328: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:21:02.328902875Z [2024-04-05 23:21:02,328: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-05T23:21:02.329165531Z [2024-04-05 23:21:02,329: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-05T23:21:02.329296841Z [2024-04-05 23:21:02,329: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:21:02.436876351Z [2024-04-05 23:21:02,436: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:21:03.951040124Z [2024-04-05 23:21:03,950: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[29f28196-05de-42b2-999a-4b175a38a4f1] succeeded in 3.342429778999758s: None 2024-04-05T23:21:04.597663660Z [2024-04-05 23:21:04,597: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[67d67420-2516-4ee8-874e-91745482269c] succeeded in 3.9760164350000196s: None 2024-04-05T23:22:00.618588660Z [2024-04-05 23:22:00,618: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bb1ecdb9-5c5c-4e6c-b74d-3a00263365e5] received 2024-04-05T23:22:00.626876315Z [2024-04-05 23:22:00,626: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b919021e-4ba8-426f-82ac-ea3bc700a1b4] received 2024-04-05T23:22:00.636696394Z [2024-04-05 23:22:00,636: INFO/ForkPoolWorker-15] [bb1ecdb9-5c5c-4e6c-b74d-3a00263365e5] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T23:22:00.643352194Z [2024-04-05 23:22:00,642: INFO/ForkPoolWorker-16] [b919021e-4ba8-426f-82ac-ea3bc700a1b4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T23:22:00.645839245Z [2024-04-05 23:22:00,645: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dbaed63c-edd8-477c-9cd0-b3de125472ae] received 2024-04-05T23:22:00.649065678Z [2024-04-05 23:22:00,648: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[503b2125-eb5e-4f3d-a573-233754419663] received 2024-04-05T23:22:00.656595137Z [2024-04-05 23:22:00,656: INFO/ForkPoolWorker-1] [dbaed63c-edd8-477c-9cd0-b3de125472ae] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T23:22:00.678213232Z [2024-04-05 23:22:00,677: INFO/ForkPoolWorker-2] [503b2125-eb5e-4f3d-a573-233754419663] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T23:22:01.065006004Z [2024-04-05 23:22:01,060: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-05T23:22:01.290873553Z [2024-04-05 23:22:01,290: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-05T23:22:01.294937215Z [2024-04-05 23:22:01,294: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:22:01.302299749Z [2024-04-05 23:22:01,292: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T23:22:01.332139924Z [2024-04-05 23:22:01,331: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-05T23:22:01.338892423Z [2024-04-05 23:22:01,333: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-05T23:22:01.342984091Z [2024-04-05 23:22:01,342: INFO/ForkPoolWorker-2] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-05T23:22:01.343066681Z [2024-04-05 23:22:01,342: INFO/ForkPoolWorker-2] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-05T23:22:01.343136781Z [2024-04-05 23:22:01,343: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-05T23:22:01.344313946Z [2024-04-05 23:22:01,339: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T23:22:01.347116343Z [2024-04-05 23:22:01,343: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-05T23:22:01.603838348Z [2024-04-05 23:22:01,603: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:22:01.773686384Z [2024-04-05 23:22:01,773: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:22:02.712762660Z [2024-04-05 23:22:02,712: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[503b2125-eb5e-4f3d-a573-233754419663] succeeded in 2.056700919999912s: None 2024-04-05T23:22:02.767609286Z [2024-04-05 23:22:02,767: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bb1ecdb9-5c5c-4e6c-b74d-3a00263365e5] succeeded in 2.1427699740002026s: None 2024-04-05T23:22:02.866446454Z [2024-04-05 23:22:02,866: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-05T23:22:02.869998985Z [2024-04-05 23:22:02,869: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:22:02.894469139Z [2024-04-05 23:22:02,894: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-05T23:22:02.895931252Z [2024-04-05 23:22:02,895: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:22:02.896031694Z [2024-04-05 23:22:02,895: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:22:02.896226564Z [2024-04-05 23:22:02,896: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:22:02.896342513Z [2024-04-05 23:22:02,896: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-05T23:22:02.896641759Z [2024-04-05 23:22:02,896: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T23:22:02.896742778Z [2024-04-05 23:22:02,896: INFO/ForkPoolWorker-1] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:22:02.990553234Z [2024-04-05 23:22:02,990: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:22:03.164465664Z [2024-04-05 23:22:03,164: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-05T23:22:03.167907162Z [2024-04-05 23:22:03,167: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:22:03.189639775Z [2024-04-05 23:22:03,189: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T23:22:03.191008669Z [2024-04-05 23:22:03,190: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:22:03.191186100Z [2024-04-05 23:22:03,191: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:22:03.191461360Z [2024-04-05 23:22:03,191: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:22:03.191651390Z [2024-04-05 23:22:03,191: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-05T23:22:03.191975879Z [2024-04-05 23:22:03,191: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-05T23:22:03.192159495Z [2024-04-05 23:22:03,192: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:22:03.285035244Z [2024-04-05 23:22:03,284: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:22:04.615654593Z [2024-04-05 23:22:04,615: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[dbaed63c-edd8-477c-9cd0-b3de125472ae] succeeded in 3.9651901680003903s: None 2024-04-05T23:22:05.684038825Z [2024-04-05 23:22:05,683: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b919021e-4ba8-426f-82ac-ea3bc700a1b4] succeeded in 5.053956039000241s: None 2024-04-05T23:23:00.444472210Z [2024-04-05 23:23:00,443: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a6657975-bb2c-461b-86c5-4204d24bd275] received 2024-04-05T23:23:00.447015589Z [2024-04-05 23:23:00,446: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[586c1bf0-7e4a-42a8-a619-f1f90394eea1] received 2024-04-05T23:23:00.454027293Z [2024-04-05 23:23:00,453: INFO/ForkPoolWorker-15] [a6657975-bb2c-461b-86c5-4204d24bd275] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T23:23:00.456910012Z [2024-04-05 23:23:00,456: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4c939a36-b508-421f-a9d2-f7d5d0cadf10] received 2024-04-05T23:23:00.457553336Z [2024-04-05 23:23:00,457: INFO/ForkPoolWorker-16] [586c1bf0-7e4a-42a8-a619-f1f90394eea1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T23:23:00.471397484Z [2024-04-05 23:23:00,470: INFO/ForkPoolWorker-1] [4c939a36-b508-421f-a9d2-f7d5d0cadf10] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T23:23:00.743961019Z [2024-04-05 23:23:00,740: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T23:23:00.770917228Z [2024-04-05 23:23:00,767: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T23:23:00.822559271Z [2024-04-05 23:23:00,806: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-05T23:23:01.018990316Z [2024-04-05 23:23:01,018: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-05T23:23:01.023723363Z [2024-04-05 23:23:01,023: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:23:01.051617362Z [2024-04-05 23:23:01,051: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-05T23:23:01.053777277Z [2024-04-05 23:23:01,053: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-05T23:23:01.053921597Z [2024-04-05 23:23:01,053: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-05T23:23:01.054052468Z [2024-04-05 23:23:01,053: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-05T23:23:01.054717829Z [2024-04-05 23:23:01,054: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-05T23:23:01.159571683Z [2024-04-05 23:23:01,159: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:23:01.844887554Z [2024-04-05 23:23:01,844: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4c939a36-b508-421f-a9d2-f7d5d0cadf10] succeeded in 1.3856375230002413s: None 2024-04-05T23:23:02.129618333Z [2024-04-05 23:23:02,129: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-05T23:23:02.133158598Z [2024-04-05 23:23:02,132: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:23:02.162980828Z [2024-04-05 23:23:02,162: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T23:23:02.165069880Z [2024-04-05 23:23:02,164: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:23:02.165556927Z [2024-04-05 23:23:02,165: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:23:02.166019994Z [2024-04-05 23:23:02,165: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:23:02.166268377Z [2024-04-05 23:23:02,166: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-05T23:23:02.167129552Z [2024-04-05 23:23:02,166: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T23:23:02.167315297Z [2024-04-05 23:23:02,167: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:23:02.255319484Z [2024-04-05 23:23:02,254: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T23:23:02.258891646Z [2024-04-05 23:23:02,258: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:23:02.262173987Z [2024-04-05 23:23:02,261: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:23:02.296387896Z [2024-04-05 23:23:02,296: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T23:23:02.298666605Z [2024-04-05 23:23:02,298: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:23:02.298813939Z [2024-04-05 23:23:02,298: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:23:02.299122718Z [2024-04-05 23:23:02,298: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:23:02.299402834Z [2024-04-05 23:23:02,299: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T23:23:02.299908462Z [2024-04-05 23:23:02,299: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-05T23:23:02.300130549Z [2024-04-05 23:23:02,299: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:23:02.404911478Z [2024-04-05 23:23:02,404: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:23:03.976340887Z [2024-04-05 23:23:03,975: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[586c1bf0-7e4a-42a8-a619-f1f90394eea1] succeeded in 3.527485551999689s: None 2024-04-05T23:23:04.323982169Z [2024-04-05 23:23:04,323: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a6657975-bb2c-461b-86c5-4204d24bd275] succeeded in 3.877248249999866s: None 2024-04-05T23:24:00.924777899Z [2024-04-05 23:24:00,924: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e3d6e09f-6f46-452b-8544-1f077ffbb245] received 2024-04-05T23:24:00.940236587Z [2024-04-05 23:24:00,939: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4fd0cfcb-63ce-40aa-accf-772197041f56] received 2024-04-05T23:24:00.943861834Z [2024-04-05 23:24:00,943: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d55d2de8-9c94-4cd7-9c6f-60a7ffe7334b] received 2024-04-05T23:24:00.949792033Z [2024-04-05 23:24:00,949: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8cd5c42b-88e9-4778-adad-4a2e1e252e3a] received 2024-04-05T23:24:00.956621195Z [2024-04-05 23:24:00,956: INFO/ForkPoolWorker-15] [e3d6e09f-6f46-452b-8544-1f077ffbb245] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T23:24:00.962967735Z [2024-04-05 23:24:00,962: INFO/ForkPoolWorker-1] [d55d2de8-9c94-4cd7-9c6f-60a7ffe7334b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T23:24:00.965136610Z [2024-04-05 23:24:00,964: INFO/ForkPoolWorker-16] [4fd0cfcb-63ce-40aa-accf-772197041f56] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T23:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T23:24:00.970218443Z [2024-04-05 23:24:00,969: INFO/ForkPoolWorker-2] [8cd5c42b-88e9-4778-adad-4a2e1e252e3a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T23:24:01.269986926Z [2024-04-05 23:24:01,266: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-05T23:24:01.291041104Z [2024-04-05 23:24:01,286: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T23:24:01.443087862Z [2024-04-05 23:24:01,442: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-05T23:24:01.443575650Z [2024-04-05 23:24:01,439: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T23:24:01.446852903Z [2024-04-05 23:24:01,442: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-05T23:24:01.448766761Z [2024-04-05 23:24:01,448: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:24:01.494797007Z [2024-04-05 23:24:01,494: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-05T23:24:01.500258358Z [2024-04-05 23:24:01,499: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-05T23:24:01.500367522Z [2024-04-05 23:24:01,500: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-05T23:24:01.500476343Z [2024-04-05 23:24:01,500: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-05T23:24:01.500831740Z [2024-04-05 23:24:01,500: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-05T23:24:01.601432665Z [2024-04-05 23:24:01,601: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:24:01.746436213Z [2024-04-05 23:24:01,743: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:24:02.383301697Z [2024-04-05 23:24:02,382: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d55d2de8-9c94-4cd7-9c6f-60a7ffe7334b] succeeded in 1.4378925199998775s: None 2024-04-05T23:24:02.419652850Z [2024-04-05 23:24:02,419: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4fd0cfcb-63ce-40aa-accf-772197041f56] succeeded in 1.4706860839996807s: None 2024-04-05T23:24:02.896705313Z [2024-04-05 23:24:02,896: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T23:24:02.900853434Z [2024-04-05 23:24:02,900: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:24:02.932973213Z [2024-04-05 23:24:02,932: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T23:24:02.934820107Z [2024-04-05 23:24:02,934: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:24:02.935164706Z [2024-04-05 23:24:02,934: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:24:02.935562538Z [2024-04-05 23:24:02,935: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:24:02.935822010Z [2024-04-05 23:24:02,935: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T23:24:02.936204475Z [2024-04-05 23:24:02,936: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T23:24:02.936425957Z [2024-04-05 23:24:02,936: INFO/ForkPoolWorker-15] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:24:03.050473837Z [2024-04-05 23:24:03,049: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-05T23:24:03.053573881Z [2024-04-05 23:24:03,053: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:24:03.096994584Z [2024-04-05 23:24:03,096: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-05T23:24:03.100977001Z [2024-04-05 23:24:03,100: INFO/ForkPoolWorker-2] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:24:03.101001396Z [2024-04-05 23:24:03,100: INFO/ForkPoolWorker-2] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:24:03.101208367Z [2024-04-05 23:24:03,100: INFO/ForkPoolWorker-2] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:24:03.101312628Z [2024-04-05 23:24:03,101: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-05T23:24:03.102312355Z [2024-04-05 23:24:03,102: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-05T23:24:03.102323234Z [2024-04-05 23:24:03,102: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:24:03.104062398Z [2024-04-05 23:24:03,103: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:24:03.208005439Z [2024-04-05 23:24:03,207: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:24:05.033416376Z [2024-04-05 23:24:05,032: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[8cd5c42b-88e9-4778-adad-4a2e1e252e3a] succeeded in 4.080652244999783s: None 2024-04-05T23:24:05.384196983Z [2024-04-05 23:24:05,383: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e3d6e09f-6f46-452b-8544-1f077ffbb245] succeeded in 4.439005719999841s: None 2024-04-05T23:25:01.228116015Z [2024-04-05 23:25:01,227: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[49f9f486-fd56-47dc-be91-625d5fd98fa8] received 2024-04-05T23:25:01.230186695Z [2024-04-05 23:25:01,229: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4d1e4d66-5295-471d-9d67-6e325a643dda] received 2024-04-05T23:25:01.232620944Z [2024-04-05 23:25:01,232: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2ab92d3e-50db-4d3a-90fb-51a0030c7ea4] received 2024-04-05T23:25:01.234416702Z [2024-04-05 23:25:01,234: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[10ebc291-95bb-4252-a983-9857cc69a4c6] received 2024-04-05T23:25:01.244698609Z [2024-04-05 23:25:01,244: INFO/ForkPoolWorker-1] [2ab92d3e-50db-4d3a-90fb-51a0030c7ea4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T23:25:01.246026718Z [2024-04-05 23:25:01,245: INFO/ForkPoolWorker-15] [49f9f486-fd56-47dc-be91-625d5fd98fa8] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T23:25:01.247154701Z [2024-04-05 23:25:01,246: INFO/ForkPoolWorker-16] [4d1e4d66-5295-471d-9d67-6e325a643dda] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T23:25:01.247804665Z [2024-04-05 23:25:01,247: INFO/ForkPoolWorker-2] [10ebc291-95bb-4252-a983-9857cc69a4c6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T23:25:01.561813776Z [2024-04-05 23:25:01,558: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T23:25:01.565802124Z [2024-04-05 23:25:01,562: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T23:25:01.610010316Z [2024-04-05 23:25:01,606: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T23:25:01.702577259Z [2024-04-05 23:25:01,698: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-05T23:25:01.868611769Z [2024-04-05 23:25:01,868: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-05T23:25:01.872665597Z [2024-04-05 23:25:01,872: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:25:01.897351580Z [2024-04-05 23:25:01,897: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T23:25:01.899519025Z [2024-04-05 23:25:01,899: INFO/ForkPoolWorker-15] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-05T23:25:01.900194617Z [2024-04-05 23:25:01,899: INFO/ForkPoolWorker-15] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-05T23:25:01.900339705Z [2024-04-05 23:25:01,900: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-05T23:25:01.900647265Z [2024-04-05 23:25:01,900: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-05T23:25:02.027787883Z [2024-04-05 23:25:02,027: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:25:02.732315856Z [2024-04-05 23:25:02,731: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[49f9f486-fd56-47dc-be91-625d5fd98fa8] succeeded in 1.5015342879996751s: None 2024-04-05T23:25:02.999665882Z [2024-04-05 23:25:02,999: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-05T23:25:03.003205515Z [2024-04-05 23:25:03,002: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:25:03.024123337Z [2024-04-05 23:25:03,023: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-05T23:25:03.028200305Z [2024-04-05 23:25:03,027: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:25:03.040762704Z [2024-04-05 23:25:03,040: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-05T23:25:03.042198516Z [2024-04-05 23:25:03,041: INFO/ForkPoolWorker-2] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:25:03.042212665Z [2024-04-05 23:25:03,042: INFO/ForkPoolWorker-2] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:25:03.042356335Z [2024-04-05 23:25:03,042: INFO/ForkPoolWorker-2] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:25:03.042374978Z [2024-04-05 23:25:03,042: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-05T23:25:03.042758862Z [2024-04-05 23:25:03,042: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-05T23:25:03.042793450Z [2024-04-05 23:25:03,042: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:25:03.056521543Z [2024-04-05 23:25:03,056: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T23:25:03.059166264Z [2024-04-05 23:25:03,058: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:25:03.059294044Z [2024-04-05 23:25:03,059: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:25:03.059558506Z [2024-04-05 23:25:03,059: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:25:03.059712892Z [2024-04-05 23:25:03,059: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-05T23:25:03.060062487Z [2024-04-05 23:25:03,059: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T23:25:03.060340374Z [2024-04-05 23:25:03,060: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:25:03.076373752Z [2024-04-05 23:25:03,075: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-05T23:25:03.081341989Z [2024-04-05 23:25:03,080: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:25:03.118084432Z [2024-04-05 23:25:03,117: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-05T23:25:03.120018591Z [2024-04-05 23:25:03,119: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:25:03.120042333Z [2024-04-05 23:25:03,119: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:25:03.120222085Z [2024-04-05 23:25:03,119: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:25:03.120270353Z [2024-04-05 23:25:03,120: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-05T23:25:03.121440531Z [2024-04-05 23:25:03,121: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T23:25:03.121752566Z [2024-04-05 23:25:03,121: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:25:03.139459559Z [2024-04-05 23:25:03,139: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:25:03.163185463Z [2024-04-05 23:25:03,161: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:25:03.212644927Z [2024-04-05 23:25:03,212: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:25:03.998778450Z [2024-04-05 23:25:03,998: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2ab92d3e-50db-4d3a-90fb-51a0030c7ea4] succeeded in 2.7639205389996278s: None 2024-04-05T23:25:04.099554611Z [2024-04-05 23:25:04,096: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[44917ad7-d5e4-4383-8fcd-4e27c931fde3] received 2024-04-05T23:25:04.128153791Z [2024-04-05 23:25:04,127: INFO/ForkPoolWorker-15] [44917ad7-d5e4-4383-8fcd-4e27c931fde3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'split_metrics', 'scheduled__2024-04-05T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T23:25:04.488940830Z [2024-04-05 23:25:04,485: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T23:25:04.864223980Z [2024-04-05 23:25:04,863: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4d1e4d66-5295-471d-9d67-6e325a643dda] succeeded in 3.6290867089996937s: None 2024-04-05T23:25:05.197164393Z [2024-04-05 23:25:05,196: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[10ebc291-95bb-4252-a983-9857cc69a4c6] succeeded in 3.9605374960001427s: None 2024-04-05T23:25:05.688909061Z [2024-04-05 23:25:05,688: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T23:25:05.691950411Z [2024-04-05 23:25:05,691: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:25:05.713117540Z [2024-04-05 23:25:05,712: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T23:25:05.715536668Z [2024-04-05 23:25:05,714: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:25:05.715564874Z [2024-04-05 23:25:05,714: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:25:05.715577711Z [2024-04-05 23:25:05,714: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:25:05.715590042Z [2024-04-05 23:25:05,714: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T23:25:05.715599744Z [2024-04-05 23:25:05,714: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T23:25:05.715644687Z [2024-04-05 23:25:05,714: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:25:05.804605268Z [2024-04-05 23:25:05,804: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:25:06.570012292Z [2024-04-05 23:25:06,569: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[44917ad7-d5e4-4383-8fcd-4e27c931fde3] succeeded in 2.470878860999619s: None 2024-04-05T23:25:07.227561180Z [2024-04-05 23:25:07,227: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[30a647ce-c52a-440b-b842-fea2789e7258] received 2024-04-05T23:25:07.235863479Z [2024-04-05 23:25:07,235: INFO/ForkPoolWorker-15] [30a647ce-c52a-440b-b842-fea2789e7258] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'collect_metrics', 'scheduled__2024-04-05T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T23:25:07.511558916Z [2024-04-05 23:25:07,506: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T23:25:08.618995723Z [2024-04-05 23:25:08,618: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T23:25:08.622673573Z [2024-04-05 23:25:08,622: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:25:08.645486133Z [2024-04-05 23:25:08,645: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T23:25:08.647077803Z [2024-04-05 23:25:08,646: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:25:08.647171750Z [2024-04-05 23:25:08,647: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:25:08.647355015Z [2024-04-05 23:25:08,647: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:25:08.647454996Z [2024-04-05 23:25:08,647: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T23:25:08.647777998Z [2024-04-05 23:25:08,647: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T23:25:08.647847192Z [2024-04-05 23:25:08,647: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:25:08.744643876Z [2024-04-05 23:25:08,744: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:25:09.442513732Z [2024-04-05 23:25:09,442: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[30a647ce-c52a-440b-b842-fea2789e7258] succeeded in 2.2131325850000394s: None 2024-04-05T23:25:10.313583503Z [2024-04-05 23:25:10,313: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[da8320b0-c9b9-43ee-93fa-c25a80393b06] received 2024-04-05T23:25:10.324097807Z [2024-04-05 23:25:10,323: INFO/ForkPoolWorker-15] [da8320b0-c9b9-43ee-93fa-c25a80393b06] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'send_prometheus', 'scheduled__2024-04-05T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T23:25:10.626311608Z [2024-04-05 23:25:10,622: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T23:25:11.781555225Z [2024-04-05 23:25:11,781: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T23:25:11.784901022Z [2024-04-05 23:25:11,784: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:25:11.829294299Z [2024-04-05 23:25:11,828: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T23:25:11.831028686Z [2024-04-05 23:25:11,830: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:25:11.831210263Z [2024-04-05 23:25:11,831: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:25:11.831510778Z [2024-04-05 23:25:11,831: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:25:11.831548473Z [2024-04-05 23:25:11,831: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T23:25:11.831840859Z [2024-04-05 23:25:11,831: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T23:25:11.831859129Z [2024-04-05 23:25:11,831: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:25:11.914479592Z [2024-04-05 23:25:11,914: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:25:12.625528972Z [2024-04-05 23:25:12,625: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[da8320b0-c9b9-43ee-93fa-c25a80393b06] succeeded in 2.30948866000017s: None 2024-04-05T23:26:01.320052304Z [2024-04-05 23:26:01,319: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b5982494-453b-44fc-958d-043f3d8d5a57] received 2024-04-05T23:26:01.326805772Z [2024-04-05 23:26:01,326: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ba92f7f5-092b-4937-bc6e-bae870cc644a] received 2024-04-05T23:26:01.331720483Z [2024-04-05 23:26:01,331: INFO/ForkPoolWorker-15] [b5982494-453b-44fc-958d-043f3d8d5a57] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T23:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T23:26:01.343631619Z [2024-04-05 23:26:01,343: INFO/ForkPoolWorker-16] [ba92f7f5-092b-4937-bc6e-bae870cc644a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T23:26:01.345637934Z [2024-04-05 23:26:01,345: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7528d227-a2dd-4406-825d-4523107ccc7e] received 2024-04-05T23:26:01.370081068Z [2024-04-05 23:26:01,369: INFO/ForkPoolWorker-1] [7528d227-a2dd-4406-825d-4523107ccc7e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T23:26:01.376682441Z [2024-04-05 23:26:01,376: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[394aaa0a-f17e-4446-bda4-bac8451c95bd] received 2024-04-05T23:26:01.396270278Z [2024-04-05 23:26:01,394: INFO/ForkPoolWorker-2] [394aaa0a-f17e-4446-bda4-bac8451c95bd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T23:26:01.698228155Z [2024-04-05 23:26:01,694: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-05T23:26:01.736683492Z [2024-04-05 23:26:01,732: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T23:26:01.800864636Z [2024-04-05 23:26:01,792: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-05T23:26:01.972915495Z [2024-04-05 23:26:01,958: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T23:26:02.032950325Z [2024-04-05 23:26:02,032: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:26:02.103194594Z [2024-04-05 23:26:02,102: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-05T23:26:02.108881786Z [2024-04-05 23:26:02,107: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:26:02.149752664Z [2024-04-05 23:26:02,149: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T23:26:02.150894619Z [2024-04-05 23:26:02,150: INFO/ForkPoolWorker-16] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-05T23:26:02.150942065Z [2024-04-05 23:26:02,150: INFO/ForkPoolWorker-16] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-05T23:26:02.151004428Z [2024-04-05 23:26:02,150: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-05T23:26:02.151215893Z [2024-04-05 23:26:02,151: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-05T23:26:02.270736317Z [2024-04-05 23:26:02,270: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:26:02.590179870Z [2024-04-05 23:26:02,589: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b5982494-453b-44fc-958d-043f3d8d5a57] succeeded in 1.2656020630001876s: None 2024-04-05T23:26:02.878084043Z [2024-04-05 23:26:02,877: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ba92f7f5-092b-4937-bc6e-bae870cc644a] succeeded in 1.5475139590002982s: None 2024-04-05T23:26:03.144114787Z [2024-04-05 23:26:03,143: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-05T23:26:03.147998487Z [2024-04-05 23:26:03,147: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:26:03.175413689Z [2024-04-05 23:26:03,175: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-05T23:26:03.176899300Z [2024-04-05 23:26:03,176: INFO/ForkPoolWorker-2] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:26:03.177037116Z [2024-04-05 23:26:03,176: INFO/ForkPoolWorker-2] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:26:03.177275645Z [2024-04-05 23:26:03,177: INFO/ForkPoolWorker-2] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:26:03.177387518Z [2024-04-05 23:26:03,177: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-05T23:26:03.177724069Z [2024-04-05 23:26:03,177: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T23:26:03.177896257Z [2024-04-05 23:26:03,177: INFO/ForkPoolWorker-2] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:26:03.273107986Z [2024-04-05 23:26:03,272: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:26:03.357755041Z [2024-04-05 23:26:03,357: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-05T23:26:03.361118642Z [2024-04-05 23:26:03,360: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:26:03.386738101Z [2024-04-05 23:26:03,386: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-05T23:26:03.388343315Z [2024-04-05 23:26:03,388: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:26:03.388463169Z [2024-04-05 23:26:03,388: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:26:03.388646437Z [2024-04-05 23:26:03,388: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:26:03.388754315Z [2024-04-05 23:26:03,388: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-05T23:26:03.389172518Z [2024-04-05 23:26:03,388: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-05T23:26:03.389871008Z [2024-04-05 23:26:03,389: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:26:03.488502508Z [2024-04-05 23:26:03,488: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:26:05.079019745Z [2024-04-05 23:26:05,078: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[394aaa0a-f17e-4446-bda4-bac8451c95bd] succeeded in 3.698088648999601s: None 2024-04-05T23:26:05.770437358Z [2024-04-05 23:26:05,769: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7528d227-a2dd-4406-825d-4523107ccc7e] succeeded in 4.422042035999766s: None 2024-04-05T23:27:01.264512909Z [2024-04-05 23:27:01,264: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c80e91fa-9b3c-4401-b8d5-9930b534dc25] received 2024-04-05T23:27:01.268880690Z [2024-04-05 23:27:01,268: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[691f392e-6f49-42aa-a930-ee71c010f797] received 2024-04-05T23:27:01.277995462Z [2024-04-05 23:27:01,277: INFO/ForkPoolWorker-15] [c80e91fa-9b3c-4401-b8d5-9930b534dc25] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T23:27:01.285101786Z [2024-04-05 23:27:01,284: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b00838aa-6616-4c72-ab3f-de9a66541941] received 2024-04-05T23:27:01.289698498Z [2024-04-05 23:27:01,289: INFO/ForkPoolWorker-16] [691f392e-6f49-42aa-a930-ee71c010f797] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T23:27:01.293614794Z [2024-04-05 23:27:01,293: INFO/ForkPoolWorker-1] [b00838aa-6616-4c72-ab3f-de9a66541941] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T23:27:01.579766515Z [2024-04-05 23:27:01,575: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T23:27:01.596007864Z [2024-04-05 23:27:01,591: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T23:27:01.627125455Z [2024-04-05 23:27:01,623: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-05T23:27:01.799032805Z [2024-04-05 23:27:01,798: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-05T23:27:01.803101049Z [2024-04-05 23:27:01,802: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:27:01.844117820Z [2024-04-05 23:27:01,843: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-05T23:27:01.846152155Z [2024-04-05 23:27:01,845: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-05T23:27:01.846249047Z [2024-04-05 23:27:01,846: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-05T23:27:01.846337195Z [2024-04-05 23:27:01,846: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-05T23:27:01.847035103Z [2024-04-05 23:27:01,846: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-05T23:27:01.978535360Z [2024-04-05 23:27:01,978: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:27:02.796433186Z [2024-04-05 23:27:02,795: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b00838aa-6616-4c72-ab3f-de9a66541941] succeeded in 1.5084679760002473s: None 2024-04-05T23:27:02.977408683Z [2024-04-05 23:27:02,976: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-05T23:27:02.981093016Z [2024-04-05 23:27:02,980: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:27:03.005058844Z [2024-04-05 23:27:03,004: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T23:27:03.006509531Z [2024-04-05 23:27:03,006: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:27:03.006579765Z [2024-04-05 23:27:03,006: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:27:03.006816572Z [2024-04-05 23:27:03,006: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:27:03.006909863Z [2024-04-05 23:27:03,006: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-05T23:27:03.007587954Z [2024-04-05 23:27:03,007: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T23:27:03.007825177Z [2024-04-05 23:27:03,007: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:27:03.014326215Z [2024-04-05 23:27:03,013: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T23:27:03.018564433Z [2024-04-05 23:27:03,018: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:27:03.036775782Z [2024-04-05 23:27:03,036: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T23:27:03.037833485Z [2024-04-05 23:27:03,037: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:27:03.037967569Z [2024-04-05 23:27:03,037: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:27:03.038170835Z [2024-04-05 23:27:03,037: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:27:03.038283843Z [2024-04-05 23:27:03,038: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T23:27:03.038578433Z [2024-04-05 23:27:03,038: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-05T23:27:03.038688396Z [2024-04-05 23:27:03,038: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:27:03.110490025Z [2024-04-05 23:27:03,110: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:27:03.121726112Z [2024-04-05 23:27:03,121: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:27:04.638173171Z [2024-04-05 23:27:04,636: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[691f392e-6f49-42aa-a930-ee71c010f797] succeeded in 3.3657359870003347s: None 2024-04-05T23:27:04.984986039Z [2024-04-05 23:27:04,984: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c80e91fa-9b3c-4401-b8d5-9930b534dc25] succeeded in 3.7176208010000664s: None 2024-04-05T23:28:01.080364167Z [2024-04-05 23:28:01,079: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7f8d1cfa-b80e-40be-9d53-fb03275668af] received 2024-04-05T23:28:01.082080245Z [2024-04-05 23:28:01,081: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bf6fd50e-622c-4fbe-995e-27885bc85fc8] received 2024-04-05T23:28:01.087710514Z [2024-04-05 23:28:01,087: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3029bfa7-4a3a-4757-8554-eb2d760b0ece] received 2024-04-05T23:28:01.093204009Z [2024-04-05 23:28:01,092: INFO/ForkPoolWorker-16] [bf6fd50e-622c-4fbe-995e-27885bc85fc8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T23:28:01.094984853Z [2024-04-05 23:28:01,094: INFO/ForkPoolWorker-15] [7f8d1cfa-b80e-40be-9d53-fb03275668af] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T23:28:01.108209759Z [2024-04-05 23:28:01,107: INFO/ForkPoolWorker-1] [3029bfa7-4a3a-4757-8554-eb2d760b0ece] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T23:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T23:28:01.116107931Z [2024-04-05 23:28:01,115: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1db0d05b-4dad-4a22-91fb-c12c19b05e56] received 2024-04-05T23:28:01.130416950Z [2024-04-05 23:28:01,130: INFO/ForkPoolWorker-2] [1db0d05b-4dad-4a22-91fb-c12c19b05e56] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T23:28:01.492255368Z [2024-04-05 23:28:01,484: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T23:28:01.493011666Z [2024-04-05 23:28:01,489: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T23:28:01.500875504Z [2024-04-05 23:28:01,496: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-05T23:28:01.737135330Z [2024-04-05 23:28:01,729: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-05T23:28:01.853761124Z [2024-04-05 23:28:01,853: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-05T23:28:01.857873255Z [2024-04-05 23:28:01,857: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:28:01.926742955Z [2024-04-05 23:28:01,926: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-05T23:28:01.932426958Z [2024-04-05 23:28:01,932: INFO/ForkPoolWorker-2] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-05T23:28:01.932525174Z [2024-04-05 23:28:01,932: INFO/ForkPoolWorker-2] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-05T23:28:01.932613365Z [2024-04-05 23:28:01,932: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-05T23:28:01.933206691Z [2024-04-05 23:28:01,933: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-05T23:28:02.074454291Z [2024-04-05 23:28:02,074: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:28:02.102644736Z [2024-04-05 23:28:02,102: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:28:02.896375301Z [2024-04-05 23:28:02,895: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[1db0d05b-4dad-4a22-91fb-c12c19b05e56] succeeded in 1.7780599580000853s: None 2024-04-05T23:28:02.904565227Z [2024-04-05 23:28:02,904: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-05T23:28:02.910971006Z [2024-04-05 23:28:02,910: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:28:02.949295991Z [2024-04-05 23:28:02,949: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T23:28:02.950908136Z [2024-04-05 23:28:02,950: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:28:02.951206160Z [2024-04-05 23:28:02,951: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:28:02.951632501Z [2024-04-05 23:28:02,951: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:28:02.951820610Z [2024-04-05 23:28:02,951: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-05T23:28:02.952639044Z [2024-04-05 23:28:02,952: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-05T23:28:02.952839195Z [2024-04-05 23:28:02,952: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:28:03.026416291Z [2024-04-05 23:28:03,025: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3029bfa7-4a3a-4757-8554-eb2d760b0ece] succeeded in 1.9354570169998624s: None 2024-04-05T23:28:03.080034150Z [2024-04-05 23:28:03,079: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:28:03.401205587Z [2024-04-05 23:28:03,400: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T23:28:03.405172962Z [2024-04-05 23:28:03,404: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:28:03.438074411Z [2024-04-05 23:28:03,435: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T23:28:03.440305397Z [2024-04-05 23:28:03,439: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:28:03.440420374Z [2024-04-05 23:28:03,440: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:28:03.440684142Z [2024-04-05 23:28:03,440: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:28:03.440785254Z [2024-04-05 23:28:03,440: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T23:28:03.441154205Z [2024-04-05 23:28:03,440: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T23:28:03.441263578Z [2024-04-05 23:28:03,441: INFO/ForkPoolWorker-15] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:28:03.543695591Z [2024-04-05 23:28:03,543: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:28:05.718313783Z [2024-04-05 23:28:05,717: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7f8d1cfa-b80e-40be-9d53-fb03275668af] succeeded in 4.635916913000074s: None 2024-04-05T23:28:05.849228352Z [2024-04-05 23:28:05,848: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[bf6fd50e-622c-4fbe-995e-27885bc85fc8] succeeded in 4.765067551999891s: None 2024-04-05T23:29:00.290255648Z [2024-04-05 23:29:00,289: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a7f55bba-d3f5-4a65-b5fa-87800fd43711] received 2024-04-05T23:29:00.294184271Z [2024-04-05 23:29:00,293: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0e217c42-7653-486e-b0b8-98b6763d5c4d] received 2024-04-05T23:29:00.299261943Z [2024-04-05 23:29:00,299: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[77f4b5e1-d18f-4d4b-866f-da553477285b] received 2024-04-05T23:29:00.303612596Z [2024-04-05 23:29:00,303: INFO/ForkPoolWorker-16] [0e217c42-7653-486e-b0b8-98b6763d5c4d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T23:29:00.304126954Z [2024-04-05 23:29:00,303: INFO/ForkPoolWorker-15] [a7f55bba-d3f5-4a65-b5fa-87800fd43711] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T23:29:00.318050703Z [2024-04-05 23:29:00,317: INFO/ForkPoolWorker-1] [77f4b5e1-d18f-4d4b-866f-da553477285b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T23:29:00.604930112Z [2024-04-05 23:29:00,601: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-05T23:29:00.633216174Z [2024-04-05 23:29:00,626: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T23:29:00.678298900Z [2024-04-05 23:29:00,674: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T23:29:00.771862276Z [2024-04-05 23:29:00,771: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-05T23:29:00.775971276Z [2024-04-05 23:29:00,775: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:29:00.805477168Z [2024-04-05 23:29:00,805: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T23:29:00.807165191Z [2024-04-05 23:29:00,806: INFO/ForkPoolWorker-15] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-05T23:29:00.807465213Z [2024-04-05 23:29:00,807: INFO/ForkPoolWorker-15] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-05T23:29:00.807526155Z [2024-04-05 23:29:00,807: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-05T23:29:00.807677238Z [2024-04-05 23:29:00,807: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-05T23:29:00.904929654Z [2024-04-05 23:29:00,904: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:29:01.486528805Z [2024-04-05 23:29:01,485: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a7f55bba-d3f5-4a65-b5fa-87800fd43711] succeeded in 1.1919644939998761s: None 2024-04-05T23:29:01.977139438Z [2024-04-05 23:29:01,976: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-05T23:29:01.980503922Z [2024-04-05 23:29:01,980: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:29:02.008940718Z [2024-04-05 23:29:02,008: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-05T23:29:02.010785557Z [2024-04-05 23:29:02,010: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:29:02.010864193Z [2024-04-05 23:29:02,010: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:29:02.011057326Z [2024-04-05 23:29:02,010: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:29:02.011123310Z [2024-04-05 23:29:02,011: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-05T23:29:02.011537625Z [2024-04-05 23:29:02,011: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T23:29:02.011666003Z [2024-04-05 23:29:02,011: INFO/ForkPoolWorker-1] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:29:02.022004539Z [2024-04-05 23:29:02,021: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-05T23:29:02.026770932Z [2024-04-05 23:29:02,026: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:29:02.054226524Z [2024-04-05 23:29:02,053: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T23:29:02.056031943Z [2024-04-05 23:29:02,055: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:29:02.056166343Z [2024-04-05 23:29:02,055: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:29:02.056368589Z [2024-04-05 23:29:02,056: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:29:02.056494888Z [2024-04-05 23:29:02,056: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-05T23:29:02.057136625Z [2024-04-05 23:29:02,056: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-05T23:29:02.057290860Z [2024-04-05 23:29:02,057: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:29:02.109520601Z [2024-04-05 23:29:02,109: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:29:02.156472712Z [2024-04-05 23:29:02,156: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:29:03.652855543Z [2024-04-05 23:29:03,652: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[77f4b5e1-d18f-4d4b-866f-da553477285b] succeeded in 3.351075999999921s: None 2024-04-05T23:29:04.135565874Z [2024-04-05 23:29:04,134: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0e217c42-7653-486e-b0b8-98b6763d5c4d] succeeded in 3.8384378529999594s: None 2024-04-05T23:30:00.786137210Z [2024-04-05 23:30:00,785: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9cac06d5-d306-4b27-adb1-877d923dea18] received 2024-04-05T23:30:00.788167381Z [2024-04-05 23:30:00,787: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9d8ae262-1667-4e45-a8e3-8ab36190b972] received 2024-04-05T23:30:00.790235590Z [2024-04-05 23:30:00,790: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[701c43a1-19df-4bd1-91ad-644e584eed25] received 2024-04-05T23:30:00.798496831Z [2024-04-05 23:30:00,798: INFO/ForkPoolWorker-15] [9cac06d5-d306-4b27-adb1-877d923dea18] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T23:30:00.798672244Z [2024-04-05 23:30:00,798: INFO/ForkPoolWorker-1] [701c43a1-19df-4bd1-91ad-644e584eed25] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T23:30:00.811667303Z [2024-04-05 23:30:00,811: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[177b7e18-e1a4-4fa4-9762-933f609f1a2b] received 2024-04-05T23:30:00.812569805Z [2024-04-05 23:30:00,812: INFO/ForkPoolWorker-16] [9d8ae262-1667-4e45-a8e3-8ab36190b972] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T23:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T23:30:00.813951052Z [2024-04-05 23:30:00,813: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5996469b-6a4e-4582-a44b-3a8c995465eb] received 2024-04-05T23:30:00.829428378Z [2024-04-05 23:30:00,829: INFO/ForkPoolWorker-2] [177b7e18-e1a4-4fa4-9762-933f609f1a2b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T23:30:00.837221557Z [2024-04-05 23:30:00,836: INFO/ForkPoolWorker-3] [5996469b-6a4e-4582-a44b-3a8c995465eb] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T23:30:01.169769097Z [2024-04-05 23:30:01,164: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T23:30:01.273242975Z [2024-04-05 23:30:01,269: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T23:30:01.328471861Z [2024-04-05 23:30:01,315: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-05T23:30:01.538985587Z [2024-04-05 23:30:01,523: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T23:30:01.645623975Z [2024-04-05 23:30:01,639: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-05T23:30:01.822496868Z [2024-04-05 23:30:01,822: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:30:02.066847858Z [2024-04-05 23:30:02,066: INFO/ForkPoolWorker-3] Getting SDNC list 2024-04-05T23:30:02.072048684Z [2024-04-05 23:30:02,071: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:30:02.097133589Z [2024-04-05 23:30:02,096: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-05T23:30:02.098496033Z [2024-04-05 23:30:02,098: INFO/ForkPoolWorker-3] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-05T23:30:02.098706778Z [2024-04-05 23:30:02,098: INFO/ForkPoolWorker-3] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-05T23:30:02.098861453Z [2024-04-05 23:30:02,098: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-04-05T23:30:02.099142404Z [2024-04-05 23:30:02,099: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-05T23:30:02.304349716Z [2024-04-05 23:30:02,304: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:30:02.523019219Z [2024-04-05 23:30:02,520: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9d8ae262-1667-4e45-a8e3-8ab36190b972] succeeded in 1.7290886600003432s: None 2024-04-05T23:30:02.977888348Z [2024-04-05 23:30:02,977: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[5996469b-6a4e-4582-a44b-3a8c995465eb] succeeded in 2.160707659999389s: None 2024-04-05T23:30:02.987554480Z [2024-04-05 23:30:02,987: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T23:30:02.991458180Z [2024-04-05 23:30:02,990: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:30:03.037025411Z [2024-04-05 23:30:03,036: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T23:30:03.039077610Z [2024-04-05 23:30:03,038: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:30:03.039192321Z [2024-04-05 23:30:03,039: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:30:03.039390225Z [2024-04-05 23:30:03,039: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:30:03.039572714Z [2024-04-05 23:30:03,039: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T23:30:03.039921858Z [2024-04-05 23:30:03,039: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T23:30:03.040296072Z [2024-04-05 23:30:03,040: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:30:03.129159009Z [2024-04-05 23:30:03,128: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:30:03.151028916Z [2024-04-05 23:30:03,150: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-05T23:30:03.154473259Z [2024-04-05 23:30:03,154: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:30:03.198526479Z [2024-04-05 23:30:03,198: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-05T23:30:03.204969935Z [2024-04-05 23:30:03,204: INFO/ForkPoolWorker-2] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:30:03.205009184Z [2024-04-05 23:30:03,204: INFO/ForkPoolWorker-2] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:30:03.205018625Z [2024-04-05 23:30:03,204: INFO/ForkPoolWorker-2] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:30:03.205026783Z [2024-04-05 23:30:03,204: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-05T23:30:03.205359715Z [2024-04-05 23:30:03,205: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T23:30:03.205380005Z [2024-04-05 23:30:03,205: INFO/ForkPoolWorker-2] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:30:03.301808125Z [2024-04-05 23:30:03,301: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:30:03.558585980Z [2024-04-05 23:30:03,558: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-05T23:30:03.561860563Z [2024-04-05 23:30:03,561: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:30:03.583294949Z [2024-04-05 23:30:03,583: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-05T23:30:03.584653727Z [2024-04-05 23:30:03,584: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:30:03.584693696Z [2024-04-05 23:30:03,584: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:30:03.584867644Z [2024-04-05 23:30:03,584: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:30:03.584910578Z [2024-04-05 23:30:03,584: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-05T23:30:03.585805211Z [2024-04-05 23:30:03,585: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-05T23:30:03.585853242Z [2024-04-05 23:30:03,585: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:30:03.688742364Z [2024-04-05 23:30:03,688: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:30:03.842468631Z [2024-04-05 23:30:03,842: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9cac06d5-d306-4b27-adb1-877d923dea18] succeeded in 3.0539029649999065s: None 2024-04-05T23:30:04.764491189Z [2024-04-05 23:30:04,764: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3dd46fc0-0ddb-45a4-b0fa-16ed49d7a98b] received 2024-04-05T23:30:04.773240943Z [2024-04-05 23:30:04,772: INFO/ForkPoolWorker-15] [3dd46fc0-0ddb-45a4-b0fa-16ed49d7a98b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'split_metrics', 'scheduled__2024-04-05T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T23:30:05.033667778Z [2024-04-05 23:30:05,032: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[177b7e18-e1a4-4fa4-9762-933f609f1a2b] succeeded in 4.218564091999724s: None 2024-04-05T23:30:05.099563025Z [2024-04-05 23:30:05,096: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T23:30:05.499697570Z [2024-04-05 23:30:05,498: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[701c43a1-19df-4bd1-91ad-644e584eed25] succeeded in 4.70706161399994s: None 2024-04-05T23:30:06.242009273Z [2024-04-05 23:30:06,241: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T23:30:06.245226727Z [2024-04-05 23:30:06,244: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:30:06.279336813Z [2024-04-05 23:30:06,279: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T23:30:06.280545507Z [2024-04-05 23:30:06,280: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:30:06.280606286Z [2024-04-05 23:30:06,280: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:30:06.280810510Z [2024-04-05 23:30:06,280: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:30:06.280833441Z [2024-04-05 23:30:06,280: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T23:30:06.281070454Z [2024-04-05 23:30:06,280: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T23:30:06.281074528Z [2024-04-05 23:30:06,281: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:30:06.355887395Z [2024-04-05 23:30:06,355: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:30:06.967615120Z [2024-04-05 23:30:06,967: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3dd46fc0-0ddb-45a4-b0fa-16ed49d7a98b] succeeded in 2.199904263999997s: None 2024-04-05T23:30:07.256147697Z [2024-04-05 23:30:07,255: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d0447491-fb0c-430a-b75f-a63221f3f22a] received 2024-04-05T23:30:07.273592367Z [2024-04-05 23:30:07,273: INFO/ForkPoolWorker-15] [d0447491-fb0c-430a-b75f-a63221f3f22a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'collect_metrics', 'scheduled__2024-04-05T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T23:30:07.550707575Z [2024-04-05 23:30:07,547: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T23:30:08.700410360Z [2024-04-05 23:30:08,700: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T23:30:08.704017878Z [2024-04-05 23:30:08,703: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:30:08.730118836Z [2024-04-05 23:30:08,729: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T23:30:08.731593184Z [2024-04-05 23:30:08,731: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:30:08.731690252Z [2024-04-05 23:30:08,731: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:30:08.731856647Z [2024-04-05 23:30:08,731: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:30:08.731906507Z [2024-04-05 23:30:08,731: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T23:30:08.732193821Z [2024-04-05 23:30:08,732: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T23:30:08.732259910Z [2024-04-05 23:30:08,732: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:30:08.841416802Z [2024-04-05 23:30:08,841: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:30:09.446880739Z [2024-04-05 23:30:09,446: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d0447491-fb0c-430a-b75f-a63221f3f22a] succeeded in 2.1882456410003215s: None 2024-04-05T23:30:09.857197784Z [2024-04-05 23:30:09,856: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f6a09198-4b7c-4a32-a6a3-fd56f121f639] received 2024-04-05T23:30:09.873758119Z [2024-04-05 23:30:09,873: INFO/ForkPoolWorker-15] [f6a09198-4b7c-4a32-a6a3-fd56f121f639] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'send_prometheus', 'scheduled__2024-04-05T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T23:30:10.224389795Z [2024-04-05 23:30:10,221: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T23:30:11.362380515Z [2024-04-05 23:30:11,361: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T23:30:11.365909459Z [2024-04-05 23:30:11,365: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:30:11.390472495Z [2024-04-05 23:30:11,390: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T23:30:11.392251044Z [2024-04-05 23:30:11,391: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:30:11.392277827Z [2024-04-05 23:30:11,392: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:30:11.392608045Z [2024-04-05 23:30:11,392: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:30:11.392622424Z [2024-04-05 23:30:11,392: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T23:30:11.393202088Z [2024-04-05 23:30:11,392: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T23:30:11.393299069Z [2024-04-05 23:30:11,392: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:30:11.497109001Z [2024-04-05 23:30:11,496: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:30:12.055028242Z [2024-04-05 23:30:12,054: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f6a09198-4b7c-4a32-a6a3-fd56f121f639] succeeded in 2.1944654110002375s: None 2024-04-05T23:31:00.763311875Z [2024-04-05 23:31:00,762: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[688a88d4-73f3-4e13-b129-979537324541] received 2024-04-05T23:31:00.773889253Z [2024-04-05 23:31:00,773: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cc508f30-39d9-4366-8c0d-5bd8aea36454] received 2024-04-05T23:31:00.783894990Z [2024-04-05 23:31:00,783: INFO/ForkPoolWorker-15] [688a88d4-73f3-4e13-b129-979537324541] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T23:31:00.787808714Z [2024-04-05 23:31:00,787: INFO/ForkPoolWorker-16] [cc508f30-39d9-4366-8c0d-5bd8aea36454] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T23:31:00.789962002Z [2024-04-05 23:31:00,789: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9219592e-0318-4f49-ad8e-c0739500b97b] received 2024-04-05T23:31:00.801667774Z [2024-04-05 23:31:00,801: INFO/ForkPoolWorker-1] [9219592e-0318-4f49-ad8e-c0739500b97b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T23:31:01.078520240Z [2024-04-05 23:31:01,074: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T23:31:01.144509986Z [2024-04-05 23:31:01,125: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-05T23:31:01.169023880Z [2024-04-05 23:31:01,165: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T23:31:01.367652248Z [2024-04-05 23:31:01,367: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-05T23:31:01.372854396Z [2024-04-05 23:31:01,372: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:31:01.431610458Z [2024-04-05 23:31:01,431: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-05T23:31:01.433866771Z [2024-04-05 23:31:01,433: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-05T23:31:01.434265964Z [2024-04-05 23:31:01,433: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-05T23:31:01.434577211Z [2024-04-05 23:31:01,434: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-05T23:31:01.435116212Z [2024-04-05 23:31:01,434: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-05T23:31:01.538563952Z [2024-04-05 23:31:01,538: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:31:02.235111359Z [2024-04-05 23:31:02,234: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9219592e-0318-4f49-ad8e-c0739500b97b] succeeded in 1.4425096459999622s: None 2024-04-05T23:31:02.412346447Z [2024-04-05 23:31:02,411: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T23:31:02.415745623Z [2024-04-05 23:31:02,415: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:31:02.441919991Z [2024-04-05 23:31:02,441: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T23:31:02.444455959Z [2024-04-05 23:31:02,444: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:31:02.444628025Z [2024-04-05 23:31:02,444: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:31:02.444898089Z [2024-04-05 23:31:02,444: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:31:02.445088540Z [2024-04-05 23:31:02,444: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T23:31:02.445466683Z [2024-04-05 23:31:02,445: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T23:31:02.445622762Z [2024-04-05 23:31:02,445: INFO/ForkPoolWorker-15] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:31:02.511193839Z [2024-04-05 23:31:02,510: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-05T23:31:02.514611005Z [2024-04-05 23:31:02,514: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:31:02.536743483Z [2024-04-05 23:31:02,536: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:31:02.538486602Z [2024-04-05 23:31:02,538: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T23:31:02.540209716Z [2024-04-05 23:31:02,539: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:31:02.540347270Z [2024-04-05 23:31:02,540: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:31:02.540579383Z [2024-04-05 23:31:02,540: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:31:02.540736384Z [2024-04-05 23:31:02,540: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-05T23:31:02.541140617Z [2024-04-05 23:31:02,540: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-05T23:31:02.541264073Z [2024-04-05 23:31:02,541: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:31:02.626645582Z [2024-04-05 23:31:02,626: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:31:04.220790330Z [2024-04-05 23:31:04,220: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[688a88d4-73f3-4e13-b129-979537324541] succeeded in 3.4549707039996065s: None 2024-04-05T23:31:05.169269102Z [2024-04-05 23:31:05,168: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[cc508f30-39d9-4366-8c0d-5bd8aea36454] succeeded in 4.3920469329996195s: None 2024-04-05T23:32:00.597190364Z [2024-04-05 23:32:00,596: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[09e44cd8-4667-4bee-a6d9-b614554d2ab3] received 2024-04-05T23:32:00.605431885Z [2024-04-05 23:32:00,605: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6fde8657-2333-4c2c-b153-9074c9e23df1] received 2024-04-05T23:32:00.609118556Z [2024-04-05 23:32:00,608: INFO/ForkPoolWorker-15] [09e44cd8-4667-4bee-a6d9-b614554d2ab3] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T23:32:00.613743120Z [2024-04-05 23:32:00,613: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[91762a19-c3fb-4edc-ab1e-c598eb53f69c] received 2024-04-05T23:32:00.618450026Z [2024-04-05 23:32:00,618: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[38be84e5-62f5-4275-8127-5e68b2000b35] received 2024-04-05T23:32:00.619338750Z [2024-04-05 23:32:00,618: INFO/ForkPoolWorker-16] [6fde8657-2333-4c2c-b153-9074c9e23df1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T23:32:00.622340640Z [2024-04-05 23:32:00,622: INFO/ForkPoolWorker-1] [91762a19-c3fb-4edc-ab1e-c598eb53f69c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T23:32:00.637396777Z [2024-04-05 23:32:00,636: INFO/ForkPoolWorker-2] [38be84e5-62f5-4275-8127-5e68b2000b35] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T23:32:00.968408091Z [2024-04-05 23:32:00,963: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T23:32:00.969513316Z [2024-04-05 23:32:00,964: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T23:32:00.997280829Z [2024-04-05 23:32:00,992: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-05T23:32:01.040987702Z [2024-04-05 23:32:01,033: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-05T23:32:01.168310793Z [2024-04-05 23:32:01,167: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-05T23:32:01.172487758Z [2024-04-05 23:32:01,172: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:32:01.228668918Z [2024-04-05 23:32:01,228: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-05T23:32:01.236485813Z [2024-04-05 23:32:01,236: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-05T23:32:01.236856701Z [2024-04-05 23:32:01,236: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-05T23:32:01.236940352Z [2024-04-05 23:32:01,236: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-05T23:32:01.237304951Z [2024-04-05 23:32:01,237: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-05T23:32:01.343490524Z [2024-04-05 23:32:01,343: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:32:01.366640431Z [2024-04-05 23:32:01,366: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:32:02.123909600Z [2024-04-05 23:32:02,123: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[09e44cd8-4667-4bee-a6d9-b614554d2ab3] succeeded in 1.5239091909998024s: None 2024-04-05T23:32:02.125021001Z [2024-04-05 23:32:02,124: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[91762a19-c3fb-4edc-ab1e-c598eb53f69c] succeeded in 1.5091840340001s: None 2024-04-05T23:32:02.443681082Z [2024-04-05 23:32:02,443: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-05T23:32:02.447149538Z [2024-04-05 23:32:02,446: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:32:02.478261573Z [2024-04-05 23:32:02,477: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T23:32:02.479996500Z [2024-04-05 23:32:02,479: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:32:02.480138268Z [2024-04-05 23:32:02,480: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:32:02.480313946Z [2024-04-05 23:32:02,480: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:32:02.480420524Z [2024-04-05 23:32:02,480: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-05T23:32:02.480725333Z [2024-04-05 23:32:02,480: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T23:32:02.480832073Z [2024-04-05 23:32:02,480: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:32:02.564244254Z [2024-04-05 23:32:02,563: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:32:02.756223107Z [2024-04-05 23:32:02,755: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-05T23:32:02.759077393Z [2024-04-05 23:32:02,758: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:32:02.783122801Z [2024-04-05 23:32:02,781: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-05T23:32:02.783135314Z [2024-04-05 23:32:02,782: INFO/ForkPoolWorker-2] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:32:02.783193842Z [2024-04-05 23:32:02,783: INFO/ForkPoolWorker-2] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:32:02.787155207Z [2024-04-05 23:32:02,783: INFO/ForkPoolWorker-2] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:32:02.787180830Z [2024-04-05 23:32:02,783: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-05T23:32:02.787186136Z [2024-04-05 23:32:02,783: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-05T23:32:02.787190839Z [2024-04-05 23:32:02,783: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:32:02.869085907Z [2024-04-05 23:32:02,868: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:32:04.089758765Z [2024-04-05 23:32:04,089: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6fde8657-2333-4c2c-b153-9074c9e23df1] succeeded in 3.4808628800001316s: None 2024-04-05T23:32:04.809429402Z [2024-04-05 23:32:04,808: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[38be84e5-62f5-4275-8127-5e68b2000b35] succeeded in 4.183715066999866s: None 2024-04-05T23:33:00.320948059Z [2024-04-05 23:33:00,320: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3b177b49-1f39-4657-bc03-208ad6202596] received 2024-04-05T23:33:00.326468067Z [2024-04-05 23:33:00,326: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[466217ea-8c1f-49ba-b2d4-91c879a8f494] received 2024-04-05T23:33:00.328110487Z [2024-04-05 23:33:00,327: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[43d165ea-819b-4384-801d-352ffc3548e1] received 2024-04-05T23:33:00.341423470Z [2024-04-05 23:33:00,341: INFO/ForkPoolWorker-15] [3b177b49-1f39-4657-bc03-208ad6202596] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T23:33:00.348175178Z [2024-04-05 23:33:00,347: INFO/ForkPoolWorker-16] [466217ea-8c1f-49ba-b2d4-91c879a8f494] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T23:33:00.348850920Z [2024-04-05 23:33:00,348: INFO/ForkPoolWorker-1] [43d165ea-819b-4384-801d-352ffc3548e1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T23:33:00.626882550Z [2024-04-05 23:33:00,622: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T23:33:00.628488462Z [2024-04-05 23:33:00,624: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T23:33:00.650481750Z [2024-04-05 23:33:00,646: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-05T23:33:00.802057583Z [2024-04-05 23:33:00,801: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-05T23:33:00.805806742Z [2024-04-05 23:33:00,805: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:33:00.836221694Z [2024-04-05 23:33:00,835: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T23:33:00.840095265Z [2024-04-05 23:33:00,839: INFO/ForkPoolWorker-15] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-05T23:33:00.840255160Z [2024-04-05 23:33:00,840: INFO/ForkPoolWorker-15] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-05T23:33:00.840377509Z [2024-04-05 23:33:00,840: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-05T23:33:00.840621810Z [2024-04-05 23:33:00,840: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-05T23:33:00.950031261Z [2024-04-05 23:33:00,949: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:33:01.611876309Z [2024-04-05 23:33:01,611: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3b177b49-1f39-4657-bc03-208ad6202596] succeeded in 1.289016348999212s: None 2024-04-05T23:33:01.919345649Z [2024-04-05 23:33:01,918: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-05T23:33:01.922540074Z [2024-04-05 23:33:01,921: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:33:01.936259923Z [2024-04-05 23:33:01,935: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-05T23:33:01.939654283Z [2024-04-05 23:33:01,939: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:33:01.954254306Z [2024-04-05 23:33:01,953: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-05T23:33:01.955864482Z [2024-04-05 23:33:01,955: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:33:01.956039111Z [2024-04-05 23:33:01,955: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:33:01.956277712Z [2024-04-05 23:33:01,955: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:33:01.956382917Z [2024-04-05 23:33:01,956: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-05T23:33:01.956697009Z [2024-04-05 23:33:01,956: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-05T23:33:01.956935828Z [2024-04-05 23:33:01,956: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:33:01.974071799Z [2024-04-05 23:33:01,973: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T23:33:01.975974517Z [2024-04-05 23:33:01,975: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:33:01.976031925Z [2024-04-05 23:33:01,975: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:33:01.976233998Z [2024-04-05 23:33:01,976: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:33:01.976296209Z [2024-04-05 23:33:01,976: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-05T23:33:01.976635465Z [2024-04-05 23:33:01,976: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T23:33:01.976704888Z [2024-04-05 23:33:01,976: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:33:02.058699055Z [2024-04-05 23:33:02,058: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:33:02.066914313Z [2024-04-05 23:33:02,066: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:33:03.720536206Z [2024-04-05 23:33:03,719: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[466217ea-8c1f-49ba-b2d4-91c879a8f494] succeeded in 3.392291817000114s: None 2024-04-05T23:33:04.936560668Z [2024-04-05 23:33:04,935: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[43d165ea-819b-4384-801d-352ffc3548e1] succeeded in 4.602021318999505s: None 2024-04-05T23:34:00.577763823Z [2024-04-05 23:34:00,577: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[05afd209-61a3-4e7a-bc0b-02c8f8d9248b] received 2024-04-05T23:34:00.595316168Z [2024-04-05 23:34:00,594: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a6253632-2634-47ef-9764-aa61932919a7] received 2024-04-05T23:34:00.604427724Z [2024-04-05 23:34:00,604: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fe92b1d5-1ab2-48e2-b781-eaf06a217984] received 2024-04-05T23:34:00.615239377Z [2024-04-05 23:34:00,614: INFO/ForkPoolWorker-15] [05afd209-61a3-4e7a-bc0b-02c8f8d9248b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T23:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T23:34:00.615848181Z [2024-04-05 23:34:00,615: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5e192c21-2f5e-42a4-8f0d-00a6ec564ed2] received 2024-04-05T23:34:00.616718020Z [2024-04-05 23:34:00,616: INFO/ForkPoolWorker-1] [fe92b1d5-1ab2-48e2-b781-eaf06a217984] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T23:34:00.620572228Z [2024-04-05 23:34:00,620: INFO/ForkPoolWorker-16] [a6253632-2634-47ef-9764-aa61932919a7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T23:34:00.631543901Z [2024-04-05 23:34:00,631: INFO/ForkPoolWorker-2] [5e192c21-2f5e-42a4-8f0d-00a6ec564ed2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T23:34:00.985463228Z [2024-04-05 23:34:00,981: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-05T23:34:00.985933695Z [2024-04-05 23:34:00,981: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T23:34:01.128835670Z [2024-04-05 23:34:01,124: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-05T23:34:01.138506789Z [2024-04-05 23:34:01,121: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T23:34:01.269960911Z [2024-04-05 23:34:01,269: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:34:01.303097261Z [2024-04-05 23:34:01,302: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-05T23:34:01.307294879Z [2024-04-05 23:34:01,306: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:34:01.330238708Z [2024-04-05 23:34:01,329: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-05T23:34:01.331939402Z [2024-04-05 23:34:01,331: INFO/ForkPoolWorker-2] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-05T23:34:01.331981242Z [2024-04-05 23:34:01,331: INFO/ForkPoolWorker-2] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-05T23:34:01.332022973Z [2024-04-05 23:34:01,331: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-05T23:34:01.332373454Z [2024-04-05 23:34:01,332: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-05T23:34:01.441620304Z [2024-04-05 23:34:01,441: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:34:01.913880757Z [2024-04-05 23:34:01,913: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[05afd209-61a3-4e7a-bc0b-02c8f8d9248b] succeeded in 1.3179909889995542s: None 2024-04-05T23:34:02.148555804Z [2024-04-05 23:34:02,148: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[5e192c21-2f5e-42a4-8f0d-00a6ec564ed2] succeeded in 1.5273226159997648s: None 2024-04-05T23:34:02.345564789Z [2024-04-05 23:34:02,345: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-05T23:34:02.349136554Z [2024-04-05 23:34:02,348: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:34:02.372487805Z [2024-04-05 23:34:02,372: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T23:34:02.374050317Z [2024-04-05 23:34:02,373: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:34:02.374065286Z [2024-04-05 23:34:02,373: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:34:02.374357941Z [2024-04-05 23:34:02,374: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:34:02.374576528Z [2024-04-05 23:34:02,374: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-05T23:34:02.374866337Z [2024-04-05 23:34:02,374: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-05T23:34:02.374986756Z [2024-04-05 23:34:02,374: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:34:02.495065980Z [2024-04-05 23:34:02,494: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:34:02.724581901Z [2024-04-05 23:34:02,724: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-05T23:34:02.728478413Z [2024-04-05 23:34:02,727: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:34:02.761237127Z [2024-04-05 23:34:02,760: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-05T23:34:02.763584100Z [2024-04-05 23:34:02,763: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:34:02.763968482Z [2024-04-05 23:34:02,763: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:34:02.766324197Z [2024-04-05 23:34:02,766: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:34:02.766436534Z [2024-04-05 23:34:02,766: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-05T23:34:02.766821316Z [2024-04-05 23:34:02,766: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T23:34:02.766986684Z [2024-04-05 23:34:02,766: INFO/ForkPoolWorker-1] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:34:02.858018593Z [2024-04-05 23:34:02,857: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:34:04.469588870Z [2024-04-05 23:34:04,469: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a6253632-2634-47ef-9764-aa61932919a7] succeeded in 3.869261576000099s: None 2024-04-05T23:34:04.479209706Z [2024-04-05 23:34:04,478: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[fe92b1d5-1ab2-48e2-b781-eaf06a217984] succeeded in 3.87229638000008s: None 2024-04-05T23:35:00.862068891Z [2024-04-05 23:35:00,861: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7bfee179-d380-49e5-87e2-d2d6b883a03a] received 2024-04-05T23:35:00.864708880Z [2024-04-05 23:35:00,864: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c1c5ca2e-8a18-44cc-a0a3-5d92d1cdce69] received 2024-04-05T23:35:00.866436564Z [2024-04-05 23:35:00,866: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d490c3be-ac65-4830-9a87-3b230451e16f] received 2024-04-05T23:35:00.870930582Z [2024-04-05 23:35:00,870: INFO/ForkPoolWorker-15] [7bfee179-d380-49e5-87e2-d2d6b883a03a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T23:35:00.871683246Z [2024-04-05 23:35:00,871: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[27320816-53a0-44bc-9536-746e27b178fb] received 2024-04-05T23:35:00.882102110Z [2024-04-05 23:35:00,881: INFO/ForkPoolWorker-1] [d490c3be-ac65-4830-9a87-3b230451e16f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T23:35:00.883918749Z [2024-04-05 23:35:00,883: INFO/ForkPoolWorker-2] [27320816-53a0-44bc-9536-746e27b178fb] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T23:35:00.889162688Z [2024-04-05 23:35:00,888: INFO/ForkPoolWorker-16] [c1c5ca2e-8a18-44cc-a0a3-5d92d1cdce69] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T23:35:01.235284202Z [2024-04-05 23:35:01,231: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-05T23:35:01.245972965Z [2024-04-05 23:35:01,237: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T23:35:01.293168452Z [2024-04-05 23:35:01,289: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T23:35:01.343842362Z [2024-04-05 23:35:01,340: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T23:35:01.450192875Z [2024-04-05 23:35:01,449: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-05T23:35:01.454555295Z [2024-04-05 23:35:01,454: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:35:01.496489413Z [2024-04-05 23:35:01,496: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-05T23:35:01.500348347Z [2024-04-05 23:35:01,500: INFO/ForkPoolWorker-2] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-05T23:35:01.500588712Z [2024-04-05 23:35:01,500: INFO/ForkPoolWorker-2] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-05T23:35:01.500835882Z [2024-04-05 23:35:01,500: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-05T23:35:01.501276788Z [2024-04-05 23:35:01,501: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-05T23:35:01.620994389Z [2024-04-05 23:35:01,620: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:35:02.286118906Z [2024-04-05 23:35:02,285: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[27320816-53a0-44bc-9536-746e27b178fb] succeeded in 1.4115772539998943s: None 2024-04-05T23:35:02.632634502Z [2024-04-05 23:35:02,632: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T23:35:02.636115477Z [2024-04-05 23:35:02,635: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:35:02.649030229Z [2024-04-05 23:35:02,648: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-05T23:35:02.654184600Z [2024-04-05 23:35:02,653: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:35:02.660298208Z [2024-04-05 23:35:02,660: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T23:35:02.664650470Z [2024-04-05 23:35:02,664: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:35:02.664980280Z [2024-04-05 23:35:02,664: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:35:02.665819071Z [2024-04-05 23:35:02,665: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:35:02.666139780Z [2024-04-05 23:35:02,665: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T23:35:02.667032582Z [2024-04-05 23:35:02,666: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T23:35:02.667902975Z [2024-04-05 23:35:02,667: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:35:02.679056317Z [2024-04-05 23:35:02,678: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-05T23:35:02.680441495Z [2024-04-05 23:35:02,680: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:35:02.680562686Z [2024-04-05 23:35:02,680: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:35:02.680720275Z [2024-04-05 23:35:02,680: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:35:02.681102904Z [2024-04-05 23:35:02,680: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-05T23:35:02.681652873Z [2024-04-05 23:35:02,681: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-05T23:35:02.682026712Z [2024-04-05 23:35:02,681: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:35:02.777422905Z [2024-04-05 23:35:02,777: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:35:02.780259548Z [2024-04-05 23:35:02,779: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-05T23:35:02.780850649Z [2024-04-05 23:35:02,780: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:35:02.783966764Z [2024-04-05 23:35:02,783: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:35:02.812153128Z [2024-04-05 23:35:02,811: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T23:35:02.813399996Z [2024-04-05 23:35:02,813: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:35:02.813464076Z [2024-04-05 23:35:02,813: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:35:02.813665928Z [2024-04-05 23:35:02,813: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:35:02.813711439Z [2024-04-05 23:35:02,813: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-05T23:35:02.813964829Z [2024-04-05 23:35:02,813: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T23:35:02.814032068Z [2024-04-05 23:35:02,813: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:35:02.918639349Z [2024-04-05 23:35:02,918: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:35:03.455395745Z [2024-04-05 23:35:03,454: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7bfee179-d380-49e5-87e2-d2d6b883a03a] succeeded in 2.591403390999403s: None 2024-04-05T23:35:03.578389628Z [2024-04-05 23:35:03,577: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ad27f707-4e48-4f21-897a-4cc7c9084358] received 2024-04-05T23:35:03.590187519Z [2024-04-05 23:35:03,589: INFO/ForkPoolWorker-15] [ad27f707-4e48-4f21-897a-4cc7c9084358] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'split_metrics', 'scheduled__2024-04-05T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T23:35:03.913438076Z [2024-04-05 23:35:03,909: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T23:35:04.581518223Z [2024-04-05 23:35:04,580: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c1c5ca2e-8a18-44cc-a0a3-5d92d1cdce69] succeeded in 3.7132492470000216s: None 2024-04-05T23:35:04.806228443Z [2024-04-05 23:35:04,805: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d490c3be-ac65-4830-9a87-3b230451e16f] succeeded in 3.9366985779997776s: None 2024-04-05T23:35:05.234808840Z [2024-04-05 23:35:05,234: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T23:35:05.238308496Z [2024-04-05 23:35:05,237: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:35:05.269049941Z [2024-04-05 23:35:05,268: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T23:35:05.270444340Z [2024-04-05 23:35:05,270: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:35:05.270570801Z [2024-04-05 23:35:05,270: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:35:05.270804435Z [2024-04-05 23:35:05,270: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:35:05.270944231Z [2024-04-05 23:35:05,270: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T23:35:05.271623528Z [2024-04-05 23:35:05,271: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T23:35:05.271715748Z [2024-04-05 23:35:05,271: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:35:05.363048552Z [2024-04-05 23:35:05,362: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:35:06.118871574Z [2024-04-05 23:35:06,118: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ad27f707-4e48-4f21-897a-4cc7c9084358] succeeded in 2.537493003000236s: None 2024-04-05T23:35:06.383298610Z [2024-04-05 23:35:06,382: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0b504bb8-357c-4f0d-bda8-bd9775f78867] received 2024-04-05T23:35:06.392059627Z [2024-04-05 23:35:06,391: INFO/ForkPoolWorker-15] [0b504bb8-357c-4f0d-bda8-bd9775f78867] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'collect_metrics', 'scheduled__2024-04-05T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T23:35:06.695999143Z [2024-04-05 23:35:06,692: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T23:35:07.825610436Z [2024-04-05 23:35:07,825: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T23:35:07.828832288Z [2024-04-05 23:35:07,828: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:35:07.853147521Z [2024-04-05 23:35:07,852: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T23:35:07.854554088Z [2024-04-05 23:35:07,854: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:35:07.854574447Z [2024-04-05 23:35:07,854: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:35:07.854781574Z [2024-04-05 23:35:07,854: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:35:07.854847344Z [2024-04-05 23:35:07,854: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T23:35:07.855166851Z [2024-04-05 23:35:07,855: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T23:35:07.855231034Z [2024-04-05 23:35:07,855: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:35:07.933573831Z [2024-04-05 23:35:07,933: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:35:08.559970531Z [2024-04-05 23:35:08,559: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0b504bb8-357c-4f0d-bda8-bd9775f78867] succeeded in 2.1744370739997976s: None 2024-04-05T23:35:08.761041620Z [2024-04-05 23:35:08,760: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1312abae-b916-4cdc-bb67-2daec4e976e1] received 2024-04-05T23:35:08.773742218Z [2024-04-05 23:35:08,773: INFO/ForkPoolWorker-15] [1312abae-b916-4cdc-bb67-2daec4e976e1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'send_prometheus', 'scheduled__2024-04-05T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T23:35:09.095927395Z [2024-04-05 23:35:09,092: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T23:35:10.359987104Z [2024-04-05 23:35:10,359: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T23:35:10.363148190Z [2024-04-05 23:35:10,362: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:35:10.386255511Z [2024-04-05 23:35:10,385: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T23:35:10.388344094Z [2024-04-05 23:35:10,388: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:35:10.388474874Z [2024-04-05 23:35:10,388: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:35:10.388762192Z [2024-04-05 23:35:10,388: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:35:10.388919350Z [2024-04-05 23:35:10,388: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T23:35:10.389285303Z [2024-04-05 23:35:10,389: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T23:35:10.389471777Z [2024-04-05 23:35:10,389: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:35:10.502250636Z [2024-04-05 23:35:10,501: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:35:11.206199356Z [2024-04-05 23:35:11,205: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1312abae-b916-4cdc-bb67-2daec4e976e1] succeeded in 2.441041523000422s: None 2024-04-05T23:36:01.225787387Z [2024-04-05 23:36:01,224: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[54ffa67c-0076-45d2-b5a2-45949dff8669] received 2024-04-05T23:36:01.229806341Z [2024-04-05 23:36:01,229: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5de04015-6ecc-4edc-b952-b2ddb09fa8ef] received 2024-04-05T23:36:01.234301127Z [2024-04-05 23:36:01,233: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[737f37bf-3cbe-4d10-be48-3b5280d5eb3d] received 2024-04-05T23:36:01.238919470Z [2024-04-05 23:36:01,238: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7492a7b9-09da-44bd-bf1e-f91d2690ebc2] received 2024-04-05T23:36:01.251100480Z [2024-04-05 23:36:01,250: INFO/ForkPoolWorker-15] [54ffa67c-0076-45d2-b5a2-45949dff8669] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T23:36:01.266416388Z [2024-04-05 23:36:01,266: INFO/ForkPoolWorker-16] [5de04015-6ecc-4edc-b952-b2ddb09fa8ef] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T23:36:01.281953648Z [2024-04-05 23:36:01,281: INFO/ForkPoolWorker-2] [7492a7b9-09da-44bd-bf1e-f91d2690ebc2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T23:36:01.288895922Z [2024-04-05 23:36:01,288: INFO/ForkPoolWorker-1] [737f37bf-3cbe-4d10-be48-3b5280d5eb3d] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T23:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T23:36:01.578204948Z [2024-04-05 23:36:01,574: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-05T23:36:01.590269955Z [2024-04-05 23:36:01,586: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T23:36:01.609485238Z [2024-04-05 23:36:01,605: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T23:36:01.630766011Z [2024-04-05 23:36:01,625: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-05T23:36:01.799826778Z [2024-04-05 23:36:01,783: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-05T23:36:01.804538638Z [2024-04-05 23:36:01,803: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:36:01.861780436Z [2024-04-05 23:36:01,861: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T23:36:01.863920593Z [2024-04-05 23:36:01,863: INFO/ForkPoolWorker-16] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-05T23:36:01.864467731Z [2024-04-05 23:36:01,864: INFO/ForkPoolWorker-16] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-05T23:36:01.864658152Z [2024-04-05 23:36:01,864: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-05T23:36:01.865192158Z [2024-04-05 23:36:01,864: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-05T23:36:01.956632763Z [2024-04-05 23:36:01,956: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:36:01.990990901Z [2024-04-05 23:36:01,990: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:36:02.502699327Z [2024-04-05 23:36:02,502: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[737f37bf-3cbe-4d10-be48-3b5280d5eb3d] succeeded in 1.2374867179996727s: None 2024-04-05T23:36:02.669681092Z [2024-04-05 23:36:02,669: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5de04015-6ecc-4edc-b952-b2ddb09fa8ef] succeeded in 1.4273644770000828s: None 2024-04-05T23:36:02.990112317Z [2024-04-05 23:36:02,989: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T23:36:02.993365837Z [2024-04-05 23:36:02,992: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:36:02.993965816Z [2024-04-05 23:36:02,993: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-05T23:36:02.997192888Z [2024-04-05 23:36:02,996: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:36:03.028655072Z [2024-04-05 23:36:03,028: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-05T23:36:03.030611605Z [2024-04-05 23:36:03,030: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T23:36:03.032004877Z [2024-04-05 23:36:03,031: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:36:03.032080785Z [2024-04-05 23:36:03,031: INFO/ForkPoolWorker-2] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:36:03.032183429Z [2024-04-05 23:36:03,031: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:36:03.032398305Z [2024-04-05 23:36:03,032: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:36:03.032523452Z [2024-04-05 23:36:03,032: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T23:36:03.032706881Z [2024-04-05 23:36:03,032: INFO/ForkPoolWorker-2] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:36:03.032917677Z [2024-04-05 23:36:03,032: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-05T23:36:03.033057802Z [2024-04-05 23:36:03,032: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:36:03.033421205Z [2024-04-05 23:36:03,032: INFO/ForkPoolWorker-2] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:36:03.033708733Z [2024-04-05 23:36:03,033: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-05T23:36:03.034210353Z [2024-04-05 23:36:03,034: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T23:36:03.034926122Z [2024-04-05 23:36:03,034: INFO/ForkPoolWorker-2] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:36:03.137693833Z [2024-04-05 23:36:03,136: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:36:03.153504424Z [2024-04-05 23:36:03,153: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:36:05.005846009Z [2024-04-05 23:36:05,005: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[7492a7b9-09da-44bd-bf1e-f91d2690ebc2] succeeded in 3.7472883779992117s: None 2024-04-05T23:36:05.318966302Z [2024-04-05 23:36:05,318: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[54ffa67c-0076-45d2-b5a2-45949dff8669] succeeded in 4.0873692880004455s: None 2024-04-05T23:37:00.293035652Z [2024-04-05 23:37:00,292: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b9fc0ea1-d954-48a9-8377-e776aa784ce2] received 2024-04-05T23:37:00.301097486Z [2024-04-05 23:37:00,300: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[62a3c260-e3cd-4749-9aae-bd5dde5103cf] received 2024-04-05T23:37:00.305612348Z [2024-04-05 23:37:00,305: INFO/ForkPoolWorker-15] [b9fc0ea1-d954-48a9-8377-e776aa784ce2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T23:37:00.306440006Z [2024-04-05 23:37:00,306: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1cdb0a38-47c3-4046-bd1f-a13629d4b774] received 2024-04-05T23:37:00.314468576Z [2024-04-05 23:37:00,314: INFO/ForkPoolWorker-16] [62a3c260-e3cd-4749-9aae-bd5dde5103cf] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T23:37:00.315266058Z [2024-04-05 23:37:00,314: INFO/ForkPoolWorker-1] [1cdb0a38-47c3-4046-bd1f-a13629d4b774] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T23:37:00.601875756Z [2024-04-05 23:37:00,598: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-05T23:37:00.613280056Z [2024-04-05 23:37:00,609: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T23:37:00.651191086Z [2024-04-05 23:37:00,647: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T23:37:00.753684969Z [2024-04-05 23:37:00,753: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-05T23:37:00.757308866Z [2024-04-05 23:37:00,756: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:37:00.778806691Z [2024-04-05 23:37:00,778: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T23:37:00.779839569Z [2024-04-05 23:37:00,779: INFO/ForkPoolWorker-16] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-05T23:37:00.779922089Z [2024-04-05 23:37:00,779: INFO/ForkPoolWorker-16] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-05T23:37:00.779953648Z [2024-04-05 23:37:00,779: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-05T23:37:00.780674264Z [2024-04-05 23:37:00,780: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-05T23:37:00.862578238Z [2024-04-05 23:37:00,862: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:37:01.466386825Z [2024-04-05 23:37:01,465: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[62a3c260-e3cd-4749-9aae-bd5dde5103cf] succeeded in 1.161887778000164s: None 2024-04-05T23:37:01.759417495Z [2024-04-05 23:37:01,758: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-05T23:37:01.762824984Z [2024-04-05 23:37:01,762: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:37:01.793726595Z [2024-04-05 23:37:01,793: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-05T23:37:01.795785877Z [2024-04-05 23:37:01,795: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:37:01.796242885Z [2024-04-05 23:37:01,795: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:37:01.796575314Z [2024-04-05 23:37:01,796: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:37:01.796795067Z [2024-04-05 23:37:01,796: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-05T23:37:01.797868632Z [2024-04-05 23:37:01,797: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T23:37:01.798199852Z [2024-04-05 23:37:01,797: INFO/ForkPoolWorker-1] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:37:01.871083144Z [2024-04-05 23:37:01,870: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T23:37:01.874729780Z [2024-04-05 23:37:01,874: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:37:01.889395581Z [2024-04-05 23:37:01,889: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:37:01.897545879Z [2024-04-05 23:37:01,897: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T23:37:01.899070057Z [2024-04-05 23:37:01,898: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:37:01.899142151Z [2024-04-05 23:37:01,898: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:37:01.899417936Z [2024-04-05 23:37:01,899: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:37:01.899519811Z [2024-04-05 23:37:01,899: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T23:37:01.900012312Z [2024-04-05 23:37:01,899: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-05T23:37:01.900050207Z [2024-04-05 23:37:01,899: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:37:01.996872405Z [2024-04-05 23:37:01,996: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:37:04.297939340Z [2024-04-05 23:37:04,297: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1cdb0a38-47c3-4046-bd1f-a13629d4b774] succeeded in 3.989409741999225s: None 2024-04-05T23:37:04.710647471Z [2024-04-05 23:37:04,710: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b9fc0ea1-d954-48a9-8377-e776aa784ce2] succeeded in 4.414162547999695s: None 2024-04-05T23:38:00.920641242Z [2024-04-05 23:38:00,920: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7019470d-c738-4614-88f0-fec8f43a13c0] received 2024-04-05T23:38:00.927351293Z [2024-04-05 23:38:00,927: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9478a783-8e37-4d4e-85cb-dbd0a293c904] received 2024-04-05T23:38:00.939084428Z [2024-04-05 23:38:00,938: INFO/ForkPoolWorker-16] [9478a783-8e37-4d4e-85cb-dbd0a293c904] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T23:38:00.940056859Z [2024-04-05 23:38:00,939: INFO/ForkPoolWorker-15] [7019470d-c738-4614-88f0-fec8f43a13c0] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T23:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T23:38:00.946473548Z [2024-04-05 23:38:00,946: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[93f3b227-1d1a-4786-9c08-e5e53af5dcb7] received 2024-04-05T23:38:00.948886536Z [2024-04-05 23:38:00,948: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[813241ed-7a9b-4828-92c8-f2f2634aebe2] received 2024-04-05T23:38:00.958865431Z [2024-04-05 23:38:00,958: INFO/ForkPoolWorker-1] [93f3b227-1d1a-4786-9c08-e5e53af5dcb7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T23:38:00.971768859Z [2024-04-05 23:38:00,971: INFO/ForkPoolWorker-2] [813241ed-7a9b-4828-92c8-f2f2634aebe2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T23:38:01.238430256Z [2024-04-05 23:38:01,234: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T23:38:01.287204555Z [2024-04-05 23:38:01,283: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-05T23:38:01.385683298Z [2024-04-05 23:38:01,381: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-05T23:38:01.420881635Z [2024-04-05 23:38:01,416: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T23:38:01.482799086Z [2024-04-05 23:38:01,482: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-05T23:38:01.486962206Z [2024-04-05 23:38:01,486: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:38:01.522488767Z [2024-04-05 23:38:01,522: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-05T23:38:01.524831665Z [2024-04-05 23:38:01,524: INFO/ForkPoolWorker-2] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-05T23:38:01.525238402Z [2024-04-05 23:38:01,524: INFO/ForkPoolWorker-2] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-05T23:38:01.525444602Z [2024-04-05 23:38:01,525: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-05T23:38:01.525767846Z [2024-04-05 23:38:01,525: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-05T23:38:01.657281951Z [2024-04-05 23:38:01,656: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:38:01.683769124Z [2024-04-05 23:38:01,683: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:38:02.325668374Z [2024-04-05 23:38:02,325: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7019470d-c738-4614-88f0-fec8f43a13c0] succeeded in 1.3970628119996036s: None 2024-04-05T23:38:02.450921930Z [2024-04-05 23:38:02,450: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[813241ed-7a9b-4828-92c8-f2f2634aebe2] succeeded in 1.4923717900001066s: None 2024-04-05T23:38:02.687551709Z [2024-04-05 23:38:02,687: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-05T23:38:02.690909612Z [2024-04-05 23:38:02,690: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:38:02.721525713Z [2024-04-05 23:38:02,721: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-05T23:38:02.723820474Z [2024-04-05 23:38:02,723: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:38:02.723915331Z [2024-04-05 23:38:02,723: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:38:02.724079590Z [2024-04-05 23:38:02,723: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:38:02.724137945Z [2024-04-05 23:38:02,724: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-05T23:38:02.724428944Z [2024-04-05 23:38:02,724: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T23:38:02.725138995Z [2024-04-05 23:38:02,724: INFO/ForkPoolWorker-1] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:38:02.819395841Z [2024-04-05 23:38:02,818: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:38:02.859911175Z [2024-04-05 23:38:02,859: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-05T23:38:02.863060393Z [2024-04-05 23:38:02,862: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:38:02.889906435Z [2024-04-05 23:38:02,889: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T23:38:02.891773274Z [2024-04-05 23:38:02,891: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:38:02.891827869Z [2024-04-05 23:38:02,891: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:38:02.891993863Z [2024-04-05 23:38:02,891: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:38:02.892041934Z [2024-04-05 23:38:02,891: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-05T23:38:02.892383832Z [2024-04-05 23:38:02,892: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-05T23:38:02.892403899Z [2024-04-05 23:38:02,892: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:38:02.980780747Z [2024-04-05 23:38:02,980: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:38:04.908407851Z [2024-04-05 23:38:04,907: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[93f3b227-1d1a-4786-9c08-e5e53af5dcb7] succeeded in 3.959713698000087s: None 2024-04-05T23:38:05.508522456Z [2024-04-05 23:38:05,508: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9478a783-8e37-4d4e-85cb-dbd0a293c904] succeeded in 4.579015127000275s: None 2024-04-05T23:39:00.424203117Z [2024-04-05 23:39:00,423: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ad8247dd-c21c-4aff-94b9-7c52b2acd5eb] received 2024-04-05T23:39:00.426315528Z [2024-04-05 23:39:00,426: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b093b290-1c24-4f55-9e15-c1fb596576a1] received 2024-04-05T23:39:00.437980985Z [2024-04-05 23:39:00,437: INFO/ForkPoolWorker-15] [ad8247dd-c21c-4aff-94b9-7c52b2acd5eb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T23:39:00.452971282Z [2024-04-05 23:39:00,452: INFO/ForkPoolWorker-16] [b093b290-1c24-4f55-9e15-c1fb596576a1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T23:39:00.455170259Z [2024-04-05 23:39:00,454: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b1cbebdc-d0fc-442e-8e64-ed861a6d7391] received 2024-04-05T23:39:00.482593066Z [2024-04-05 23:39:00,482: INFO/ForkPoolWorker-1] [b1cbebdc-d0fc-442e-8e64-ed861a6d7391] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T23:39:00.969313782Z [2024-04-05 23:39:00,945: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-05T23:39:01.150129305Z [2024-04-05 23:39:01,136: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T23:39:01.298416135Z [2024-04-05 23:39:01,292: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T23:39:01.407647684Z [2024-04-05 23:39:01,406: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-05T23:39:01.412016265Z [2024-04-05 23:39:01,411: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:39:01.467849959Z [2024-04-05 23:39:01,467: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-05T23:39:01.471699443Z [2024-04-05 23:39:01,471: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-05T23:39:01.471727634Z [2024-04-05 23:39:01,471: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-05T23:39:01.471797752Z [2024-04-05 23:39:01,471: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-05T23:39:01.472543852Z [2024-04-05 23:39:01,472: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-05T23:39:01.732577881Z [2024-04-05 23:39:01,732: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:39:02.774121660Z [2024-04-05 23:39:02,773: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b1cbebdc-d0fc-442e-8e64-ed861a6d7391] succeeded in 2.3157092919991555s: None 2024-04-05T23:39:03.333566316Z [2024-04-05 23:39:03,333: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T23:39:03.337133273Z [2024-04-05 23:39:03,336: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:39:03.356403679Z [2024-04-05 23:39:03,356: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T23:39:03.357505628Z [2024-04-05 23:39:03,357: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:39:03.357519109Z [2024-04-05 23:39:03,357: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:39:03.357655511Z [2024-04-05 23:39:03,357: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:39:03.357682457Z [2024-04-05 23:39:03,357: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T23:39:03.357869427Z [2024-04-05 23:39:03,357: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-05T23:39:03.357890446Z [2024-04-05 23:39:03,357: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:39:03.444160589Z [2024-04-05 23:39:03,443: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:39:03.660138228Z [2024-04-05 23:39:03,659: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-05T23:39:03.663739453Z [2024-04-05 23:39:03,663: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:39:03.747544091Z [2024-04-05 23:39:03,747: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T23:39:03.749082648Z [2024-04-05 23:39:03,748: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:39:03.749231855Z [2024-04-05 23:39:03,749: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:39:03.749408814Z [2024-04-05 23:39:03,749: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:39:03.749739229Z [2024-04-05 23:39:03,749: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-05T23:39:03.750139826Z [2024-04-05 23:39:03,749: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T23:39:03.750177609Z [2024-04-05 23:39:03,750: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:39:03.903959872Z [2024-04-05 23:39:03,903: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:39:05.514696453Z [2024-04-05 23:39:05,514: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ad8247dd-c21c-4aff-94b9-7c52b2acd5eb] succeeded in 5.0849047920000885s: None 2024-04-05T23:39:06.172169260Z [2024-04-05 23:39:06,171: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b093b290-1c24-4f55-9e15-c1fb596576a1] succeeded in 5.738635100000465s: None 2024-04-05T23:40:00.393937151Z [2024-04-05 23:40:00,393: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8beb5df8-bb84-4608-988b-767c882d3692] received 2024-04-05T23:40:00.395867298Z [2024-04-05 23:40:00,395: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[69c330a3-6964-4ad7-8696-55a5dafa91d2] received 2024-04-05T23:40:00.397420199Z [2024-04-05 23:40:00,397: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a66c58ea-a24e-4a5b-8fa5-c66c86ea4c63] received 2024-04-05T23:40:00.398970162Z [2024-04-05 23:40:00,398: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f7404b2a-18c0-406b-9151-fe9937ace7a4] received 2024-04-05T23:40:00.403118820Z [2024-04-05 23:40:00,402: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eca656ab-8ac8-4421-8d5c-0a8bc32d20a9] received 2024-04-05T23:40:00.408397702Z [2024-04-05 23:40:00,408: INFO/ForkPoolWorker-16] [69c330a3-6964-4ad7-8696-55a5dafa91d2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T23:40:00.421241536Z [2024-04-05 23:40:00,420: INFO/ForkPoolWorker-1] [a66c58ea-a24e-4a5b-8fa5-c66c86ea4c63] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T23:40:00.425926873Z [2024-04-05 23:40:00,425: INFO/ForkPoolWorker-3] [eca656ab-8ac8-4421-8d5c-0a8bc32d20a9] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T23:40:00.428509613Z [2024-04-05 23:40:00,427: INFO/ForkPoolWorker-2] [f7404b2a-18c0-406b-9151-fe9937ace7a4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T23:40:00.432756618Z [2024-04-05 23:40:00,432: INFO/ForkPoolWorker-15] [8beb5df8-bb84-4608-988b-767c882d3692] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T23:40:00.809842809Z [2024-04-05 23:40:00,805: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T23:40:00.830328974Z [2024-04-05 23:40:00,822: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T23:40:00.919173278Z [2024-04-05 23:40:00,915: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-05T23:40:01.122937317Z [2024-04-05 23:40:01,122: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-05T23:40:01.127336316Z [2024-04-05 23:40:01,126: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:40:01.174352484Z [2024-04-05 23:40:01,174: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-05T23:40:01.180238524Z [2024-04-05 23:40:01,179: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-05T23:40:01.180495763Z [2024-04-05 23:40:01,180: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-05T23:40:01.180667936Z [2024-04-05 23:40:01,180: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-05T23:40:01.181008079Z [2024-04-05 23:40:01,180: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-05T23:40:01.311331058Z [2024-04-05 23:40:01,310: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:40:01.335167285Z [2024-04-05 23:40:01,328: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-05T23:40:01.391993791Z [2024-04-05 23:40:01,387: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T23:40:02.177990482Z [2024-04-05 23:40:02,177: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a66c58ea-a24e-4a5b-8fa5-c66c86ea4c63] succeeded in 1.7775294839993876s: None 2024-04-05T23:40:02.445263227Z [2024-04-05 23:40:02,444: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:40:02.487539288Z [2024-04-05 23:40:02,487: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-05T23:40:02.500300987Z [2024-04-05 23:40:02,499: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:40:02.553240158Z [2024-04-05 23:40:02,552: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T23:40:02.558939457Z [2024-04-05 23:40:02,558: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:40:02.559424936Z [2024-04-05 23:40:02,559: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:40:02.559669292Z [2024-04-05 23:40:02,559: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:40:02.559695207Z [2024-04-05 23:40:02,559: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-05T23:40:02.560051572Z [2024-04-05 23:40:02,559: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T23:40:02.560061304Z [2024-04-05 23:40:02,559: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:40:02.684937192Z [2024-04-05 23:40:02,684: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:40:02.780638993Z [2024-04-05 23:40:02,780: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-05T23:40:02.787537681Z [2024-04-05 23:40:02,786: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:40:02.809054370Z [2024-04-05 23:40:02,808: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-05T23:40:02.810120896Z [2024-04-05 23:40:02,809: INFO/ForkPoolWorker-2] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:40:02.810228974Z [2024-04-05 23:40:02,810: INFO/ForkPoolWorker-2] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:40:02.810436245Z [2024-04-05 23:40:02,810: INFO/ForkPoolWorker-2] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:40:02.810504576Z [2024-04-05 23:40:02,810: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-05T23:40:02.811054203Z [2024-04-05 23:40:02,810: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-05T23:40:02.811135498Z [2024-04-05 23:40:02,811: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:40:02.922060942Z [2024-04-05 23:40:02,921: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:40:03.106898287Z [2024-04-05 23:40:03,106: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T23:40:03.110786602Z [2024-04-05 23:40:03,110: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:40:03.151814121Z [2024-04-05 23:40:03,151: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T23:40:03.157102471Z [2024-04-05 23:40:03,156: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:40:03.157161891Z [2024-04-05 23:40:03,156: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:40:03.157173657Z [2024-04-05 23:40:03,157: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:40:03.157202168Z [2024-04-05 23:40:03,157: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T23:40:03.157500857Z [2024-04-05 23:40:03,157: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T23:40:03.157510649Z [2024-04-05 23:40:03,157: INFO/ForkPoolWorker-15] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:40:03.250020169Z [2024-04-05 23:40:03,249: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[eca656ab-8ac8-4421-8d5c-0a8bc32d20a9] succeeded in 2.8388161309994757s: None 2024-04-05T23:40:03.308513792Z [2024-04-05 23:40:03,308: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:40:03.357988375Z [2024-04-05 23:40:03,357: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[69c330a3-6964-4ad7-8696-55a5dafa91d2] succeeded in 2.9602146120005273s: None 2024-04-05T23:40:03.656312914Z [2024-04-05 23:40:03,656: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5198e3fb-6013-49e2-87c3-1661c2a8fb4a] received 2024-04-05T23:40:03.676429273Z [2024-04-05 23:40:03,675: INFO/ForkPoolWorker-16] [5198e3fb-6013-49e2-87c3-1661c2a8fb4a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'split_metrics', 'scheduled__2024-04-05T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T23:40:04.074967456Z [2024-04-05 23:40:04,071: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T23:40:05.084891450Z [2024-04-05 23:40:05,084: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8beb5df8-bb84-4608-988b-767c882d3692] succeeded in 4.686861657999543s: None 2024-04-05T23:40:05.242341034Z [2024-04-05 23:40:05,240: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[f7404b2a-18c0-406b-9151-fe9937ace7a4] succeeded in 4.838165496000329s: None 2024-04-05T23:40:05.395531255Z [2024-04-05 23:40:05,395: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-05T23:40:05.398903018Z [2024-04-05 23:40:05,398: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:40:05.422829109Z [2024-04-05 23:40:05,422: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T23:40:05.424422694Z [2024-04-05 23:40:05,424: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:40:05.424500904Z [2024-04-05 23:40:05,424: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:40:05.424679633Z [2024-04-05 23:40:05,424: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:40:05.424743205Z [2024-04-05 23:40:05,424: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-05T23:40:05.425046107Z [2024-04-05 23:40:05,424: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T23:40:05.425138705Z [2024-04-05 23:40:05,425: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:40:05.527989767Z [2024-04-05 23:40:05,527: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:40:06.273670600Z [2024-04-05 23:40:06,273: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5198e3fb-6013-49e2-87c3-1661c2a8fb4a] succeeded in 2.6149725039995246s: None 2024-04-05T23:40:06.425442749Z [2024-04-05 23:40:06,425: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[296295fe-2539-4778-9468-63bb0d8fcbff] received 2024-04-05T23:40:06.438256564Z [2024-04-05 23:40:06,437: INFO/ForkPoolWorker-15] [296295fe-2539-4778-9468-63bb0d8fcbff] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'collect_metrics', 'scheduled__2024-04-05T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T23:40:06.759575709Z [2024-04-05 23:40:06,752: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T23:40:07.891306097Z [2024-04-05 23:40:07,890: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T23:40:07.894423768Z [2024-04-05 23:40:07,893: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:40:07.919893843Z [2024-04-05 23:40:07,919: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T23:40:07.921207468Z [2024-04-05 23:40:07,920: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:40:07.921270525Z [2024-04-05 23:40:07,921: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:40:07.921499907Z [2024-04-05 23:40:07,921: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:40:07.921514942Z [2024-04-05 23:40:07,921: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T23:40:07.921848930Z [2024-04-05 23:40:07,921: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T23:40:07.921909288Z [2024-04-05 23:40:07,921: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:40:08.017171880Z [2024-04-05 23:40:08,016: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:40:08.661664301Z [2024-04-05 23:40:08,661: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[296295fe-2539-4778-9468-63bb0d8fcbff] succeeded in 2.233266275999995s: None 2024-04-05T23:40:08.779612560Z [2024-04-05 23:40:08,779: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cfd48f48-e88d-453f-8186-e4da0f597f0b] received 2024-04-05T23:40:08.788647678Z [2024-04-05 23:40:08,788: INFO/ForkPoolWorker-15] [cfd48f48-e88d-453f-8186-e4da0f597f0b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'send_prometheus', 'scheduled__2024-04-05T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T23:40:09.079959756Z [2024-04-05 23:40:09,076: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T23:40:10.397240375Z [2024-04-05 23:40:10,396: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T23:40:10.400911346Z [2024-04-05 23:40:10,400: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:40:10.429051365Z [2024-04-05 23:40:10,428: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T23:40:10.431173056Z [2024-04-05 23:40:10,430: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:40:10.431429784Z [2024-04-05 23:40:10,431: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:40:10.431709019Z [2024-04-05 23:40:10,431: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:40:10.431851321Z [2024-04-05 23:40:10,431: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T23:40:10.432250713Z [2024-04-05 23:40:10,432: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T23:40:10.432494243Z [2024-04-05 23:40:10,432: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:40:10.518036643Z [2024-04-05 23:40:10,517: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:40:11.174827136Z [2024-04-05 23:40:11,174: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cfd48f48-e88d-453f-8186-e4da0f597f0b] succeeded in 2.392070545999559s: None 2024-04-05T23:41:00.360965509Z [2024-04-05 23:41:00,360: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[47a5d038-af14-4336-9c77-fda90a7f2859] received 2024-04-05T23:41:00.369790767Z [2024-04-05 23:41:00,369: INFO/ForkPoolWorker-15] [47a5d038-af14-4336-9c77-fda90a7f2859] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T23:41:00.370116921Z [2024-04-05 23:41:00,369: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b09d80c4-aca6-4c92-afdc-f845c3b049fa] received 2024-04-05T23:41:00.379188298Z [2024-04-05 23:41:00,378: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d2939478-0032-49e4-8662-f16efb27e3ed] received 2024-04-05T23:41:00.382692633Z [2024-04-05 23:41:00,382: INFO/ForkPoolWorker-16] [b09d80c4-aca6-4c92-afdc-f845c3b049fa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T23:41:00.403448169Z [2024-04-05 23:41:00,403: INFO/ForkPoolWorker-1] [d2939478-0032-49e4-8662-f16efb27e3ed] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T23:41:00.713812679Z [2024-04-05 23:41:00,710: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T23:41:00.719755507Z [2024-04-05 23:41:00,715: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T23:41:00.727576161Z [2024-04-05 23:41:00,723: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-05T23:41:00.881227859Z [2024-04-05 23:41:00,880: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-05T23:41:00.884996041Z [2024-04-05 23:41:00,884: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:41:00.912099859Z [2024-04-05 23:41:00,911: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-05T23:41:00.915811716Z [2024-04-05 23:41:00,915: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-05T23:41:00.915872455Z [2024-04-05 23:41:00,915: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-05T23:41:00.915950846Z [2024-04-05 23:41:00,915: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-05T23:41:00.916221815Z [2024-04-05 23:41:00,916: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-05T23:41:00.999606002Z [2024-04-05 23:41:00,999: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:41:01.730661013Z [2024-04-05 23:41:01,725: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d2939478-0032-49e4-8662-f16efb27e3ed] succeeded in 1.344501410999328s: None 2024-04-05T23:41:02.072397987Z [2024-04-05 23:41:02,072: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-05T23:41:02.075572859Z [2024-04-05 23:41:02,075: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:41:02.118667984Z [2024-04-05 23:41:02,118: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T23:41:02.126560049Z [2024-04-05 23:41:02,126: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:41:02.126598716Z [2024-04-05 23:41:02,126: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:41:02.126884089Z [2024-04-05 23:41:02,126: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:41:02.126976359Z [2024-04-05 23:41:02,126: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-05T23:41:02.127446623Z [2024-04-05 23:41:02,127: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T23:41:02.127550084Z [2024-04-05 23:41:02,127: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:41:02.197201480Z [2024-04-05 23:41:02,196: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T23:41:02.202077337Z [2024-04-05 23:41:02,201: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:41:02.221454101Z [2024-04-05 23:41:02,221: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:41:02.249434071Z [2024-04-05 23:41:02,249: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T23:41:02.253171046Z [2024-04-05 23:41:02,252: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:41:02.253904004Z [2024-04-05 23:41:02,253: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:41:02.254195826Z [2024-04-05 23:41:02,253: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:41:02.254347614Z [2024-04-05 23:41:02,254: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T23:41:02.254773876Z [2024-04-05 23:41:02,254: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-05T23:41:02.254980191Z [2024-04-05 23:41:02,254: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:41:02.364622888Z [2024-04-05 23:41:02,364: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:41:03.846769390Z [2024-04-05 23:41:03,846: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b09d80c4-aca6-4c92-afdc-f845c3b049fa] succeeded in 3.474184208999759s: None 2024-04-05T23:41:05.286712478Z [2024-04-05 23:41:05,285: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[47a5d038-af14-4336-9c77-fda90a7f2859] succeeded in 4.923587674000373s: None 2024-04-05T23:42:01.096970628Z [2024-04-05 23:42:01,096: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f51ff456-0844-4db9-8958-d771cbecfbcd] received 2024-04-05T23:42:01.108078472Z [2024-04-05 23:42:01,107: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[167cee7c-95cd-481f-a308-adbb18af97a9] received 2024-04-05T23:42:01.114585740Z [2024-04-05 23:42:01,114: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e3a95004-fa9a-4e5e-b2e6-eddd4e2c6fce] received 2024-04-05T23:42:01.120547197Z [2024-04-05 23:42:01,119: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e2103df4-854d-475d-b4ef-d6cf83c3ce42] received 2024-04-05T23:42:01.121700701Z [2024-04-05 23:42:01,121: INFO/ForkPoolWorker-15] [f51ff456-0844-4db9-8958-d771cbecfbcd] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T23:42:01.128676905Z [2024-04-05 23:42:01,128: INFO/ForkPoolWorker-1] [e3a95004-fa9a-4e5e-b2e6-eddd4e2c6fce] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T23:42:01.142825735Z [2024-04-05 23:42:01,142: INFO/ForkPoolWorker-16] [167cee7c-95cd-481f-a308-adbb18af97a9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T23:42:01.169923579Z [2024-04-05 23:42:01,169: INFO/ForkPoolWorker-2] [e2103df4-854d-475d-b4ef-d6cf83c3ce42] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T23:42:01.809381284Z [2024-04-05 23:42:01,802: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T23:42:01.963390994Z [2024-04-05 23:42:01,956: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-05T23:42:02.091900885Z [2024-04-05 23:42:02,084: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T23:42:02.104399837Z [2024-04-05 23:42:02,093: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-05T23:42:02.652436398Z [2024-04-05 23:42:02,651: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-05T23:42:02.682601275Z [2024-04-05 23:42:02,682: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:42:02.690220031Z [2024-04-05 23:42:02,689: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:42:02.792053478Z [2024-04-05 23:42:02,791: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-05T23:42:02.795399308Z [2024-04-05 23:42:02,795: INFO/ForkPoolWorker-2] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-05T23:42:02.795721282Z [2024-04-05 23:42:02,795: INFO/ForkPoolWorker-2] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-05T23:42:02.795800838Z [2024-04-05 23:42:02,795: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-05T23:42:02.796135441Z [2024-04-05 23:42:02,795: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-05T23:42:03.006020533Z [2024-04-05 23:42:03,005: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:42:03.832816637Z [2024-04-05 23:42:03,831: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f51ff456-0844-4db9-8958-d771cbecfbcd] succeeded in 2.7314489270002014s: None 2024-04-05T23:42:04.218272463Z [2024-04-05 23:42:04,217: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[e2103df4-854d-475d-b4ef-d6cf83c3ce42] succeeded in 3.0811264559997653s: None 2024-04-05T23:42:04.667280923Z [2024-04-05 23:42:04,666: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-05T23:42:04.670500421Z [2024-04-05 23:42:04,670: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:42:04.694513396Z [2024-04-05 23:42:04,694: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-05T23:42:04.695958523Z [2024-04-05 23:42:04,695: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:42:04.695975066Z [2024-04-05 23:42:04,695: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:42:04.696113291Z [2024-04-05 23:42:04,695: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:42:04.696146666Z [2024-04-05 23:42:04,696: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-05T23:42:04.696719658Z [2024-04-05 23:42:04,696: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T23:42:04.696757393Z [2024-04-05 23:42:04,696: INFO/ForkPoolWorker-1] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:42:04.794009064Z [2024-04-05 23:42:04,793: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:42:04.952075884Z [2024-04-05 23:42:04,951: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-05T23:42:04.955853270Z [2024-04-05 23:42:04,955: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:42:04.991876271Z [2024-04-05 23:42:04,991: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T23:42:04.993926836Z [2024-04-05 23:42:04,993: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:42:04.994059942Z [2024-04-05 23:42:04,993: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:42:04.994273631Z [2024-04-05 23:42:04,994: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:42:04.994406180Z [2024-04-05 23:42:04,994: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-05T23:42:04.994742440Z [2024-04-05 23:42:04,994: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-05T23:42:04.997019039Z [2024-04-05 23:42:04,994: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:42:05.091292469Z [2024-04-05 23:42:05,091: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:42:06.282624499Z [2024-04-05 23:42:06,282: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e3a95004-fa9a-4e5e-b2e6-eddd4e2c6fce] succeeded in 5.164934831999744s: None 2024-04-05T23:42:06.993919724Z [2024-04-05 23:42:06,993: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[167cee7c-95cd-481f-a308-adbb18af97a9] succeeded in 5.865023914000631s: None 2024-04-05T23:43:00.752158383Z [2024-04-05 23:43:00,751: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2480f7f0-b8d3-43bf-a62b-4f4ad5bad9f1] received 2024-04-05T23:43:00.761985570Z [2024-04-05 23:43:00,761: INFO/ForkPoolWorker-15] [2480f7f0-b8d3-43bf-a62b-4f4ad5bad9f1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T23:43:00.763892301Z [2024-04-05 23:43:00,763: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[02895fae-ca18-440a-a701-64a3bca6f992] received 2024-04-05T23:43:00.771540802Z [2024-04-05 23:43:00,771: INFO/ForkPoolWorker-16] [02895fae-ca18-440a-a701-64a3bca6f992] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T23:43:00.774465938Z [2024-04-05 23:43:00,774: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c000b820-7991-42c9-a079-6a5a10dd853e] received 2024-04-05T23:43:00.789538370Z [2024-04-05 23:43:00,789: INFO/ForkPoolWorker-1] [c000b820-7991-42c9-a079-6a5a10dd853e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T23:43:01.089249429Z [2024-04-05 23:43:01,085: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T23:43:01.116701627Z [2024-04-05 23:43:01,113: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-05T23:43:01.165766295Z [2024-04-05 23:43:01,161: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T23:43:01.305015288Z [2024-04-05 23:43:01,304: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-05T23:43:01.310801044Z [2024-04-05 23:43:01,310: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:43:01.350991436Z [2024-04-05 23:43:01,350: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T23:43:01.356402054Z [2024-04-05 23:43:01,356: INFO/ForkPoolWorker-16] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-05T23:43:01.356516331Z [2024-04-05 23:43:01,356: INFO/ForkPoolWorker-16] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-05T23:43:01.356568200Z [2024-04-05 23:43:01,356: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-05T23:43:01.356835544Z [2024-04-05 23:43:01,356: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-05T23:43:01.479032937Z [2024-04-05 23:43:01,478: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:43:02.124678078Z [2024-04-05 23:43:02,124: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[02895fae-ca18-440a-a701-64a3bca6f992] succeeded in 1.3587987250002698s: None 2024-04-05T23:43:02.766942092Z [2024-04-05 23:43:02,766: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T23:43:02.771465020Z [2024-04-05 23:43:02,770: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:43:02.801552047Z [2024-04-05 23:43:02,800: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-05T23:43:02.805498242Z [2024-04-05 23:43:02,804: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:43:02.816211387Z [2024-04-05 23:43:02,815: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T23:43:02.825074282Z [2024-04-05 23:43:02,824: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:43:02.825882893Z [2024-04-05 23:43:02,825: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:43:02.826078068Z [2024-04-05 23:43:02,825: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:43:02.826153936Z [2024-04-05 23:43:02,826: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T23:43:02.826558649Z [2024-04-05 23:43:02,826: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-05T23:43:02.826672106Z [2024-04-05 23:43:02,826: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:43:02.836627921Z [2024-04-05 23:43:02,836: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-05T23:43:02.837913700Z [2024-04-05 23:43:02,837: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:43:02.838055797Z [2024-04-05 23:43:02,837: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:43:02.838262228Z [2024-04-05 23:43:02,838: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:43:02.838392070Z [2024-04-05 23:43:02,838: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-05T23:43:02.838799691Z [2024-04-05 23:43:02,838: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T23:43:02.838917395Z [2024-04-05 23:43:02,838: INFO/ForkPoolWorker-1] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:43:02.934746042Z [2024-04-05 23:43:02,934: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:43:02.958761465Z [2024-04-05 23:43:02,958: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:43:04.986991320Z [2024-04-05 23:43:04,986: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c000b820-7991-42c9-a079-6a5a10dd853e] succeeded in 4.210323552999398s: None 2024-04-05T23:43:06.074590975Z [2024-04-05 23:43:06,074: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2480f7f0-b8d3-43bf-a62b-4f4ad5bad9f1] succeeded in 5.320194705999711s: None 2024-04-05T23:44:00.686482318Z [2024-04-05 23:44:00,686: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[08fb76aa-9007-44ed-a419-71c7339d77e3] received 2024-04-05T23:44:00.691007859Z [2024-04-05 23:44:00,690: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[18cf6b15-aadb-4045-9777-6be95c5f1e92] received 2024-04-05T23:44:00.697919213Z [2024-04-05 23:44:00,697: INFO/ForkPoolWorker-15] [08fb76aa-9007-44ed-a419-71c7339d77e3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T23:44:00.702178131Z [2024-04-05 23:44:00,701: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a90f5521-9b90-429c-9b89-2976f2da230b] received 2024-04-05T23:44:00.708168951Z [2024-04-05 23:44:00,707: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6a59e1b1-c6f3-4e01-8867-b6ba5bd48a47] received 2024-04-05T23:44:00.714388283Z [2024-04-05 23:44:00,714: INFO/ForkPoolWorker-16] [18cf6b15-aadb-4045-9777-6be95c5f1e92] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T23:44:00.745061247Z [2024-04-05 23:44:00,742: INFO/ForkPoolWorker-2] [6a59e1b1-c6f3-4e01-8867-b6ba5bd48a47] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T23:44:00.776383526Z [2024-04-05 23:44:00,772: INFO/ForkPoolWorker-1] [a90f5521-9b90-429c-9b89-2976f2da230b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T23:44:01.049516466Z [2024-04-05 23:44:01,045: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T23:44:01.246663117Z [2024-04-05 23:44:01,242: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-05T23:44:01.301343010Z [2024-04-05 23:44:01,297: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T23:44:01.307326916Z [2024-04-05 23:44:01,303: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-05T23:44:01.483383169Z [2024-04-05 23:44:01,482: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-05T23:44:01.487395639Z [2024-04-05 23:44:01,486: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:44:01.528778312Z [2024-04-05 23:44:01,528: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T23:44:01.532804113Z [2024-04-05 23:44:01,532: INFO/ForkPoolWorker-16] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-05T23:44:01.533194421Z [2024-04-05 23:44:01,532: INFO/ForkPoolWorker-16] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-05T23:44:01.533304316Z [2024-04-05 23:44:01,533: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-05T23:44:01.533595081Z [2024-04-05 23:44:01,533: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-05T23:44:01.540616968Z [2024-04-05 23:44:01,540: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:44:01.641532876Z [2024-04-05 23:44:01,641: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:44:02.231675359Z [2024-04-05 23:44:02,231: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a90f5521-9b90-429c-9b89-2976f2da230b] succeeded in 1.51712851100001s: None 2024-04-05T23:44:02.280448294Z [2024-04-05 23:44:02,280: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[18cf6b15-aadb-4045-9777-6be95c5f1e92] succeeded in 1.5840119030008282s: None 2024-04-05T23:44:02.567418603Z [2024-04-05 23:44:02,566: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T23:44:02.571202967Z [2024-04-05 23:44:02,570: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:44:02.590006017Z [2024-04-05 23:44:02,589: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T23:44:02.591880230Z [2024-04-05 23:44:02,591: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:44:02.592065312Z [2024-04-05 23:44:02,591: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:44:02.592271515Z [2024-04-05 23:44:02,592: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:44:02.592403147Z [2024-04-05 23:44:02,592: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T23:44:02.592745035Z [2024-04-05 23:44:02,592: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T23:44:02.592906694Z [2024-04-05 23:44:02,592: INFO/ForkPoolWorker-15] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:44:02.683384128Z [2024-04-05 23:44:02,682: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-05T23:44:02.686879779Z [2024-04-05 23:44:02,686: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:44:02.727004348Z [2024-04-05 23:44:02,726: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-05T23:44:02.727417596Z [2024-04-05 23:44:02,727: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:44:02.728344716Z [2024-04-05 23:44:02,728: INFO/ForkPoolWorker-2] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:44:02.728381248Z [2024-04-05 23:44:02,728: INFO/ForkPoolWorker-2] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:44:02.728733223Z [2024-04-05 23:44:02,728: INFO/ForkPoolWorker-2] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:44:02.728761996Z [2024-04-05 23:44:02,728: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-05T23:44:02.728963083Z [2024-04-05 23:44:02,728: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-05T23:44:02.728973376Z [2024-04-05 23:44:02,728: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:44:02.811881781Z [2024-04-05 23:44:02,811: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:44:04.538421086Z [2024-04-05 23:44:04,537: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[08fb76aa-9007-44ed-a419-71c7339d77e3] succeeded in 3.850007209999603s: None 2024-04-05T23:44:05.017651654Z [2024-04-05 23:44:05,016: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[6a59e1b1-c6f3-4e01-8867-b6ba5bd48a47] succeeded in 4.307310457999847s: None 2024-04-05T23:45:00.608056011Z [2024-04-05 23:45:00,607: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fe9623a5-953c-4d22-9de8-e6df9927c538] received 2024-04-05T23:45:00.612834025Z [2024-04-05 23:45:00,612: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ea274313-e0df-4534-b769-dc21e40e1510] received 2024-04-05T23:45:00.614496464Z [2024-04-05 23:45:00,614: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c887cc76-63fd-4f79-a642-241139280e37] received 2024-04-05T23:45:00.616013579Z [2024-04-05 23:45:00,615: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d3cabb92-9dd7-4f33-a5c2-996e135a729d] received 2024-04-05T23:45:00.624772386Z [2024-04-05 23:45:00,624: INFO/ForkPoolWorker-1] [c887cc76-63fd-4f79-a642-241139280e37] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T23:45:00.628105538Z [2024-04-05 23:45:00,627: INFO/ForkPoolWorker-2] [d3cabb92-9dd7-4f33-a5c2-996e135a729d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T23:45:00.635624049Z [2024-04-05 23:45:00,634: INFO/ForkPoolWorker-16] [ea274313-e0df-4534-b769-dc21e40e1510] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T23:45:00.639358718Z [2024-04-05 23:45:00,639: INFO/ForkPoolWorker-15] [fe9623a5-953c-4d22-9de8-e6df9927c538] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T23:45:01.168679014Z [2024-04-05 23:45:01,164: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T23:45:01.196317579Z [2024-04-05 23:45:01,192: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T23:45:01.226639933Z [2024-04-05 23:45:01,222: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-05T23:45:01.239090191Z [2024-04-05 23:45:01,234: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T23:45:01.507634037Z [2024-04-05 23:45:01,506: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-05T23:45:01.527924915Z [2024-04-05 23:45:01,518: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:45:01.547552952Z [2024-04-05 23:45:01,546: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T23:45:01.570610162Z [2024-04-05 23:45:01,552: INFO/ForkPoolWorker-15] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-05T23:45:01.570619684Z [2024-04-05 23:45:01,552: INFO/ForkPoolWorker-15] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-05T23:45:01.570623560Z [2024-04-05 23:45:01,552: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-05T23:45:01.570626780Z [2024-04-05 23:45:01,552: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-05T23:45:01.714168628Z [2024-04-05 23:45:01,711: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:45:02.589786761Z [2024-04-05 23:45:02,588: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fe9623a5-953c-4d22-9de8-e6df9927c538] succeeded in 1.9777114190001157s: None 2024-04-05T23:45:03.011132006Z [2024-04-05 23:45:03,010: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-05T23:45:03.019563507Z [2024-04-05 23:45:03,019: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:45:03.064009446Z [2024-04-05 23:45:03,063: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-05T23:45:03.072048525Z [2024-04-05 23:45:03,071: INFO/ForkPoolWorker-2] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:45:03.072078631Z [2024-04-05 23:45:03,071: INFO/ForkPoolWorker-2] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:45:03.072097608Z [2024-04-05 23:45:03,071: INFO/ForkPoolWorker-2] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:45:03.072151490Z [2024-04-05 23:45:03,072: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-05T23:45:03.075691968Z [2024-04-05 23:45:03,075: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-05T23:45:03.075712707Z [2024-04-05 23:45:03,075: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:45:03.082443037Z [2024-04-05 23:45:03,082: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-05T23:45:03.086610771Z [2024-04-05 23:45:03,085: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:45:03.113476891Z [2024-04-05 23:45:03,113: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-05T23:45:03.116480062Z [2024-04-05 23:45:03,116: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:45:03.116507569Z [2024-04-05 23:45:03,116: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:45:03.116589075Z [2024-04-05 23:45:03,116: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:45:03.116609792Z [2024-04-05 23:45:03,116: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-05T23:45:03.116870413Z [2024-04-05 23:45:03,116: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T23:45:03.116892505Z [2024-04-05 23:45:03,116: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:45:03.159358837Z [2024-04-05 23:45:03,158: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-05T23:45:03.163352582Z [2024-04-05 23:45:03,162: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:45:03.193087000Z [2024-04-05 23:45:03,192: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T23:45:03.194896978Z [2024-04-05 23:45:03,194: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:45:03.195147014Z [2024-04-05 23:45:03,194: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:45:03.195539015Z [2024-04-05 23:45:03,195: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:45:03.195717776Z [2024-04-05 23:45:03,195: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-05T23:45:03.196096480Z [2024-04-05 23:45:03,195: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T23:45:03.196644159Z [2024-04-05 23:45:03,196: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:45:03.262156488Z [2024-04-05 23:45:03,261: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:45:03.280706633Z [2024-04-05 23:45:03,280: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:45:03.287497469Z [2024-04-05 23:45:03,287: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:45:03.880512074Z [2024-04-05 23:45:03,880: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c887cc76-63fd-4f79-a642-241139280e37] succeeded in 3.263464448999912s: None 2024-04-05T23:45:04.191568502Z [2024-04-05 23:45:04,191: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aa19f90f-7967-4175-a2f0-77b54c3c00fc] received 2024-04-05T23:45:04.202921544Z [2024-04-05 23:45:04,202: INFO/ForkPoolWorker-15] [aa19f90f-7967-4175-a2f0-77b54c3c00fc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'split_metrics', 'scheduled__2024-04-05T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T23:45:04.559636092Z [2024-04-05 23:45:04,556: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T23:45:05.102553249Z [2024-04-05 23:45:05,101: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ea274313-e0df-4534-b769-dc21e40e1510] succeeded in 4.482039764000547s: None 2024-04-05T23:45:05.361161226Z [2024-04-05 23:45:05,360: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d3cabb92-9dd7-4f33-a5c2-996e135a729d] succeeded in 4.742153230999975s: None 2024-04-05T23:45:06.035864444Z [2024-04-05 23:45:06,035: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T23:45:06.038968641Z [2024-04-05 23:45:06,038: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:45:06.069811923Z [2024-04-05 23:45:06,069: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T23:45:06.071404577Z [2024-04-05 23:45:06,071: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:45:06.071437475Z [2024-04-05 23:45:06,071: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:45:06.071593132Z [2024-04-05 23:45:06,071: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:45:06.071675786Z [2024-04-05 23:45:06,071: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T23:45:06.071916590Z [2024-04-05 23:45:06,071: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T23:45:06.071991496Z [2024-04-05 23:45:06,071: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:45:06.157293574Z [2024-04-05 23:45:06,156: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:45:06.868863349Z [2024-04-05 23:45:06,868: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[aa19f90f-7967-4175-a2f0-77b54c3c00fc] succeeded in 2.6753053399997953s: None 2024-04-05T23:45:07.588199616Z [2024-04-05 23:45:07,587: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8e516bea-62f3-4e98-b9fa-7fdf2099f51e] received 2024-04-05T23:45:07.610584794Z [2024-04-05 23:45:07,610: INFO/ForkPoolWorker-15] [8e516bea-62f3-4e98-b9fa-7fdf2099f51e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'collect_metrics', 'scheduled__2024-04-05T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T23:45:07.891873360Z [2024-04-05 23:45:07,888: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T23:45:09.078437814Z [2024-04-05 23:45:09,077: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T23:45:09.081937352Z [2024-04-05 23:45:09,081: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:45:09.109556776Z [2024-04-05 23:45:09,109: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T23:45:09.111440376Z [2024-04-05 23:45:09,111: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:45:09.111551464Z [2024-04-05 23:45:09,111: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:45:09.111826552Z [2024-04-05 23:45:09,111: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:45:09.111899112Z [2024-04-05 23:45:09,111: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T23:45:09.112366903Z [2024-04-05 23:45:09,112: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T23:45:09.112388303Z [2024-04-05 23:45:09,112: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:45:09.208638165Z [2024-04-05 23:45:09,208: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:45:09.748138682Z [2024-04-05 23:45:09,747: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8e516bea-62f3-4e98-b9fa-7fdf2099f51e] succeeded in 2.1534796810001353s: None 2024-04-05T23:45:10.635240259Z [2024-04-05 23:45:10,634: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1f4bfa62-90f8-4dcd-8a6c-0b576dcd55ce] received 2024-04-05T23:45:10.644331681Z [2024-04-05 23:45:10,643: INFO/ForkPoolWorker-15] [1f4bfa62-90f8-4dcd-8a6c-0b576dcd55ce] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'send_prometheus', 'scheduled__2024-04-05T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T23:45:10.927977584Z [2024-04-05 23:45:10,924: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T23:45:12.087045221Z [2024-04-05 23:45:12,086: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T23:45:12.090736860Z [2024-04-05 23:45:12,090: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:45:12.118457332Z [2024-04-05 23:45:12,118: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T23:45:12.121951520Z [2024-04-05 23:45:12,121: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:45:12.122163616Z [2024-04-05 23:45:12,121: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:45:12.122651580Z [2024-04-05 23:45:12,122: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:45:12.122955421Z [2024-04-05 23:45:12,122: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T23:45:12.123775046Z [2024-04-05 23:45:12,123: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T23:45:12.124233621Z [2024-04-05 23:45:12,123: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:45:12.218703485Z [2024-04-05 23:45:12,218: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:45:12.846464299Z [2024-04-05 23:45:12,845: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1f4bfa62-90f8-4dcd-8a6c-0b576dcd55ce] succeeded in 2.2081027089998315s: None 2024-04-05T23:46:00.472330118Z [2024-04-05 23:46:00,471: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[340edf36-ed79-46f9-9aec-b9a59eb12aa0] received 2024-04-05T23:46:00.475151299Z [2024-04-05 23:46:00,474: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c1171d18-67b9-4d76-8348-0fe3b60fc171] received 2024-04-05T23:46:00.477538488Z [2024-04-05 23:46:00,477: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a1a56937-c78b-4e83-9f3b-2c07d3f400be] received 2024-04-05T23:46:00.479398027Z [2024-04-05 23:46:00,479: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e15a2ead-07ad-448f-aa8c-a3efac2145b0] received 2024-04-05T23:46:00.494056320Z [2024-04-05 23:46:00,492: INFO/ForkPoolWorker-16] [c1171d18-67b9-4d76-8348-0fe3b60fc171] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T23:46:00.496835856Z [2024-04-05 23:46:00,496: INFO/ForkPoolWorker-15] [340edf36-ed79-46f9-9aec-b9a59eb12aa0] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T23:46:00.498656719Z [2024-04-05 23:46:00,498: INFO/ForkPoolWorker-2] [e15a2ead-07ad-448f-aa8c-a3efac2145b0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T23:46:00.503787352Z [2024-04-05 23:46:00,497: INFO/ForkPoolWorker-1] [a1a56937-c78b-4e83-9f3b-2c07d3f400be] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T23:46:00.770770442Z [2024-04-05 23:46:00,767: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T23:46:00.823105207Z [2024-04-05 23:46:00,819: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T23:46:00.854201396Z [2024-04-05 23:46:00,850: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-05T23:46:00.892229174Z [2024-04-05 23:46:00,886: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-05T23:46:01.143466811Z [2024-04-05 23:46:01,142: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-05T23:46:01.147454593Z [2024-04-05 23:46:01,146: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:46:01.198851533Z [2024-04-05 23:46:01,198: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T23:46:01.203014924Z [2024-04-05 23:46:01,202: INFO/ForkPoolWorker-16] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-05T23:46:01.203658494Z [2024-04-05 23:46:01,202: INFO/ForkPoolWorker-16] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-05T23:46:01.203793677Z [2024-04-05 23:46:01,203: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-05T23:46:01.204131092Z [2024-04-05 23:46:01,203: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-05T23:46:01.206925817Z [2024-04-05 23:46:01,206: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:46:01.336054620Z [2024-04-05 23:46:01,335: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:46:01.955524790Z [2024-04-05 23:46:01,955: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[340edf36-ed79-46f9-9aec-b9a59eb12aa0] succeeded in 1.4811156259993368s: None 2024-04-05T23:46:02.097038933Z [2024-04-05 23:46:02,096: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c1171d18-67b9-4d76-8348-0fe3b60fc171] succeeded in 1.6162523689999944s: None 2024-04-05T23:46:02.184719256Z [2024-04-05 23:46:02,184: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-05T23:46:02.188820398Z [2024-04-05 23:46:02,188: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:46:02.213217874Z [2024-04-05 23:46:02,212: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-05T23:46:02.215033446Z [2024-04-05 23:46:02,214: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:46:02.215131592Z [2024-04-05 23:46:02,215: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:46:02.216461567Z [2024-04-05 23:46:02,215: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:46:02.216816067Z [2024-04-05 23:46:02,216: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-05T23:46:02.217166105Z [2024-04-05 23:46:02,216: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-05T23:46:02.217311601Z [2024-04-05 23:46:02,217: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:46:02.234799476Z [2024-04-05 23:46:02,234: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-05T23:46:02.239160556Z [2024-04-05 23:46:02,238: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:46:02.274325873Z [2024-04-05 23:46:02,273: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-05T23:46:02.277030341Z [2024-04-05 23:46:02,276: INFO/ForkPoolWorker-2] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:46:02.277088023Z [2024-04-05 23:46:02,276: INFO/ForkPoolWorker-2] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:46:02.277112639Z [2024-04-05 23:46:02,276: INFO/ForkPoolWorker-2] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:46:02.277118014Z [2024-04-05 23:46:02,277: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-05T23:46:02.277443699Z [2024-04-05 23:46:02,277: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T23:46:02.277513917Z [2024-04-05 23:46:02,277: INFO/ForkPoolWorker-2] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:46:02.353509650Z [2024-04-05 23:46:02,352: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:46:02.403572158Z [2024-04-05 23:46:02,403: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:46:04.054338249Z [2024-04-05 23:46:04,053: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[e15a2ead-07ad-448f-aa8c-a3efac2145b0] succeeded in 3.5721988550003516s: None 2024-04-05T23:46:04.414312248Z [2024-04-05 23:46:04,413: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a1a56937-c78b-4e83-9f3b-2c07d3f400be] succeeded in 3.9334099849993436s: None 2024-04-05T23:47:01.255953720Z [2024-04-05 23:47:01,254: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f5ab07c7-522b-480a-8b73-c045c184bba9] received 2024-04-05T23:47:01.260290666Z [2024-04-05 23:47:01,259: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d71e68c0-67bc-4cfb-a16b-2d6f3084e253] received 2024-04-05T23:47:01.275778316Z [2024-04-05 23:47:01,275: INFO/ForkPoolWorker-15] [f5ab07c7-522b-480a-8b73-c045c184bba9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T23:47:01.280242930Z [2024-04-05 23:47:01,279: INFO/ForkPoolWorker-16] [d71e68c0-67bc-4cfb-a16b-2d6f3084e253] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T23:47:01.513147138Z [2024-04-05 23:47:01,512: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[261899c8-ccd4-4ca2-9aa5-60e92250dc67] received 2024-04-05T23:47:01.541826663Z [2024-04-05 23:47:01,541: INFO/ForkPoolWorker-1] [261899c8-ccd4-4ca2-9aa5-60e92250dc67] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T23:47:01.580986950Z [2024-04-05 23:47:01,577: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T23:47:01.584469432Z [2024-04-05 23:47:01,580: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T23:47:01.907642830Z [2024-04-05 23:47:01,903: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-05T23:47:02.080348992Z [2024-04-05 23:47:02,079: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-05T23:47:02.084358317Z [2024-04-05 23:47:02,083: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:47:02.111944982Z [2024-04-05 23:47:02,111: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-05T23:47:02.113246985Z [2024-04-05 23:47:02,113: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-05T23:47:02.113449139Z [2024-04-05 23:47:02,113: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-05T23:47:02.113609324Z [2024-04-05 23:47:02,113: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-05T23:47:02.113955506Z [2024-04-05 23:47:02,113: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-05T23:47:02.218489111Z [2024-04-05 23:47:02,218: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:47:02.778116999Z [2024-04-05 23:47:02,777: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T23:47:02.781974695Z [2024-04-05 23:47:02,781: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:47:02.804246551Z [2024-04-05 23:47:02,803: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T23:47:02.805905245Z [2024-04-05 23:47:02,805: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:47:02.806169567Z [2024-04-05 23:47:02,806: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:47:02.806425698Z [2024-04-05 23:47:02,806: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:47:02.806626531Z [2024-04-05 23:47:02,806: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T23:47:02.806994546Z [2024-04-05 23:47:02,806: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T23:47:02.807595022Z [2024-04-05 23:47:02,807: INFO/ForkPoolWorker-15] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:47:02.847437793Z [2024-04-05 23:47:02,846: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-05T23:47:02.850836507Z [2024-04-05 23:47:02,850: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:47:02.879917146Z [2024-04-05 23:47:02,879: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T23:47:02.881468163Z [2024-04-05 23:47:02,881: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:47:02.881495447Z [2024-04-05 23:47:02,881: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:47:02.881706457Z [2024-04-05 23:47:02,881: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:47:02.881796313Z [2024-04-05 23:47:02,881: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-05T23:47:02.882220091Z [2024-04-05 23:47:02,881: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-05T23:47:02.882338458Z [2024-04-05 23:47:02,882: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:47:02.899454615Z [2024-04-05 23:47:02,898: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[261899c8-ccd4-4ca2-9aa5-60e92250dc67] succeeded in 1.3829584389995944s: None 2024-04-05T23:47:02.904427879Z [2024-04-05 23:47:02,904: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:47:02.980746506Z [2024-04-05 23:47:02,980: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:47:04.502943361Z [2024-04-05 23:47:04,502: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f5ab07c7-522b-480a-8b73-c045c184bba9] succeeded in 3.2428931639997245s: None 2024-04-05T23:47:05.025574490Z [2024-04-05 23:47:05,024: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d71e68c0-67bc-4cfb-a16b-2d6f3084e253] succeeded in 3.7610230699992826s: None 2024-04-05T23:48:01.256109344Z [2024-04-05 23:48:01,255: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2635a865-0633-4b9c-adf1-32d94fc8b929] received 2024-04-05T23:48:01.259494630Z [2024-04-05 23:48:01,259: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[53c9cbb5-2027-4a59-9463-aa58a4a87fa4] received 2024-04-05T23:48:01.265774237Z [2024-04-05 23:48:01,265: INFO/ForkPoolWorker-15] [2635a865-0633-4b9c-adf1-32d94fc8b929] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T23:48:01.277712696Z [2024-04-05 23:48:01,276: INFO/ForkPoolWorker-16] [53c9cbb5-2027-4a59-9463-aa58a4a87fa4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T23:48:01.278132807Z [2024-04-05 23:48:01,277: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2622da52-6129-4793-934b-0a981ac9f234] received 2024-04-05T23:48:01.282299812Z [2024-04-05 23:48:01,282: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a91d3348-f9f0-4526-9ee0-a1f30b595102] received 2024-04-05T23:48:01.296308479Z [2024-04-05 23:48:01,295: INFO/ForkPoolWorker-1] [2622da52-6129-4793-934b-0a981ac9f234] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T23:48:01.296945117Z [2024-04-05 23:48:01,296: INFO/ForkPoolWorker-2] [a91d3348-f9f0-4526-9ee0-a1f30b595102] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T23:48:01.623601638Z [2024-04-05 23:48:01,619: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-05T23:48:01.640517537Z [2024-04-05 23:48:01,631: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-05T23:48:01.655183314Z [2024-04-05 23:48:01,650: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T23:48:01.659033694Z [2024-04-05 23:48:01,655: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T23:48:01.922325097Z [2024-04-05 23:48:01,921: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-05T23:48:01.927801956Z [2024-04-05 23:48:01,927: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:48:01.968828525Z [2024-04-05 23:48:01,968: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-05T23:48:01.970577897Z [2024-04-05 23:48:01,970: INFO/ForkPoolWorker-2] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-05T23:48:01.970812105Z [2024-04-05 23:48:01,970: INFO/ForkPoolWorker-2] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-05T23:48:01.971052593Z [2024-04-05 23:48:01,970: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-05T23:48:01.971419095Z [2024-04-05 23:48:01,971: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-05T23:48:02.045856541Z [2024-04-05 23:48:02,045: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:48:02.274007255Z [2024-04-05 23:48:02,273: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:48:02.841364991Z [2024-04-05 23:48:02,840: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2635a865-0633-4b9c-adf1-32d94fc8b929] succeeded in 1.580574286999763s: None 2024-04-05T23:48:03.049103636Z [2024-04-05 23:48:03,048: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a91d3348-f9f0-4526-9ee0-a1f30b595102] succeeded in 1.7645870679998552s: None 2024-04-05T23:48:03.342972184Z [2024-04-05 23:48:03,342: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-05T23:48:03.346267548Z [2024-04-05 23:48:03,345: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:48:03.371019248Z [2024-04-05 23:48:03,370: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T23:48:03.372731700Z [2024-04-05 23:48:03,372: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:48:03.372748816Z [2024-04-05 23:48:03,372: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:48:03.372888970Z [2024-04-05 23:48:03,372: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:48:03.372916462Z [2024-04-05 23:48:03,372: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-05T23:48:03.373177723Z [2024-04-05 23:48:03,373: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T23:48:03.373270758Z [2024-04-05 23:48:03,373: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:48:03.457502741Z [2024-04-05 23:48:03,457: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-05T23:48:03.460961919Z [2024-04-05 23:48:03,460: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:48:03.467858453Z [2024-04-05 23:48:03,467: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:48:03.501228724Z [2024-04-05 23:48:03,500: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-05T23:48:03.502530450Z [2024-04-05 23:48:03,502: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:48:03.502614585Z [2024-04-05 23:48:03,502: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:48:03.502761551Z [2024-04-05 23:48:03,502: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:48:03.502816611Z [2024-04-05 23:48:03,502: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-05T23:48:03.503168087Z [2024-04-05 23:48:03,503: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-05T23:48:03.503236409Z [2024-04-05 23:48:03,503: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:48:03.631439380Z [2024-04-05 23:48:03,631: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:48:05.466027015Z [2024-04-05 23:48:05,465: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[53c9cbb5-2027-4a59-9463-aa58a4a87fa4] succeeded in 4.1987638399996285s: None 2024-04-05T23:48:06.725754694Z [2024-04-05 23:48:06,725: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2622da52-6129-4793-934b-0a981ac9f234] succeeded in 5.4445034890004536s: None 2024-04-05T23:49:01.140189721Z [2024-04-05 23:49:01,139: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9bd79745-8852-4dbb-bc8d-1dfd57e00e57] received 2024-04-05T23:49:01.173812511Z [2024-04-05 23:49:01,173: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[60d0c99e-35f6-47dd-a991-165bf028589c] received 2024-04-05T23:49:01.181704614Z [2024-04-05 23:49:01,180: INFO/ForkPoolWorker-15] [9bd79745-8852-4dbb-bc8d-1dfd57e00e57] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T23:49:01.189225562Z [2024-04-05 23:49:01,188: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bc2f0604-3ed8-4674-a95d-69c43cbe890a] received 2024-04-05T23:49:01.198790381Z [2024-04-05 23:49:01,188: INFO/ForkPoolWorker-16] [60d0c99e-35f6-47dd-a991-165bf028589c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T23:49:01.204166043Z [2024-04-05 23:49:01,203: INFO/ForkPoolWorker-1] [bc2f0604-3ed8-4674-a95d-69c43cbe890a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T23:49:01.579935131Z [2024-04-05 23:49:01,576: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-05T23:49:01.793028970Z [2024-04-05 23:49:01,792: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-05T23:49:01.797530312Z [2024-04-05 23:49:01,796: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:49:01.873797555Z [2024-04-05 23:49:01,867: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T23:49:01.879469462Z [2024-04-05 23:49:01,874: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-05T23:49:01.889864618Z [2024-04-05 23:49:01,889: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-05T23:49:01.889934002Z [2024-04-05 23:49:01,889: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-05T23:49:01.889981413Z [2024-04-05 23:49:01,889: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-05T23:49:01.890460601Z [2024-04-05 23:49:01,889: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-05T23:49:02.008474966Z [2024-04-05 23:49:02,003: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T23:49:02.093367631Z [2024-04-05 23:49:02,093: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:49:03.024860113Z [2024-04-05 23:49:03,024: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[bc2f0604-3ed8-4674-a95d-69c43cbe890a] succeeded in 1.8346482709994234s: None 2024-04-05T23:49:04.574180400Z [2024-04-05 23:49:04,573: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T23:49:04.619458703Z [2024-04-05 23:49:04,618: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:49:04.904150297Z [2024-04-05 23:49:04,903: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T23:49:04.907850189Z [2024-04-05 23:49:04,907: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:49:04.907967727Z [2024-04-05 23:49:04,907: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:49:04.908236792Z [2024-04-05 23:49:04,907: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:49:04.908309310Z [2024-04-05 23:49:04,908: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T23:49:04.909392385Z [2024-04-05 23:49:04,908: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-05T23:49:04.910161546Z [2024-04-05 23:49:04,909: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:49:05.068699487Z [2024-04-05 23:49:05,068: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-05T23:49:05.075511595Z [2024-04-05 23:49:05,074: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:49:05.130861411Z [2024-04-05 23:49:05,130: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T23:49:05.133502286Z [2024-04-05 23:49:05,133: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:49:05.133553669Z [2024-04-05 23:49:05,133: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:49:05.133765374Z [2024-04-05 23:49:05,133: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:49:05.133832515Z [2024-04-05 23:49:05,133: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-05T23:49:05.134190825Z [2024-04-05 23:49:05,134: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T23:49:05.134226137Z [2024-04-05 23:49:05,134: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:49:05.181774407Z [2024-04-05 23:49:05,181: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:49:05.359519635Z [2024-04-05 23:49:05,359: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:49:07.659448529Z [2024-04-05 23:49:07,655: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[60d0c99e-35f6-47dd-a991-165bf028589c] succeeded in 6.478717218000384s: None 2024-04-05T23:49:07.861397237Z [2024-04-05 23:49:07,860: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9bd79745-8852-4dbb-bc8d-1dfd57e00e57] succeeded in 6.697560814999633s: None 2024-04-05T23:50:01.132069771Z [2024-04-05 23:50:01,131: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4b0f790f-4174-46aa-9db0-2e73eb660317] received 2024-04-05T23:50:01.134320417Z [2024-04-05 23:50:01,134: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[327e36b3-cd39-4a66-891d-6edd4b0b8ce2] received 2024-04-05T23:50:01.136805377Z [2024-04-05 23:50:01,136: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2f75f2e5-f9f5-49f8-8d59-a0e8908c668d] received 2024-04-05T23:50:01.141138174Z [2024-04-05 23:50:01,140: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9598d276-e832-400a-a084-2c553b423a3c] received 2024-04-05T23:50:01.148508131Z [2024-04-05 23:50:01,148: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[31008321-1f30-4d57-8b4d-20796cbd99fc] received 2024-04-05T23:50:01.160824387Z [2024-04-05 23:50:01,160: INFO/ForkPoolWorker-16] [327e36b3-cd39-4a66-891d-6edd4b0b8ce2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T23:50:01.161065663Z [2024-04-05 23:50:01,160: INFO/ForkPoolWorker-2] [9598d276-e832-400a-a084-2c553b423a3c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T23:50:01.161286910Z [2024-04-05 23:50:01,160: INFO/ForkPoolWorker-15] [4b0f790f-4174-46aa-9db0-2e73eb660317] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T23:50:01.172242033Z [2024-04-05 23:50:01,165: INFO/ForkPoolWorker-1] [2f75f2e5-f9f5-49f8-8d59-a0e8908c668d] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T23:50:01.181217379Z [2024-04-05 23:50:01,180: INFO/ForkPoolWorker-3] [31008321-1f30-4d57-8b4d-20796cbd99fc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T23:50:01.949811613Z [2024-04-05 23:50:01,945: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T23:50:02.065822701Z [2024-04-05 23:50:02,060: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-05T23:50:02.076169856Z [2024-04-05 23:50:02,072: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T23:50:02.092738653Z [2024-04-05 23:50:02,084: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T23:50:02.146900740Z [2024-04-05 23:50:02,141: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-05T23:50:02.339166386Z [2024-04-05 23:50:02,338: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-05T23:50:02.344319949Z [2024-04-05 23:50:02,343: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:50:02.400284947Z [2024-04-05 23:50:02,400: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T23:50:02.404008781Z [2024-04-05 23:50:02,403: INFO/ForkPoolWorker-15] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-05T23:50:02.404088016Z [2024-04-05 23:50:02,403: INFO/ForkPoolWorker-15] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-05T23:50:02.404095961Z [2024-04-05 23:50:02,404: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-05T23:50:02.404335630Z [2024-04-05 23:50:02,404: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-05T23:50:02.553474608Z [2024-04-05 23:50:02,553: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:50:02.572929845Z [2024-04-05 23:50:02,572: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:50:03.462933185Z [2024-04-05 23:50:03,462: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2f75f2e5-f9f5-49f8-8d59-a0e8908c668d] succeeded in 2.322262851999767s: None 2024-04-05T23:50:03.603198050Z [2024-04-05 23:50:03,602: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4b0f790f-4174-46aa-9db0-2e73eb660317] succeeded in 2.4676914350002335s: None 2024-04-05T23:50:04.057348003Z [2024-04-05 23:50:04,056: INFO/ForkPoolWorker-3] Getting VIM list 2024-04-05T23:50:04.060906606Z [2024-04-05 23:50:04,060: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:50:04.092533948Z [2024-04-05 23:50:04,092: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-05T23:50:04.094977595Z [2024-04-05 23:50:04,094: INFO/ForkPoolWorker-3] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:50:04.095033552Z [2024-04-05 23:50:04,094: INFO/ForkPoolWorker-3] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:50:04.095125402Z [2024-04-05 23:50:04,094: INFO/ForkPoolWorker-3] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:50:04.095167971Z [2024-04-05 23:50:04,095: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-04-05T23:50:04.096157925Z [2024-04-05 23:50:04,095: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-04-05T23:50:04.096207600Z [2024-04-05 23:50:04,096: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:50:04.276380512Z [2024-04-05 23:50:04,276: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:50:04.301657184Z [2024-04-05 23:50:04,301: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-05T23:50:04.305218882Z [2024-04-05 23:50:04,304: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:50:04.374345053Z [2024-04-05 23:50:04,373: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-05T23:50:04.397720687Z [2024-04-05 23:50:04,397: INFO/ForkPoolWorker-2] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:50:04.397750694Z [2024-04-05 23:50:04,397: INFO/ForkPoolWorker-2] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:50:04.397835532Z [2024-04-05 23:50:04,397: INFO/ForkPoolWorker-2] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:50:04.401254463Z [2024-04-05 23:50:04,397: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-05T23:50:04.401519457Z [2024-04-05 23:50:04,401: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T23:50:04.401553384Z [2024-04-05 23:50:04,401: INFO/ForkPoolWorker-2] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:50:04.603248362Z [2024-04-05 23:50:04,595: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:50:04.665809780Z [2024-04-05 23:50:04,665: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-05T23:50:04.686457196Z [2024-04-05 23:50:04,685: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:50:04.762930454Z [2024-04-05 23:50:04,762: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T23:50:04.771683866Z [2024-04-05 23:50:04,771: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:50:04.771738361Z [2024-04-05 23:50:04,771: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:50:04.772343834Z [2024-04-05 23:50:04,771: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:50:04.772798081Z [2024-04-05 23:50:04,772: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-05T23:50:04.774402172Z [2024-04-05 23:50:04,774: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T23:50:04.775461506Z [2024-04-05 23:50:04,774: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:50:04.914542110Z [2024-04-05 23:50:04,914: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:50:05.588603700Z [2024-04-05 23:50:05,588: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[327e36b3-cd39-4a66-891d-6edd4b0b8ce2] succeeded in 4.4475406229994405s: None 2024-04-05T23:50:06.023796419Z [2024-04-05 23:50:06,023: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2840587c-1a9d-43df-8427-f2ae5bfd17db] received 2024-04-05T23:50:06.036350421Z [2024-04-05 23:50:06,035: INFO/ForkPoolWorker-15] [2840587c-1a9d-43df-8427-f2ae5bfd17db] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'split_metrics', 'scheduled__2024-04-05T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T23:50:06.386044740Z [2024-04-05 23:50:06,382: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T23:50:06.812462784Z [2024-04-05 23:50:06,811: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[9598d276-e832-400a-a084-2c553b423a3c] succeeded in 5.664501962999566s: None 2024-04-05T23:50:07.278100877Z [2024-04-05 23:50:07,277: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[31008321-1f30-4d57-8b4d-20796cbd99fc] succeeded in 6.113924632999442s: None 2024-04-05T23:50:07.634693205Z [2024-04-05 23:50:07,634: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T23:50:07.638192927Z [2024-04-05 23:50:07,637: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:50:07.658373480Z [2024-04-05 23:50:07,658: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T23:50:07.659681369Z [2024-04-05 23:50:07,659: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:50:07.659779756Z [2024-04-05 23:50:07,659: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:50:07.659910774Z [2024-04-05 23:50:07,659: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:50:07.659998872Z [2024-04-05 23:50:07,659: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T23:50:07.660271923Z [2024-04-05 23:50:07,660: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T23:50:07.660680104Z [2024-04-05 23:50:07,660: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:50:07.759568300Z [2024-04-05 23:50:07,759: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:50:08.521306809Z [2024-04-05 23:50:08,520: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2840587c-1a9d-43df-8427-f2ae5bfd17db] succeeded in 2.4951580770002693s: None 2024-04-05T23:50:08.607193160Z [2024-04-05 23:50:08,606: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[454c971f-09db-416b-80d0-825f42fe340b] received 2024-04-05T23:50:08.613887380Z [2024-04-05 23:50:08,613: INFO/ForkPoolWorker-15] [454c971f-09db-416b-80d0-825f42fe340b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'collect_metrics', 'scheduled__2024-04-05T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T23:50:08.893170267Z [2024-04-05 23:50:08,889: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T23:50:10.166089781Z [2024-04-05 23:50:10,165: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T23:50:10.169859351Z [2024-04-05 23:50:10,169: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:50:10.191577940Z [2024-04-05 23:50:10,191: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T23:50:10.195861172Z [2024-04-05 23:50:10,195: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:50:10.195931295Z [2024-04-05 23:50:10,195: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:50:10.196100807Z [2024-04-05 23:50:10,195: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:50:10.196149604Z [2024-04-05 23:50:10,196: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T23:50:10.196544880Z [2024-04-05 23:50:10,196: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T23:50:10.196660448Z [2024-04-05 23:50:10,196: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:50:10.288805840Z [2024-04-05 23:50:10,288: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:50:10.878878240Z [2024-04-05 23:50:10,878: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[454c971f-09db-416b-80d0-825f42fe340b] succeeded in 2.2698623169999337s: None 2024-04-05T23:50:11.257036461Z [2024-04-05 23:50:11,256: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7a4026c6-a3b3-489d-af54-2016511c0841] received 2024-04-05T23:50:11.266299492Z [2024-04-05 23:50:11,266: INFO/ForkPoolWorker-15] [7a4026c6-a3b3-489d-af54-2016511c0841] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'send_prometheus', 'scheduled__2024-04-05T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T23:50:11.536064588Z [2024-04-05 23:50:11,532: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T23:50:12.833644419Z [2024-04-05 23:50:12,833: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T23:50:12.836904049Z [2024-04-05 23:50:12,836: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:50:12.860139881Z [2024-04-05 23:50:12,859: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T23:50:12.861581095Z [2024-04-05 23:50:12,861: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:50:12.861863400Z [2024-04-05 23:50:12,861: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:50:12.862077272Z [2024-04-05 23:50:12,861: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:50:12.862261880Z [2024-04-05 23:50:12,862: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T23:50:12.862687878Z [2024-04-05 23:50:12,862: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T23:50:12.862857419Z [2024-04-05 23:50:12,862: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:50:12.965006031Z [2024-04-05 23:50:12,964: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:50:13.662240261Z [2024-04-05 23:50:13,661: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7a4026c6-a3b3-489d-af54-2016511c0841] succeeded in 2.4027220279995163s: None 2024-04-05T23:51:01.137823944Z [2024-04-05 23:51:01,137: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3c969f2c-47ab-459e-a727-f0d18257a4a1] received 2024-04-05T23:51:01.140098024Z [2024-04-05 23:51:01,139: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2b435ca9-1e5d-4484-b1d5-b784f5200959] received 2024-04-05T23:51:01.141719386Z [2024-04-05 23:51:01,141: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[88768a57-0d49-4fa6-a55f-49d963063ca8] received 2024-04-05T23:51:01.153818927Z [2024-04-05 23:51:01,153: INFO/ForkPoolWorker-15] [3c969f2c-47ab-459e-a727-f0d18257a4a1] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T23:51:01.160914673Z [2024-04-05 23:51:01,160: INFO/ForkPoolWorker-1] [88768a57-0d49-4fa6-a55f-49d963063ca8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T23:51:01.162654326Z [2024-04-05 23:51:01,162: INFO/ForkPoolWorker-16] [2b435ca9-1e5d-4484-b1d5-b784f5200959] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T23:51:01.455549167Z [2024-04-05 23:51:01,451: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T23:51:01.455586634Z [2024-04-05 23:51:01,452: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T23:51:01.518122084Z [2024-04-05 23:51:01,514: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-05T23:51:01.678338027Z [2024-04-05 23:51:01,677: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-05T23:51:01.682817926Z [2024-04-05 23:51:01,682: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:51:01.724403967Z [2024-04-05 23:51:01,724: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T23:51:01.728455674Z [2024-04-05 23:51:01,728: INFO/ForkPoolWorker-15] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-05T23:51:01.728710514Z [2024-04-05 23:51:01,728: INFO/ForkPoolWorker-15] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-05T23:51:01.729195122Z [2024-04-05 23:51:01,728: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-05T23:51:01.729691351Z [2024-04-05 23:51:01,729: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-05T23:51:01.836483942Z [2024-04-05 23:51:01,836: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:51:02.540896942Z [2024-04-05 23:51:02,540: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3c969f2c-47ab-459e-a727-f0d18257a4a1] succeeded in 1.3997227500003646s: None 2024-04-05T23:51:02.832572232Z [2024-04-05 23:51:02,832: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-05T23:51:02.838518804Z [2024-04-05 23:51:02,838: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:51:02.879033849Z [2024-04-05 23:51:02,878: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-05T23:51:02.880717751Z [2024-04-05 23:51:02,880: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:51:02.880947112Z [2024-04-05 23:51:02,880: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:51:02.881111640Z [2024-04-05 23:51:02,880: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:51:02.881214203Z [2024-04-05 23:51:02,881: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-05T23:51:02.881639407Z [2024-04-05 23:51:02,881: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-05T23:51:02.881772958Z [2024-04-05 23:51:02,881: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:51:02.916992549Z [2024-04-05 23:51:02,916: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-05T23:51:02.923561992Z [2024-04-05 23:51:02,922: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:51:02.961364418Z [2024-04-05 23:51:02,961: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T23:51:02.962917027Z [2024-04-05 23:51:02,962: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:51:02.962972958Z [2024-04-05 23:51:02,962: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:51:02.963088038Z [2024-04-05 23:51:02,962: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:51:02.963118021Z [2024-04-05 23:51:02,963: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-05T23:51:02.963384054Z [2024-04-05 23:51:02,963: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T23:51:02.963412622Z [2024-04-05 23:51:02,963: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:51:02.981453186Z [2024-04-05 23:51:02,981: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:51:03.082931543Z [2024-04-05 23:51:03,082: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:51:04.936558017Z [2024-04-05 23:51:04,936: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2b435ca9-1e5d-4484-b1d5-b784f5200959] succeeded in 3.789486781999585s: None 2024-04-05T23:51:05.505964459Z [2024-04-05 23:51:05,505: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[88768a57-0d49-4fa6-a55f-49d963063ca8] succeeded in 4.3582378789997165s: None 2024-04-05T23:52:00.596789625Z [2024-04-05 23:52:00,596: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[23706900-3b10-48fd-9f4f-0e885ff5f68b] received 2024-04-05T23:52:00.600078398Z [2024-04-05 23:52:00,599: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7a3e5b58-f618-4856-93c4-a7781b580d4f] received 2024-04-05T23:52:00.603955062Z [2024-04-05 23:52:00,603: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1bfd005c-055e-4da0-b529-4b9ecbae4d07] received 2024-04-05T23:52:00.607440117Z [2024-04-05 23:52:00,606: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c2b44552-ea37-4769-b71e-7aa1e4ac1cf2] received 2024-04-05T23:52:00.611519101Z [2024-04-05 23:52:00,611: INFO/ForkPoolWorker-1] [1bfd005c-055e-4da0-b529-4b9ecbae4d07] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T23:52:00.616347677Z [2024-04-05 23:52:00,615: INFO/ForkPoolWorker-15] [23706900-3b10-48fd-9f4f-0e885ff5f68b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T23:52:00.619839673Z [2024-04-05 23:52:00,619: INFO/ForkPoolWorker-2] [c2b44552-ea37-4769-b71e-7aa1e4ac1cf2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T23:52:00.620843357Z [2024-04-05 23:52:00,620: INFO/ForkPoolWorker-16] [7a3e5b58-f618-4856-93c4-a7781b580d4f] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T23:52:00.927967740Z [2024-04-05 23:52:00,921: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T23:52:01.022369707Z [2024-04-05 23:52:01,018: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-05T23:52:01.038459976Z [2024-04-05 23:52:01,034: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T23:52:01.137263488Z [2024-04-05 23:52:01,131: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-05T23:52:01.343213033Z [2024-04-05 23:52:01,342: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:52:01.348011941Z [2024-04-05 23:52:01,347: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-05T23:52:01.352476508Z [2024-04-05 23:52:01,351: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:52:01.385794590Z [2024-04-05 23:52:01,385: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-05T23:52:01.387542634Z [2024-04-05 23:52:01,387: INFO/ForkPoolWorker-2] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-05T23:52:01.387856356Z [2024-04-05 23:52:01,387: INFO/ForkPoolWorker-2] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-05T23:52:01.387989126Z [2024-04-05 23:52:01,387: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-05T23:52:01.388253731Z [2024-04-05 23:52:01,388: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-05T23:52:01.504752845Z [2024-04-05 23:52:01,504: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:52:01.969999669Z [2024-04-05 23:52:01,969: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7a3e5b58-f618-4856-93c4-a7781b580d4f] succeeded in 1.367153991000123s: None 2024-04-05T23:52:02.190447353Z [2024-04-05 23:52:02,189: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[c2b44552-ea37-4769-b71e-7aa1e4ac1cf2] succeeded in 1.5798910860003161s: None 2024-04-05T23:52:02.224164336Z [2024-04-05 23:52:02,223: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T23:52:02.227630099Z [2024-04-05 23:52:02,227: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:52:02.255238770Z [2024-04-05 23:52:02,254: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T23:52:02.259214197Z [2024-04-05 23:52:02,258: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:52:02.259242928Z [2024-04-05 23:52:02,259: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:52:02.259478273Z [2024-04-05 23:52:02,259: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:52:02.259563433Z [2024-04-05 23:52:02,259: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T23:52:02.260140915Z [2024-04-05 23:52:02,259: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-05T23:52:02.260165693Z [2024-04-05 23:52:02,260: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:52:02.341684796Z [2024-04-05 23:52:02,341: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:52:02.501061499Z [2024-04-05 23:52:02,500: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-05T23:52:02.504363325Z [2024-04-05 23:52:02,503: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:52:02.526385380Z [2024-04-05 23:52:02,526: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-05T23:52:02.528002147Z [2024-04-05 23:52:02,527: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:52:02.528176548Z [2024-04-05 23:52:02,527: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:52:02.528390939Z [2024-04-05 23:52:02,528: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:52:02.528552049Z [2024-04-05 23:52:02,528: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-05T23:52:02.528882197Z [2024-04-05 23:52:02,528: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T23:52:02.529160878Z [2024-04-05 23:52:02,528: INFO/ForkPoolWorker-1] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:52:02.618989360Z [2024-04-05 23:52:02,618: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:52:04.251184635Z [2024-04-05 23:52:04,250: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[23706900-3b10-48fd-9f4f-0e885ff5f68b] succeeded in 3.6494983219999995s: None 2024-04-05T23:52:04.540809397Z [2024-04-05 23:52:04,540: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1bfd005c-055e-4da0-b529-4b9ecbae4d07] succeeded in 3.935193387000254s: None 2024-04-05T23:53:01.065006033Z [2024-04-05 23:53:01,064: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f2d80cae-bed7-4520-b9b8-437aa607d88d] received 2024-04-05T23:53:01.070033779Z [2024-04-05 23:53:01,069: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4004e3c7-29d5-45ef-8ae0-3614a85b9d86] received 2024-04-05T23:53:01.074402943Z [2024-04-05 23:53:01,074: INFO/ForkPoolWorker-15] [f2d80cae-bed7-4520-b9b8-437aa607d88d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T23:53:01.078708995Z [2024-04-05 23:53:01,076: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ebf3acfa-25d2-4bff-8df1-6b2eefc8b8a8] received 2024-04-05T23:53:01.088609411Z [2024-04-05 23:53:01,086: INFO/ForkPoolWorker-16] [4004e3c7-29d5-45ef-8ae0-3614a85b9d86] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T23:53:01.093748669Z [2024-04-05 23:53:01,093: INFO/ForkPoolWorker-1] [ebf3acfa-25d2-4bff-8df1-6b2eefc8b8a8] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T23:53:01.434599229Z [2024-04-05 23:53:01,430: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T23:53:01.454892615Z [2024-04-05 23:53:01,450: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T23:53:01.465458629Z [2024-04-05 23:53:01,460: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-05T23:53:01.649923339Z [2024-04-05 23:53:01,648: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-05T23:53:01.654974755Z [2024-04-05 23:53:01,654: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:53:01.682099265Z [2024-04-05 23:53:01,681: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-05T23:53:01.683506470Z [2024-04-05 23:53:01,683: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-05T23:53:01.683678236Z [2024-04-05 23:53:01,683: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-05T23:53:01.683770014Z [2024-04-05 23:53:01,683: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-05T23:53:01.684097733Z [2024-04-05 23:53:01,683: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-05T23:53:01.781860325Z [2024-04-05 23:53:01,781: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:53:02.442511268Z [2024-04-05 23:53:02,442: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ebf3acfa-25d2-4bff-8df1-6b2eefc8b8a8] succeeded in 1.3591563850004604s: None 2024-04-05T23:53:02.784465565Z [2024-04-05 23:53:02,784: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-05T23:53:02.788477468Z [2024-04-05 23:53:02,787: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:53:02.816962362Z [2024-04-05 23:53:02,816: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T23:53:02.818647303Z [2024-04-05 23:53:02,818: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:53:02.818817316Z [2024-04-05 23:53:02,818: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:53:02.819039717Z [2024-04-05 23:53:02,818: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:53:02.819158039Z [2024-04-05 23:53:02,819: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-05T23:53:02.819843144Z [2024-04-05 23:53:02,819: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-05T23:53:02.820079353Z [2024-04-05 23:53:02,819: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:53:02.846491570Z [2024-04-05 23:53:02,846: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T23:53:02.850111868Z [2024-04-05 23:53:02,849: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:53:02.878760710Z [2024-04-05 23:53:02,878: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T23:53:02.880399446Z [2024-04-05 23:53:02,880: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:53:02.880464866Z [2024-04-05 23:53:02,880: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:53:02.880611709Z [2024-04-05 23:53:02,880: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:53:02.880697107Z [2024-04-05 23:53:02,880: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T23:53:02.880974910Z [2024-04-05 23:53:02,880: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T23:53:02.880993324Z [2024-04-05 23:53:02,880: INFO/ForkPoolWorker-15] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:53:02.919765912Z [2024-04-05 23:53:02,919: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:53:02.973020113Z [2024-04-05 23:53:02,972: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:53:04.758284752Z [2024-04-05 23:53:04,757: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f2d80cae-bed7-4520-b9b8-437aa607d88d] succeeded in 3.690627984999992s: None 2024-04-05T23:53:05.182256184Z [2024-04-05 23:53:05,181: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4004e3c7-29d5-45ef-8ae0-3614a85b9d86] succeeded in 4.108727539000029s: None 2024-04-05T23:54:00.546426620Z [2024-04-05 23:54:00,545: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e6e6ce08-88f7-40fe-8d23-cab5fa5af9a3] received 2024-04-05T23:54:00.550237785Z [2024-04-05 23:54:00,549: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e6b7cab8-e2bf-4156-8869-7a0a10cbef9c] received 2024-04-05T23:54:00.554362319Z [2024-04-05 23:54:00,554: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9b830039-5f3a-43d2-9498-1daf5fbc2455] received 2024-04-05T23:54:00.557957766Z [2024-04-05 23:54:00,557: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aaf09f86-11df-4fe0-b379-e2e1fcbf4c99] received 2024-04-05T23:54:00.571081812Z [2024-04-05 23:54:00,570: INFO/ForkPoolWorker-2] [aaf09f86-11df-4fe0-b379-e2e1fcbf4c99] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T23:54:00.574357220Z [2024-04-05 23:54:00,574: INFO/ForkPoolWorker-15] [e6e6ce08-88f7-40fe-8d23-cab5fa5af9a3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T23:54:00.575858040Z [2024-04-05 23:54:00,575: INFO/ForkPoolWorker-16] [e6b7cab8-e2bf-4156-8869-7a0a10cbef9c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T23:54:00.579472008Z [2024-04-05 23:54:00,579: INFO/ForkPoolWorker-1] [9b830039-5f3a-43d2-9498-1daf5fbc2455] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T23:54:00.938489141Z [2024-04-05 23:54:00,934: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T23:54:00.967572997Z [2024-04-05 23:54:00,964: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T23:54:01.053537885Z [2024-04-05 23:54:01,049: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-05T23:54:01.071086062Z [2024-04-05 23:54:01,067: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-05T23:54:01.263194616Z [2024-04-05 23:54:01,262: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-05T23:54:01.268040003Z [2024-04-05 23:54:01,267: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:54:01.319499486Z [2024-04-05 23:54:01,319: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T23:54:01.322723576Z [2024-04-05 23:54:01,322: INFO/ForkPoolWorker-16] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-05T23:54:01.323046939Z [2024-04-05 23:54:01,322: INFO/ForkPoolWorker-16] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-05T23:54:01.323244979Z [2024-04-05 23:54:01,323: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-05T23:54:01.323720910Z [2024-04-05 23:54:01,323: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-05T23:54:01.325984034Z [2024-04-05 23:54:01,325: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:54:01.473420452Z [2024-04-05 23:54:01,473: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:54:02.026452935Z [2024-04-05 23:54:02,025: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9b830039-5f3a-43d2-9498-1daf5fbc2455] succeeded in 1.468640434000008s: None 2024-04-05T23:54:02.150484810Z [2024-04-05 23:54:02,150: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e6b7cab8-e2bf-4156-8869-7a0a10cbef9c] succeeded in 1.591156205000516s: None 2024-04-05T23:54:02.309786351Z [2024-04-05 23:54:02,309: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-05T23:54:02.313243995Z [2024-04-05 23:54:02,312: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:54:02.334558431Z [2024-04-05 23:54:02,334: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T23:54:02.338056766Z [2024-04-05 23:54:02,337: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:54:02.344481658Z [2024-04-05 23:54:02,344: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-05T23:54:02.346667506Z [2024-04-05 23:54:02,346: INFO/ForkPoolWorker-2] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:54:02.346822073Z [2024-04-05 23:54:02,346: INFO/ForkPoolWorker-2] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:54:02.347046044Z [2024-04-05 23:54:02,346: INFO/ForkPoolWorker-2] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:54:02.347234842Z [2024-04-05 23:54:02,347: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-05T23:54:02.347683124Z [2024-04-05 23:54:02,347: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-05T23:54:02.347854159Z [2024-04-05 23:54:02,347: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:54:02.369127875Z [2024-04-05 23:54:02,367: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T23:54:02.370147063Z [2024-04-05 23:54:02,369: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:54:02.370202821Z [2024-04-05 23:54:02,370: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:54:02.370375565Z [2024-04-05 23:54:02,370: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:54:02.370437982Z [2024-04-05 23:54:02,370: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T23:54:02.370889062Z [2024-04-05 23:54:02,370: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T23:54:02.371034656Z [2024-04-05 23:54:02,370: INFO/ForkPoolWorker-15] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:54:02.458720289Z [2024-04-05 23:54:02,458: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:54:02.484539793Z [2024-04-05 23:54:02,484: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:54:03.965025336Z [2024-04-05 23:54:03,964: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e6e6ce08-88f7-40fe-8d23-cab5fa5af9a3] succeeded in 3.407954479000182s: None 2024-04-05T23:54:04.503567056Z [2024-04-05 23:54:04,502: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[aaf09f86-11df-4fe0-b379-e2e1fcbf4c99] succeeded in 3.942021226000179s: None 2024-04-05T23:55:00.406207394Z [2024-04-05 23:55:00,405: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2521e702-ccec-430c-8270-45a2f02f63ab] received 2024-04-05T23:55:00.416260453Z [2024-04-05 23:55:00,415: INFO/ForkPoolWorker-15] [2521e702-ccec-430c-8270-45a2f02f63ab] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T23:55:00.419689966Z [2024-04-05 23:55:00,415: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eb547268-823d-44f0-924a-cf129156a261] received 2024-04-05T23:55:00.426794284Z [2024-04-05 23:55:00,426: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0e5f0dad-c235-42d9-9b13-de428ce6f5c0] received 2024-04-05T23:55:00.430173247Z [2024-04-05 23:55:00,429: INFO/ForkPoolWorker-16] [eb547268-823d-44f0-924a-cf129156a261] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T23:55:00.435209673Z [2024-04-05 23:55:00,434: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3d7bc623-ed65-4ca3-a1b1-118c607f143b] received 2024-04-05T23:55:00.453268340Z [2024-04-05 23:55:00,452: INFO/ForkPoolWorker-1] [0e5f0dad-c235-42d9-9b13-de428ce6f5c0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T23:55:00.458339948Z [2024-04-05 23:55:00,458: INFO/ForkPoolWorker-2] [3d7bc623-ed65-4ca3-a1b1-118c607f143b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T23:55:00.724758483Z [2024-04-05 23:55:00,721: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-05T23:55:00.822573398Z [2024-04-05 23:55:00,819: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T23:55:00.863031491Z [2024-04-05 23:55:00,859: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T23:55:00.878496226Z [2024-04-05 23:55:00,873: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T23:55:00.940197879Z [2024-04-05 23:55:00,939: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-05T23:55:00.944162455Z [2024-04-05 23:55:00,943: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:55:00.978347896Z [2024-04-05 23:55:00,978: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T23:55:00.979953653Z [2024-04-05 23:55:00,979: INFO/ForkPoolWorker-16] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-05T23:55:00.980010239Z [2024-04-05 23:55:00,979: INFO/ForkPoolWorker-16] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-05T23:55:00.980589601Z [2024-04-05 23:55:00,979: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-05T23:55:00.980800283Z [2024-04-05 23:55:00,980: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-05T23:55:01.114964233Z [2024-04-05 23:55:01,114: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:55:01.730135703Z [2024-04-05 23:55:01,729: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[eb547268-823d-44f0-924a-cf129156a261] succeeded in 1.308477380000113s: None 2024-04-05T23:55:02.184632228Z [2024-04-05 23:55:02,184: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-05T23:55:02.188559304Z [2024-04-05 23:55:02,188: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:55:02.212491655Z [2024-04-05 23:55:02,212: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-05T23:55:02.214799067Z [2024-04-05 23:55:02,214: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:55:02.214936326Z [2024-04-05 23:55:02,214: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:55:02.215544190Z [2024-04-05 23:55:02,215: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:55:02.215729029Z [2024-04-05 23:55:02,215: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-05T23:55:02.216213624Z [2024-04-05 23:55:02,216: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T23:55:02.216233003Z [2024-04-05 23:55:02,216: INFO/ForkPoolWorker-1] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:55:02.235053550Z [2024-04-05 23:55:02,234: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T23:55:02.238830814Z [2024-04-05 23:55:02,238: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:55:02.272976468Z [2024-04-05 23:55:02,272: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T23:55:02.280697723Z [2024-04-05 23:55:02,280: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:55:02.280807079Z [2024-04-05 23:55:02,280: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:55:02.280846882Z [2024-04-05 23:55:02,280: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:55:02.280940320Z [2024-04-05 23:55:02,280: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T23:55:02.281322630Z [2024-04-05 23:55:02,281: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T23:55:02.281444119Z [2024-04-05 23:55:02,281: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:55:02.303465749Z [2024-04-05 23:55:02,303: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:55:02.323550576Z [2024-04-05 23:55:02,323: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-05T23:55:02.327092680Z [2024-04-05 23:55:02,326: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:55:02.368982963Z [2024-04-05 23:55:02,368: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-05T23:55:02.376540370Z [2024-04-05 23:55:02,376: INFO/ForkPoolWorker-2] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:55:02.376581879Z [2024-04-05 23:55:02,376: INFO/ForkPoolWorker-2] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:55:02.376640219Z [2024-04-05 23:55:02,376: INFO/ForkPoolWorker-2] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:55:02.376675541Z [2024-04-05 23:55:02,376: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-05T23:55:02.376996967Z [2024-04-05 23:55:02,376: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-05T23:55:02.377032829Z [2024-04-05 23:55:02,376: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:55:02.413476565Z [2024-04-05 23:55:02,413: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:55:02.497820966Z [2024-04-05 23:55:02,497: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:55:03.065529404Z [2024-04-05 23:55:03,065: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2521e702-ccec-430c-8270-45a2f02f63ab] succeeded in 2.6566220520007846s: None 2024-04-05T23:55:03.187012404Z [2024-04-05 23:55:03,186: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5d63bf37-c20b-4294-9b29-057c7f14b238] received 2024-04-05T23:55:03.202338993Z [2024-04-05 23:55:03,201: INFO/ForkPoolWorker-15] [5d63bf37-c20b-4294-9b29-057c7f14b238] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'split_metrics', 'scheduled__2024-04-05T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T23:55:03.477383969Z [2024-04-05 23:55:03,473: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T23:55:03.820745288Z [2024-04-05 23:55:03,820: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0e5f0dad-c235-42d9-9b13-de428ce6f5c0] succeeded in 3.3838699070001894s: None 2024-04-05T23:55:04.576928057Z [2024-04-05 23:55:04,576: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[3d7bc623-ed65-4ca3-a1b1-118c607f143b] succeeded in 4.134848611000052s: None 2024-04-05T23:55:04.906776010Z [2024-04-05 23:55:04,906: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T23:55:04.910122294Z [2024-04-05 23:55:04,909: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:55:04.945213459Z [2024-04-05 23:55:04,944: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T23:55:04.946513496Z [2024-04-05 23:55:04,946: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:55:04.946574962Z [2024-04-05 23:55:04,946: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:55:04.946788595Z [2024-04-05 23:55:04,946: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:55:04.946806286Z [2024-04-05 23:55:04,946: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T23:55:04.947203218Z [2024-04-05 23:55:04,946: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T23:55:04.947334427Z [2024-04-05 23:55:04,947: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:55:05.058505171Z [2024-04-05 23:55:05,058: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:55:05.676256479Z [2024-04-05 23:55:05,675: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[50efb401-abf9-4264-83b4-b594a534cf40] received 2024-04-05T23:55:05.693662721Z [2024-04-05 23:55:05,693: INFO/ForkPoolWorker-16] [50efb401-abf9-4264-83b4-b594a534cf40] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'collect_metrics', 'scheduled__2024-04-05T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T23:55:05.764217492Z [2024-04-05 23:55:05,763: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5d63bf37-c20b-4294-9b29-057c7f14b238] succeeded in 2.5750960949999353s: None 2024-04-05T23:55:05.976230964Z [2024-04-05 23:55:05,972: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T23:55:07.115773843Z [2024-04-05 23:55:07,115: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-05T23:55:07.119226848Z [2024-04-05 23:55:07,118: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:55:07.150156202Z [2024-04-05 23:55:07,149: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T23:55:07.151359040Z [2024-04-05 23:55:07,151: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:55:07.151375309Z [2024-04-05 23:55:07,151: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:55:07.151486965Z [2024-04-05 23:55:07,151: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:55:07.151530540Z [2024-04-05 23:55:07,151: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-05T23:55:07.152022472Z [2024-04-05 23:55:07,151: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T23:55:07.152046489Z [2024-04-05 23:55:07,151: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:55:07.242329493Z [2024-04-05 23:55:07,241: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:55:07.911897045Z [2024-04-05 23:55:07,911: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[50efb401-abf9-4264-83b4-b594a534cf40] succeeded in 2.232052795000527s: None 2024-04-05T23:55:08.732504075Z [2024-04-05 23:55:08,732: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d5e5e82a-ad4d-4fe7-9976-e046587ad9b0] received 2024-04-05T23:55:08.746126423Z [2024-04-05 23:55:08,745: INFO/ForkPoolWorker-15] [d5e5e82a-ad4d-4fe7-9976-e046587ad9b0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'send_prometheus', 'scheduled__2024-04-05T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T23:55:09.021908855Z [2024-04-05 23:55:09,018: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-05T23:55:10.237276024Z [2024-04-05 23:55:10,236: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T23:55:10.240656746Z [2024-04-05 23:55:10,240: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:55:10.262454755Z [2024-04-05 23:55:10,262: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T23:55:10.264068673Z [2024-04-05 23:55:10,263: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:55:10.264135946Z [2024-04-05 23:55:10,263: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:55:10.264338473Z [2024-04-05 23:55:10,264: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:55:10.264435949Z [2024-04-05 23:55:10,264: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T23:55:10.264731411Z [2024-04-05 23:55:10,264: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-05T23:55:10.264891007Z [2024-04-05 23:55:10,264: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:55:10.344034462Z [2024-04-05 23:55:10,343: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:55:10.866323252Z [2024-04-05 23:55:10,865: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d5e5e82a-ad4d-4fe7-9976-e046587ad9b0] succeeded in 2.129032374000417s: None 2024-04-05T23:56:00.256226638Z [2024-04-05 23:56:00,255: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[db95eaaf-941d-4f54-91cb-f94c830b234b] received 2024-04-05T23:56:00.264069409Z [2024-04-05 23:56:00,263: INFO/ForkPoolWorker-15] [db95eaaf-941d-4f54-91cb-f94c830b234b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T23:56:00.264760976Z [2024-04-05 23:56:00,264: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fc7a88be-ce30-43ad-8a1c-3daa231c72ae] received 2024-04-05T23:56:00.267849452Z [2024-04-05 23:56:00,267: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d9bcf957-3bf7-441c-a44d-14a17d4ec574] received 2024-04-05T23:56:00.272491570Z [2024-04-05 23:56:00,271: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c377e3ed-64ce-43c5-9258-0f50f44bd4be] received 2024-04-05T23:56:00.284116179Z [2024-04-05 23:56:00,283: INFO/ForkPoolWorker-2] [c377e3ed-64ce-43c5-9258-0f50f44bd4be] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T23:56:00.291427024Z [2024-04-05 23:56:00,290: INFO/ForkPoolWorker-16] [fc7a88be-ce30-43ad-8a1c-3daa231c72ae] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T23:56:00.293106936Z [2024-04-05 23:56:00,292: INFO/ForkPoolWorker-1] [d9bcf957-3bf7-441c-a44d-14a17d4ec574] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T23:56:00.629484985Z [2024-04-05 23:56:00,625: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-05T23:56:00.817761227Z [2024-04-05 23:56:00,814: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T23:56:00.927402802Z [2024-04-05 23:56:00,924: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-05T23:56:00.927813407Z [2024-04-05 23:56:00,920: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T23:56:00.936356109Z [2024-04-05 23:56:00,936: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:56:01.091494069Z [2024-04-05 23:56:01,087: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-05T23:56:01.095692849Z [2024-04-05 23:56:01,095: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:56:01.148129956Z [2024-04-05 23:56:01,147: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-05T23:56:01.151431129Z [2024-04-05 23:56:01,151: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-05T23:56:01.152298184Z [2024-04-05 23:56:01,151: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-05T23:56:01.152442806Z [2024-04-05 23:56:01,152: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-05T23:56:01.152736869Z [2024-04-05 23:56:01,152: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-05T23:56:01.310068981Z [2024-04-05 23:56:01,309: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:56:01.813936822Z [2024-04-05 23:56:01,812: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[fc7a88be-ce30-43ad-8a1c-3daa231c72ae] succeeded in 1.5443041179996726s: None 2024-04-05T23:56:02.066468547Z [2024-04-05 23:56:02,066: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d9bcf957-3bf7-441c-a44d-14a17d4ec574] succeeded in 1.7945074839999506s: None 2024-04-05T23:56:02.407404356Z [2024-04-05 23:56:02,406: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T23:56:02.410835424Z [2024-04-05 23:56:02,410: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:56:02.436932173Z [2024-04-05 23:56:02,436: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T23:56:02.438687130Z [2024-04-05 23:56:02,438: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:56:02.438969314Z [2024-04-05 23:56:02,438: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:56:02.439205583Z [2024-04-05 23:56:02,438: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:56:02.439354376Z [2024-04-05 23:56:02,439: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T23:56:02.439964837Z [2024-04-05 23:56:02,439: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T23:56:02.440139532Z [2024-04-05 23:56:02,439: INFO/ForkPoolWorker-15] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:56:02.441578617Z [2024-04-05 23:56:02,441: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-05T23:56:02.445017960Z [2024-04-05 23:56:02,444: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:56:02.477205450Z [2024-04-05 23:56:02,476: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-05T23:56:02.478818320Z [2024-04-05 23:56:02,478: INFO/ForkPoolWorker-2] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:56:02.478852178Z [2024-04-05 23:56:02,478: INFO/ForkPoolWorker-2] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:56:02.479045472Z [2024-04-05 23:56:02,478: INFO/ForkPoolWorker-2] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:56:02.479088204Z [2024-04-05 23:56:02,478: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-05T23:56:02.479620105Z [2024-04-05 23:56:02,479: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-05T23:56:02.479641199Z [2024-04-05 23:56:02,479: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:56:02.552639897Z [2024-04-05 23:56:02,552: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:56:02.561526903Z [2024-04-05 23:56:02,561: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:56:04.114679263Z [2024-04-05 23:56:04,107: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[db95eaaf-941d-4f54-91cb-f94c830b234b] succeeded in 3.850039961999755s: None 2024-04-05T23:56:04.448004834Z [2024-04-05 23:56:04,447: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[c377e3ed-64ce-43c5-9258-0f50f44bd4be] succeeded in 4.17282712999986s: None 2024-04-05T23:57:01.122507796Z [2024-04-05 23:57:01,122: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1909d887-754f-4005-9732-b4d4ef72a967] received 2024-04-05T23:57:01.124162462Z [2024-04-05 23:57:01,123: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[41abab79-0b38-4bb3-85e0-32cf5f501d0c] received 2024-04-05T23:57:01.128400411Z [2024-04-05 23:57:01,128: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[28131714-4af0-4893-ad3c-2c2e40af0d2a] received 2024-04-05T23:57:01.132714102Z [2024-04-05 23:57:01,132: INFO/ForkPoolWorker-15] [1909d887-754f-4005-9732-b4d4ef72a967] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T23:57:01.135495994Z [2024-04-05 23:57:01,135: INFO/ForkPoolWorker-16] [41abab79-0b38-4bb3-85e0-32cf5f501d0c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T23:57:01.147717126Z [2024-04-05 23:57:01,147: INFO/ForkPoolWorker-1] [28131714-4af0-4893-ad3c-2c2e40af0d2a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T23:57:01.441852979Z [2024-04-05 23:57:01,437: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-05T23:57:01.549536780Z [2024-04-05 23:57:01,546: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T23:57:01.566004929Z [2024-04-05 23:57:01,561: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T23:57:01.599916457Z [2024-04-05 23:57:01,599: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-05T23:57:01.603817278Z [2024-04-05 23:57:01,603: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:57:01.640309242Z [2024-04-05 23:57:01,640: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T23:57:01.642172035Z [2024-04-05 23:57:01,641: INFO/ForkPoolWorker-16] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-05T23:57:01.642305265Z [2024-04-05 23:57:01,642: INFO/ForkPoolWorker-16] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-05T23:57:01.642361301Z [2024-04-05 23:57:01,642: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-05T23:57:01.642588548Z [2024-04-05 23:57:01,642: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-05T23:57:01.729024752Z [2024-04-05 23:57:01,728: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:57:02.415963808Z [2024-04-05 23:57:02,415: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[41abab79-0b38-4bb3-85e0-32cf5f501d0c] succeeded in 1.2873621110002205s: None 2024-04-05T23:57:02.909014621Z [2024-04-05 23:57:02,908: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-05T23:57:02.912083497Z [2024-04-05 23:57:02,911: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:57:02.947186572Z [2024-04-05 23:57:02,946: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-05T23:57:02.950127630Z [2024-04-05 23:57:02,949: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:57:02.950165453Z [2024-04-05 23:57:02,950: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:57:02.950402133Z [2024-04-05 23:57:02,950: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:57:02.950433076Z [2024-04-05 23:57:02,950: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-05T23:57:02.950772086Z [2024-04-05 23:57:02,950: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T23:57:02.950843368Z [2024-04-05 23:57:02,950: INFO/ForkPoolWorker-1] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:57:02.957630799Z [2024-04-05 23:57:02,957: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T23:57:02.961229734Z [2024-04-05 23:57:02,960: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:57:02.983949874Z [2024-04-05 23:57:02,983: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T23:57:02.985339988Z [2024-04-05 23:57:02,985: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:57:02.985402749Z [2024-04-05 23:57:02,985: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:57:02.985566691Z [2024-04-05 23:57:02,985: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:57:02.985683783Z [2024-04-05 23:57:02,985: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T23:57:02.985928110Z [2024-04-05 23:57:02,985: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-05T23:57:02.985987003Z [2024-04-05 23:57:02,985: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:57:03.063240891Z [2024-04-05 23:57:03,062: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:57:03.078977519Z [2024-04-05 23:57:03,078: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:57:04.808648696Z [2024-04-05 23:57:04,808: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[28131714-4af0-4893-ad3c-2c2e40af0d2a] succeeded in 3.675179959000161s: None 2024-04-05T23:57:05.093064870Z [2024-04-05 23:57:05,092: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1909d887-754f-4005-9732-b4d4ef72a967] succeeded in 3.967363531999581s: None 2024-04-05T23:58:01.209593391Z [2024-04-05 23:58:01,208: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[57ccbb08-54d2-4a55-9c79-c77b5d806cf6] received 2024-04-05T23:58:01.215370589Z [2024-04-05 23:58:01,215: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[752dbb24-15c6-4d84-8a4f-ae9f7f42fe80] received 2024-04-05T23:58:01.219310025Z [2024-04-05 23:58:01,218: INFO/ForkPoolWorker-15] [57ccbb08-54d2-4a55-9c79-c77b5d806cf6] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T23:58:01.223137859Z [2024-04-05 23:58:01,222: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9796ab02-a4d3-4848-a6c5-cc2e5374f9f3] received 2024-04-05T23:58:01.226654444Z [2024-04-05 23:58:01,226: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b6a30f78-9599-421b-915c-98f7796507d9] received 2024-04-05T23:58:01.248307350Z [2024-04-05 23:58:01,247: INFO/ForkPoolWorker-1] [9796ab02-a4d3-4848-a6c5-cc2e5374f9f3] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T23:58:01.253124873Z [2024-04-05 23:58:01,252: INFO/ForkPoolWorker-2] [b6a30f78-9599-421b-915c-98f7796507d9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T23:58:01.258291547Z [2024-04-05 23:58:01,257: INFO/ForkPoolWorker-16] [752dbb24-15c6-4d84-8a4f-ae9f7f42fe80] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T23:58:01.490430510Z [2024-04-05 23:58:01,486: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-05T23:58:01.590494273Z [2024-04-05 23:58:01,587: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T23:58:01.606351494Z [2024-04-05 23:58:01,602: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-05T23:58:01.625243668Z [2024-04-05 23:58:01,620: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T23:58:01.798448567Z [2024-04-05 23:58:01,797: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-05T23:58:01.804739159Z [2024-04-05 23:58:01,804: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:58:01.838097081Z [2024-04-05 23:58:01,837: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-05T23:58:01.844379661Z [2024-04-05 23:58:01,844: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-05T23:58:01.844478322Z [2024-04-05 23:58:01,844: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-05T23:58:01.844558544Z [2024-04-05 23:58:01,844: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-05T23:58:01.844829220Z [2024-04-05 23:58:01,844: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-05T23:58:01.855995734Z [2024-04-05 23:58:01,855: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:58:01.965489707Z [2024-04-05 23:58:01,965: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:58:02.573185199Z [2024-04-05 23:58:02,572: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[57ccbb08-54d2-4a55-9c79-c77b5d806cf6] succeeded in 1.3608315270003004s: None 2024-04-05T23:58:02.692656192Z [2024-04-05 23:58:02,692: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9796ab02-a4d3-4848-a6c5-cc2e5374f9f3] succeeded in 1.4658734650001861s: None 2024-04-05T23:58:03.055434616Z [2024-04-05 23:58:03,054: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-05T23:58:03.058642927Z [2024-04-05 23:58:03,058: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:58:03.066954065Z [2024-04-05 23:58:03,066: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-05T23:58:03.070898612Z [2024-04-05 23:58:03,070: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:58:03.080772712Z [2024-04-05 23:58:03,080: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-05T23:58:03.082228474Z [2024-04-05 23:58:03,081: INFO/ForkPoolWorker-2] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:58:03.082244489Z [2024-04-05 23:58:03,082: INFO/ForkPoolWorker-2] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:58:03.082413020Z [2024-04-05 23:58:03,082: INFO/ForkPoolWorker-2] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:58:03.082451889Z [2024-04-05 23:58:03,082: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-05T23:58:03.082730266Z [2024-04-05 23:58:03,082: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T23:58:03.082769620Z [2024-04-05 23:58:03,082: INFO/ForkPoolWorker-2] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:58:03.093117112Z [2024-04-05 23:58:03,092: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T23:58:03.095323087Z [2024-04-05 23:58:03,095: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:58:03.095500056Z [2024-04-05 23:58:03,095: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:58:03.095805254Z [2024-04-05 23:58:03,095: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:58:03.096021547Z [2024-04-05 23:58:03,095: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-05T23:58:03.096517171Z [2024-04-05 23:58:03,096: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-05T23:58:03.096664212Z [2024-04-05 23:58:03,096: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:58:03.171747008Z [2024-04-05 23:58:03,171: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:58:03.193726193Z [2024-04-05 23:58:03,193: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:58:04.730484690Z [2024-04-05 23:58:04,729: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b6a30f78-9599-421b-915c-98f7796507d9] succeeded in 3.49849555199944s: None 2024-04-05T23:58:05.352157012Z [2024-04-05 23:58:05,351: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[752dbb24-15c6-4d84-8a4f-ae9f7f42fe80] succeeded in 4.127600433000225s: None 2024-04-05T23:59:01.182555894Z [2024-04-05 23:59:01,182: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0812862a-5ef2-465a-a759-6049a908bf3d] received 2024-04-05T23:59:01.184775107Z [2024-04-05 23:59:01,184: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[631526fc-e1b9-4d91-a15a-e51b58382c52] received 2024-04-05T23:59:01.186374983Z [2024-04-05 23:59:01,186: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4f4a7ed6-6112-4b5a-bd4d-d86a5f805ccd] received 2024-04-05T23:59:01.191147288Z [2024-04-05 23:59:01,190: INFO/ForkPoolWorker-15] [0812862a-5ef2-465a-a759-6049a908bf3d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T23:59:01.195319543Z [2024-04-05 23:59:01,194: INFO/ForkPoolWorker-1] [4f4a7ed6-6112-4b5a-bd4d-d86a5f805ccd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T23:59:01.213523983Z [2024-04-05 23:59:01,213: INFO/ForkPoolWorker-16] [631526fc-e1b9-4d91-a15a-e51b58382c52] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T23:59:01.506335057Z [2024-04-05 23:59:01,503: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-05T23:59:01.507016383Z [2024-04-05 23:59:01,503: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-05T23:59:01.510587877Z [2024-04-05 23:59:01,507: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-05T23:59:01.703586812Z [2024-04-05 23:59:01,700: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-05T23:59:01.707490599Z [2024-04-05 23:59:01,705: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:59:01.744105428Z [2024-04-05 23:59:01,743: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-05T23:59:01.745830838Z [2024-04-05 23:59:01,745: INFO/ForkPoolWorker-16] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-05T23:59:01.745953099Z [2024-04-05 23:59:01,745: INFO/ForkPoolWorker-16] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-05T23:59:01.746015827Z [2024-04-05 23:59:01,745: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-05T23:59:01.750261620Z [2024-04-05 23:59:01,749: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-05T23:59:01.887496453Z [2024-04-05 23:59:01,887: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:59:02.581722823Z [2024-04-05 23:59:02,581: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[631526fc-e1b9-4d91-a15a-e51b58382c52] succeeded in 1.3939949390005495s: None 2024-04-05T23:59:02.928566441Z [2024-04-05 23:59:02,928: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-05T23:59:02.931994559Z [2024-04-05 23:59:02,931: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:59:02.948201066Z [2024-04-05 23:59:02,947: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-05T23:59:02.952370229Z [2024-04-05 23:59:02,951: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-05T23:59:02.954362208Z [2024-04-05 23:59:02,954: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-05T23:59:02.956072735Z [2024-04-05 23:59:02,955: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:59:02.956090681Z [2024-04-05 23:59:02,956: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:59:02.956219176Z [2024-04-05 23:59:02,956: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:59:02.956262068Z [2024-04-05 23:59:02,956: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-05T23:59:02.956476152Z [2024-04-05 23:59:02,956: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-05T23:59:02.956518462Z [2024-04-05 23:59:02,956: INFO/ForkPoolWorker-15] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:59:02.973615376Z [2024-04-05 23:59:02,973: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-05T23:59:02.974873176Z [2024-04-05 23:59:02,974: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-05T23:59:02.974923520Z [2024-04-05 23:59:02,974: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-05T23:59:02.974972743Z [2024-04-05 23:59:02,974: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-05T23:59:02.975109625Z [2024-04-05 23:59:02,974: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-05T23:59:02.975369913Z [2024-04-05 23:59:02,975: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-05T23:59:02.975428270Z [2024-04-05 23:59:02,975: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-05T23:59:03.039843257Z [2024-04-05 23:59:03,039: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:59:03.061694679Z [2024-04-05 23:59:03,061: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-05T23:59:05.044462560Z [2024-04-05 23:59:05,044: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0812862a-5ef2-465a-a759-6049a908bf3d] succeeded in 3.8599902699997983s: None 2024-04-05T23:59:05.832250039Z [2024-04-05 23:59:05,829: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4f4a7ed6-6112-4b5a-bd4d-d86a5f805ccd] succeeded in 4.641937418999987s: None 2024-04-06T00:00:00.525369116Z [2024-04-06 00:00:00,524: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a17c1dac-ee1c-4936-9281-da6a14a88494] received 2024-04-06T00:00:00.528646323Z [2024-04-06 00:00:00,528: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d690dfad-fdc4-4a69-b49c-a535df66effb] received 2024-04-06T00:00:00.536647610Z [2024-04-06 00:00:00,536: INFO/ForkPoolWorker-15] [a17c1dac-ee1c-4936-9281-da6a14a88494] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T00:00:00.538182101Z [2024-04-06 00:00:00,537: INFO/ForkPoolWorker-16] [d690dfad-fdc4-4a69-b49c-a535df66effb] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T00:00:00.548847703Z [2024-04-06 00:00:00,548: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9c69be06-66db-4391-b3a6-9d14cca3b6d5] received 2024-04-06T00:00:00.551966561Z [2024-04-06 00:00:00,551: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[73eb48cc-815d-4212-8991-ee654b74f8c7] received 2024-04-06T00:00:00.569942094Z [2024-04-06 00:00:00,569: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[73c6c644-60b4-454a-b2c6-9c534934b95b] received 2024-04-06T00:00:00.592648440Z [2024-04-06 00:00:00,592: INFO/ForkPoolWorker-1] [9c69be06-66db-4391-b3a6-9d14cca3b6d5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T00:00:00.602867806Z [2024-04-06 00:00:00,601: INFO/ForkPoolWorker-2] [73eb48cc-815d-4212-8991-ee654b74f8c7] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T00:00:00.603411034Z [2024-04-06 00:00:00,603: INFO/ForkPoolWorker-3] [73c6c644-60b4-454a-b2c6-9c534934b95b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T23:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T00:00:00.936164922Z [2024-04-06 00:00:00,931: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T00:00:00.976557372Z [2024-04-06 00:00:00,972: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T00:00:01.007894459Z [2024-04-06 00:00:01,004: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T00:00:01.062345736Z [2024-04-06 00:00:01,053: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T00:00:01.139436206Z [2024-04-06 00:00:01,133: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T00:00:01.142950738Z [2024-04-06 00:00:01,142: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-06T00:00:01.146804036Z [2024-04-06 00:00:01,146: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:00:01.180035552Z [2024-04-06 00:00:01,179: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T00:00:01.181456928Z [2024-04-06 00:00:01,181: INFO/ForkPoolWorker-2] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T00:00:01.181603233Z [2024-04-06 00:00:01,181: INFO/ForkPoolWorker-2] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T00:00:01.181685712Z [2024-04-06 00:00:01,181: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-06T00:00:01.181907123Z [2024-04-06 00:00:01,181: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T00:00:01.313823212Z [2024-04-06 00:00:01,313: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:00:01.373622390Z [2024-04-06 00:00:01,373: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:00:02.000224576Z [2024-04-06 00:00:01,999: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[73eb48cc-815d-4212-8991-ee654b74f8c7] succeeded in 1.4420457369997166s: None 2024-04-06T00:00:02.020268160Z [2024-04-06 00:00:02,019: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d690dfad-fdc4-4a69-b49c-a535df66effb] succeeded in 1.48994023799969s: None 2024-04-06T00:00:02.724801130Z [2024-04-06 00:00:02,724: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T00:00:02.728422741Z [2024-04-06 00:00:02,727: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:00:02.751783762Z [2024-04-06 00:00:02,751: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T00:00:02.753772320Z [2024-04-06 00:00:02,753: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:00:02.753788472Z [2024-04-06 00:00:02,753: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:00:02.753929619Z [2024-04-06 00:00:02,753: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:00:02.753962884Z [2024-04-06 00:00:02,753: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T00:00:02.754284404Z [2024-04-06 00:00:02,754: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T00:00:02.754344056Z [2024-04-06 00:00:02,754: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:00:02.827555313Z [2024-04-06 00:00:02,826: INFO/ForkPoolWorker-3] Getting VIM list 2024-04-06T00:00:02.835519754Z [2024-04-06 00:00:02,834: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:00:02.849572158Z [2024-04-06 00:00:02,849: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:00:02.877897634Z [2024-04-06 00:00:02,877: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-06T00:00:02.881400889Z [2024-04-06 00:00:02,880: INFO/ForkPoolWorker-3] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:00:02.881410828Z [2024-04-06 00:00:02,880: INFO/ForkPoolWorker-3] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:00:02.881414891Z [2024-04-06 00:00:02,880: INFO/ForkPoolWorker-3] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:00:02.881418399Z [2024-04-06 00:00:02,880: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-04-06T00:00:02.881613952Z [2024-04-06 00:00:02,881: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-04-06T00:00:02.881806588Z [2024-04-06 00:00:02,881: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:00:02.945696550Z [2024-04-06 00:00:02,945: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T00:00:02.953109359Z [2024-04-06 00:00:02,952: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:00:02.981240782Z [2024-04-06 00:00:02,980: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T00:00:02.982676253Z [2024-04-06 00:00:02,982: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:00:02.982757499Z [2024-04-06 00:00:02,982: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:00:02.982880348Z [2024-04-06 00:00:02,982: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:00:02.983218009Z [2024-04-06 00:00:02,983: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T00:00:02.988761657Z [2024-04-06 00:00:02,985: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T00:00:02.988782287Z [2024-04-06 00:00:02,988: INFO/ForkPoolWorker-1] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:00:03.041189152Z [2024-04-06 00:00:03,040: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:00:03.099802277Z [2024-04-06 00:00:03,099: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:00:03.639103504Z [2024-04-06 00:00:03,638: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a17c1dac-ee1c-4936-9281-da6a14a88494] succeeded in 3.1089287570002853s: None 2024-04-06T00:00:04.195867708Z [2024-04-06 00:00:04,195: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f328754a-158d-4bb8-8ca3-fd7b607e373a] received 2024-04-06T00:00:04.207108719Z [2024-04-06 00:00:04,206: INFO/ForkPoolWorker-15] [f328754a-158d-4bb8-8ca3-fd7b607e373a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'split_metrics', 'scheduled__2024-04-05T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T00:00:04.545946001Z [2024-04-06 00:00:04,542: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T00:00:04.582590785Z [2024-04-06 00:00:04,580: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9c69be06-66db-4391-b3a6-9d14cca3b6d5] succeeded in 4.01203204399917s: None 2024-04-06T00:00:04.909446918Z [2024-04-06 00:00:04,908: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[73c6c644-60b4-454a-b2c6-9c534934b95b] succeeded in 4.332341608000206s: None 2024-04-06T00:00:05.809086654Z [2024-04-06 00:00:05,808: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T00:00:05.812235051Z [2024-04-06 00:00:05,811: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:00:05.839341691Z [2024-04-06 00:00:05,839: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T00:00:05.840467599Z [2024-04-06 00:00:05,840: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:00:05.840486356Z [2024-04-06 00:00:05,840: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:00:05.840577317Z [2024-04-06 00:00:05,840: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:00:05.840615184Z [2024-04-06 00:00:05,840: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T00:00:05.840870152Z [2024-04-06 00:00:05,840: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T00:00:05.840897905Z [2024-04-06 00:00:05,840: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:00:05.943537019Z [2024-04-06 00:00:05,943: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:00:06.530928575Z [2024-04-06 00:00:06,529: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f328754a-158d-4bb8-8ca3-fd7b607e373a] succeeded in 2.3288745689997086s: None 2024-04-06T00:00:07.448078817Z [2024-04-06 00:00:07,447: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[509edd6b-3962-40c2-983e-f48df41d7e8f] received 2024-04-06T00:00:07.459027262Z [2024-04-06 00:00:07,458: INFO/ForkPoolWorker-15] [509edd6b-3962-40c2-983e-f48df41d7e8f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'collect_metrics', 'scheduled__2024-04-05T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T00:00:07.737770477Z [2024-04-06 00:00:07,734: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T00:00:08.874511599Z [2024-04-06 00:00:08,874: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T00:00:08.878138379Z [2024-04-06 00:00:08,877: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:00:08.906538744Z [2024-04-06 00:00:08,906: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T00:00:08.908562077Z [2024-04-06 00:00:08,908: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:00:08.908726605Z [2024-04-06 00:00:08,908: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:00:08.908992869Z [2024-04-06 00:00:08,908: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:00:08.909112378Z [2024-04-06 00:00:08,908: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T00:00:08.909509582Z [2024-04-06 00:00:08,909: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T00:00:08.909668398Z [2024-04-06 00:00:08,909: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:00:09.010190783Z [2024-04-06 00:00:09,009: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:00:09.638751441Z [2024-04-06 00:00:09,638: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[509edd6b-3962-40c2-983e-f48df41d7e8f] succeeded in 2.187874062999981s: None 2024-04-06T00:00:10.097436750Z [2024-04-06 00:00:10,097: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1da4d61c-8701-4bc6-9324-ab19222d2017] received 2024-04-06T00:00:10.121503989Z [2024-04-06 00:00:10,121: INFO/ForkPoolWorker-15] [1da4d61c-8701-4bc6-9324-ab19222d2017] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'send_prometheus', 'scheduled__2024-04-05T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T00:00:10.382205867Z [2024-04-06 00:00:10,378: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T00:00:11.495160627Z [2024-04-06 00:00:11,494: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T00:00:11.498365476Z [2024-04-06 00:00:11,497: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:00:11.523420765Z [2024-04-06 00:00:11,523: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T00:00:11.525758415Z [2024-04-06 00:00:11,525: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:00:11.525956881Z [2024-04-06 00:00:11,525: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:00:11.526177777Z [2024-04-06 00:00:11,525: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:00:11.526289244Z [2024-04-06 00:00:11,526: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T00:00:11.526614879Z [2024-04-06 00:00:11,526: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T00:00:11.526653343Z [2024-04-06 00:00:11,526: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:00:11.614510737Z [2024-04-06 00:00:11,614: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:00:12.301884005Z [2024-04-06 00:00:12,301: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1da4d61c-8701-4bc6-9324-ab19222d2017] succeeded in 2.2014864110005874s: None 2024-04-06T00:01:00.574566220Z [2024-04-06 00:01:00,574: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[25e0b400-4c80-4835-80bd-dca7622fa1e8] received 2024-04-06T00:01:00.577298957Z [2024-04-06 00:01:00,577: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7c39a552-2c35-4ad8-b844-3f0255df3bc6] received 2024-04-06T00:01:00.578850624Z [2024-04-06 00:01:00,578: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b2ba64d6-4eb7-4052-a017-63d8e87e9ce0] received 2024-04-06T00:01:00.585905762Z [2024-04-06 00:01:00,585: INFO/ForkPoolWorker-15] [25e0b400-4c80-4835-80bd-dca7622fa1e8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T00:01:00.587054065Z [2024-04-06 00:01:00,586: INFO/ForkPoolWorker-1] [b2ba64d6-4eb7-4052-a017-63d8e87e9ce0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T00:01:00.588517559Z [2024-04-06 00:01:00,588: INFO/ForkPoolWorker-16] [7c39a552-2c35-4ad8-b844-3f0255df3bc6] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T00:01:00.900111814Z [2024-04-06 00:01:00,896: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T00:01:00.958650948Z [2024-04-06 00:01:00,954: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T00:01:01.033351792Z [2024-04-06 00:01:01,029: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T00:01:01.193720183Z [2024-04-06 00:01:01,193: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-06T00:01:01.197811203Z [2024-04-06 00:01:01,197: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:01:01.232041805Z [2024-04-06 00:01:01,231: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T00:01:01.236109790Z [2024-04-06 00:01:01,235: INFO/ForkPoolWorker-16] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T00:01:01.236160868Z [2024-04-06 00:01:01,236: INFO/ForkPoolWorker-16] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T00:01:01.236179646Z [2024-04-06 00:01:01,236: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-06T00:01:01.236393196Z [2024-04-06 00:01:01,236: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T00:01:01.331718911Z [2024-04-06 00:01:01,331: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:01:01.927512437Z [2024-04-06 00:01:01,926: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7c39a552-2c35-4ad8-b844-3f0255df3bc6] succeeded in 1.3469678700002987s: None 2024-04-06T00:01:02.248740737Z [2024-04-06 00:01:02,248: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T00:01:02.252117758Z [2024-04-06 00:01:02,251: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:01:02.277374280Z [2024-04-06 00:01:02,277: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T00:01:02.278719551Z [2024-04-06 00:01:02,278: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:01:02.278733299Z [2024-04-06 00:01:02,278: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:01:02.278871486Z [2024-04-06 00:01:02,278: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:01:02.278882731Z [2024-04-06 00:01:02,278: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T00:01:02.279121758Z [2024-04-06 00:01:02,279: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T00:01:02.279149515Z [2024-04-06 00:01:02,279: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:01:02.297718358Z [2024-04-06 00:01:02,297: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T00:01:02.301033308Z [2024-04-06 00:01:02,300: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:01:02.325099988Z [2024-04-06 00:01:02,324: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T00:01:02.327376006Z [2024-04-06 00:01:02,327: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:01:02.327581974Z [2024-04-06 00:01:02,327: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:01:02.327789908Z [2024-04-06 00:01:02,327: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:01:02.327935603Z [2024-04-06 00:01:02,327: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T00:01:02.328249336Z [2024-04-06 00:01:02,328: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T00:01:02.328396410Z [2024-04-06 00:01:02,328: INFO/ForkPoolWorker-1] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:01:02.364510032Z [2024-04-06 00:01:02,364: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:01:02.414741977Z [2024-04-06 00:01:02,414: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:01:04.106323793Z [2024-04-06 00:01:04,105: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b2ba64d6-4eb7-4052-a017-63d8e87e9ce0] succeeded in 3.52573300900076s: None 2024-04-06T00:01:04.408897939Z [2024-04-06 00:01:04,408: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[25e0b400-4c80-4835-80bd-dca7622fa1e8] succeeded in 3.8313677729993287s: None 2024-04-06T00:02:00.471503372Z [2024-04-06 00:02:00,470: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c55de90d-d2f9-42ab-a754-0d795224c3a2] received 2024-04-06T00:02:00.481587111Z [2024-04-06 00:02:00,480: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1c613c9c-8901-4e81-962e-c5e43cedbc74] received 2024-04-06T00:02:00.490835006Z [2024-04-06 00:02:00,490: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7cdea3bf-08b8-4b8c-8816-d92ae5966b06] received 2024-04-06T00:02:00.492100733Z [2024-04-06 00:02:00,491: INFO/ForkPoolWorker-16] [1c613c9c-8901-4e81-962e-c5e43cedbc74] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T00:02:00.492409615Z [2024-04-06 00:02:00,491: INFO/ForkPoolWorker-15] [c55de90d-d2f9-42ab-a754-0d795224c3a2] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T00:02:00.506875852Z [2024-04-06 00:02:00,506: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[428eaf0d-1da0-42c3-8147-6c53b65ea8ec] received 2024-04-06T00:02:00.517686239Z [2024-04-06 00:02:00,517: INFO/ForkPoolWorker-1] [7cdea3bf-08b8-4b8c-8816-d92ae5966b06] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T00:02:00.520435487Z [2024-04-06 00:02:00,519: INFO/ForkPoolWorker-2] [428eaf0d-1da0-42c3-8147-6c53b65ea8ec] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T00:02:00.818781904Z [2024-04-06 00:02:00,814: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T00:02:00.952239738Z [2024-04-06 00:02:00,948: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T00:02:01.006855121Z [2024-04-06 00:02:01,000: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T00:02:01.169392408Z [2024-04-06 00:02:01,166: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T00:02:01.184693471Z [2024-04-06 00:02:01,184: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:02:01.187386592Z [2024-04-06 00:02:01,186: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-06T00:02:01.197699087Z [2024-04-06 00:02:01,196: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:02:01.254310843Z [2024-04-06 00:02:01,254: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T00:02:01.255714766Z [2024-04-06 00:02:01,255: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T00:02:01.255733030Z [2024-04-06 00:02:01,255: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T00:02:01.255807180Z [2024-04-06 00:02:01,255: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-06T00:02:01.256004157Z [2024-04-06 00:02:01,255: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T00:02:01.388065353Z [2024-04-06 00:02:01,387: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:02:01.824997667Z [2024-04-06 00:02:01,824: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c55de90d-d2f9-42ab-a754-0d795224c3a2] succeeded in 1.347678394000468s: None 2024-04-06T00:02:02.153771107Z [2024-04-06 00:02:02,153: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7cdea3bf-08b8-4b8c-8816-d92ae5966b06] succeeded in 1.644713462999789s: None 2024-04-06T00:02:02.563545016Z [2024-04-06 00:02:02,562: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T00:02:02.567120481Z [2024-04-06 00:02:02,566: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:02:02.594203583Z [2024-04-06 00:02:02,593: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T00:02:02.595783966Z [2024-04-06 00:02:02,595: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:02:02.595810951Z [2024-04-06 00:02:02,595: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:02:02.596011743Z [2024-04-06 00:02:02,595: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:02:02.596040293Z [2024-04-06 00:02:02,595: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T00:02:02.597119671Z [2024-04-06 00:02:02,596: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-06T00:02:02.598180888Z [2024-04-06 00:02:02,597: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T00:02:02.598202803Z [2024-04-06 00:02:02,598: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:02:02.600290357Z [2024-04-06 00:02:02,599: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:02:02.626168927Z [2024-04-06 00:02:02,625: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T00:02:02.628183428Z [2024-04-06 00:02:02,627: INFO/ForkPoolWorker-2] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:02:02.628209996Z [2024-04-06 00:02:02,628: INFO/ForkPoolWorker-2] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:02:02.628240876Z [2024-04-06 00:02:02,628: INFO/ForkPoolWorker-2] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:02:02.628284606Z [2024-04-06 00:02:02,628: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-06T00:02:02.628548167Z [2024-04-06 00:02:02,628: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T00:02:02.628560573Z [2024-04-06 00:02:02,628: INFO/ForkPoolWorker-2] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:02:02.706465247Z [2024-04-06 00:02:02,706: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:02:02.712837967Z [2024-04-06 00:02:02,712: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:02:05.175078575Z [2024-04-06 00:02:05,174: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[428eaf0d-1da0-42c3-8147-6c53b65ea8ec] succeeded in 4.6662896599991655s: None 2024-04-06T00:02:05.268005158Z [2024-04-06 00:02:05,267: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1c613c9c-8901-4e81-962e-c5e43cedbc74] succeeded in 4.784356514000137s: None 2024-04-06T00:03:00.388382871Z [2024-04-06 00:03:00,387: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6607d2e0-89c8-4b3c-887d-24b6c630bb09] received 2024-04-06T00:03:00.392105109Z [2024-04-06 00:03:00,391: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a855a1a6-6bb7-4f70-8d5a-5b3f198dcc33] received 2024-04-06T00:03:00.402815302Z [2024-04-06 00:03:00,402: INFO/ForkPoolWorker-15] [6607d2e0-89c8-4b3c-887d-24b6c630bb09] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T00:03:00.408167391Z [2024-04-06 00:03:00,407: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[882f0f66-e999-4a1e-819e-4fd00bf8d2c4] received 2024-04-06T00:03:00.409837178Z [2024-04-06 00:03:00,409: INFO/ForkPoolWorker-16] [a855a1a6-6bb7-4f70-8d5a-5b3f198dcc33] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T00:03:00.419554064Z [2024-04-06 00:03:00,419: INFO/ForkPoolWorker-1] [882f0f66-e999-4a1e-819e-4fd00bf8d2c4] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T00:03:00.726050121Z [2024-04-06 00:03:00,722: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T00:03:00.762852632Z [2024-04-06 00:03:00,758: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T00:03:00.763331355Z [2024-04-06 00:03:00,759: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T00:03:00.933726634Z [2024-04-06 00:03:00,933: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-06T00:03:00.938468520Z [2024-04-06 00:03:00,937: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:03:00.964987557Z [2024-04-06 00:03:00,964: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T00:03:00.966610011Z [2024-04-06 00:03:00,966: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T00:03:00.966877257Z [2024-04-06 00:03:00,966: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T00:03:00.967030165Z [2024-04-06 00:03:00,966: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-06T00:03:00.967375709Z [2024-04-06 00:03:00,967: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T00:03:01.096844268Z [2024-04-06 00:03:01,096: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:03:01.775140309Z [2024-04-06 00:03:01,774: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[882f0f66-e999-4a1e-819e-4fd00bf8d2c4] succeeded in 1.364263968999694s: None 2024-04-06T00:03:01.961117723Z [2024-04-06 00:03:01,960: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T00:03:01.965667577Z [2024-04-06 00:03:01,965: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:03:01.990567993Z [2024-04-06 00:03:01,990: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T00:03:01.992027286Z [2024-04-06 00:03:01,991: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:03:01.992081608Z [2024-04-06 00:03:01,991: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:03:01.992219331Z [2024-04-06 00:03:01,992: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:03:01.992273487Z [2024-04-06 00:03:01,992: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T00:03:01.992676283Z [2024-04-06 00:03:01,992: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T00:03:01.992726950Z [2024-04-06 00:03:01,992: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:03:02.008689405Z [2024-04-06 00:03:02,008: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T00:03:02.012231868Z [2024-04-06 00:03:02,011: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:03:02.032221297Z [2024-04-06 00:03:02,031: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T00:03:02.033791710Z [2024-04-06 00:03:02,033: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:03:02.033956724Z [2024-04-06 00:03:02,033: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:03:02.034256997Z [2024-04-06 00:03:02,033: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:03:02.034401159Z [2024-04-06 00:03:02,034: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T00:03:02.034765390Z [2024-04-06 00:03:02,034: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T00:03:02.034864198Z [2024-04-06 00:03:02,034: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:03:02.116204367Z [2024-04-06 00:03:02,115: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:03:02.162864741Z [2024-04-06 00:03:02,162: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:03:03.820581469Z [2024-04-06 00:03:03,820: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a855a1a6-6bb7-4f70-8d5a-5b3f198dcc33] succeeded in 3.426125189999766s: None 2024-04-06T00:03:04.020147751Z [2024-04-06 00:03:04,019: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6607d2e0-89c8-4b3c-887d-24b6c630bb09] succeeded in 3.6263700019999305s: None 2024-04-06T00:04:01.270398646Z [2024-04-06 00:04:01,269: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[77fa1e84-4607-4541-9797-f3f0275654c5] received 2024-04-06T00:04:01.273224261Z [2024-04-06 00:04:01,272: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e7befa69-ecbf-4bcf-89a5-c0c865ecb9cd] received 2024-04-06T00:04:01.282047852Z [2024-04-06 00:04:01,281: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bac28270-ebe3-421a-9ffd-8aa84a7bf355] received 2024-04-06T00:04:01.292016578Z [2024-04-06 00:04:01,291: INFO/ForkPoolWorker-1] [bac28270-ebe3-421a-9ffd-8aa84a7bf355] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T00:04:01.293223802Z [2024-04-06 00:04:01,292: INFO/ForkPoolWorker-16] [e7befa69-ecbf-4bcf-89a5-c0c865ecb9cd] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T00:04:01.296031403Z [2024-04-06 00:04:01,295: INFO/ForkPoolWorker-15] [77fa1e84-4607-4541-9797-f3f0275654c5] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T00:04:01.299226873Z [2024-04-06 00:04:01,299: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7c38ca9e-2ce4-4fb4-8896-d1b447a22524] received 2024-04-06T00:04:01.318207146Z [2024-04-06 00:04:01,317: INFO/ForkPoolWorker-2] [7c38ca9e-2ce4-4fb4-8896-d1b447a22524] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T00:04:01.611212013Z [2024-04-06 00:04:01,607: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T00:04:01.668871797Z [2024-04-06 00:04:01,664: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T00:04:01.697359193Z [2024-04-06 00:04:01,685: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T00:04:01.783651733Z [2024-04-06 00:04:01,778: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T00:04:01.839962363Z [2024-04-06 00:04:01,839: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-06T00:04:01.843939177Z [2024-04-06 00:04:01,843: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:04:01.888263888Z [2024-04-06 00:04:01,888: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T00:04:01.889462688Z [2024-04-06 00:04:01,889: INFO/ForkPoolWorker-16] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T00:04:01.889548121Z [2024-04-06 00:04:01,889: INFO/ForkPoolWorker-16] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T00:04:01.889578465Z [2024-04-06 00:04:01,889: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-06T00:04:01.889770150Z [2024-04-06 00:04:01,889: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T00:04:01.977717016Z [2024-04-06 00:04:01,977: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:04:01.992328658Z [2024-04-06 00:04:01,992: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:04:02.541912136Z [2024-04-06 00:04:02,541: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[77fa1e84-4607-4541-9797-f3f0275654c5] succeeded in 1.2630366950006646s: None 2024-04-06T00:04:02.681202846Z [2024-04-06 00:04:02,680: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e7befa69-ecbf-4bcf-89a5-c0c865ecb9cd] succeeded in 1.398387387999719s: None 2024-04-06T00:04:02.990011967Z [2024-04-06 00:04:02,989: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T00:04:02.993345438Z [2024-04-06 00:04:02,992: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:04:03.013633211Z [2024-04-06 00:04:03,013: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T00:04:03.014768102Z [2024-04-06 00:04:03,014: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:04:03.014837703Z [2024-04-06 00:04:03,014: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:04:03.015029637Z [2024-04-06 00:04:03,014: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:04:03.015040288Z [2024-04-06 00:04:03,014: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T00:04:03.015335730Z [2024-04-06 00:04:03,015: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T00:04:03.015379321Z [2024-04-06 00:04:03,015: INFO/ForkPoolWorker-1] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:04:03.077940215Z [2024-04-06 00:04:03,077: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-06T00:04:03.081122786Z [2024-04-06 00:04:03,080: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:04:03.098116987Z [2024-04-06 00:04:03,097: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T00:04:03.099211372Z [2024-04-06 00:04:03,098: INFO/ForkPoolWorker-2] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:04:03.099222200Z [2024-04-06 00:04:03,099: INFO/ForkPoolWorker-2] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:04:03.099372317Z [2024-04-06 00:04:03,099: INFO/ForkPoolWorker-2] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:04:03.099397958Z [2024-04-06 00:04:03,099: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-06T00:04:03.099725834Z [2024-04-06 00:04:03,099: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-06T00:04:03.099734711Z [2024-04-06 00:04:03,099: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:04:03.110233487Z [2024-04-06 00:04:03,109: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:04:03.191486940Z [2024-04-06 00:04:03,191: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:04:05.015042980Z [2024-04-06 00:04:05,014: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[bac28270-ebe3-421a-9ffd-8aa84a7bf355] succeeded in 3.729961430000003s: None 2024-04-06T00:04:05.819458663Z [2024-04-06 00:04:05,818: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[7c38ca9e-2ce4-4fb4-8896-d1b447a22524] succeeded in 4.512675959999797s: None 2024-04-06T00:05:00.358967291Z [2024-04-06 00:05:00,358: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8afd3681-8169-4081-aec9-83226fbdf9c1] received 2024-04-06T00:05:00.366223473Z [2024-04-06 00:05:00,365: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3c3e0309-e1ca-44de-b416-462fb98ded67] received 2024-04-06T00:05:00.369860808Z [2024-04-06 00:05:00,369: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f28de7dd-cd59-420b-abb2-8a80aeeadd20] received 2024-04-06T00:05:00.370129510Z [2024-04-06 00:05:00,367: INFO/ForkPoolWorker-15] [8afd3681-8169-4081-aec9-83226fbdf9c1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T00:05:00.371841747Z [2024-04-06 00:05:00,371: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fd0d65d0-85c9-492c-8d23-1915c46a53c5] received 2024-04-06T00:05:00.378331917Z [2024-04-06 00:05:00,378: INFO/ForkPoolWorker-2] [fd0d65d0-85c9-492c-8d23-1915c46a53c5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T00:05:00.380956616Z [2024-04-06 00:05:00,380: INFO/ForkPoolWorker-16] [3c3e0309-e1ca-44de-b416-462fb98ded67] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T00:05:00.391966811Z [2024-04-06 00:05:00,391: INFO/ForkPoolWorker-1] [f28de7dd-cd59-420b-abb2-8a80aeeadd20] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T00:05:00.766628969Z [2024-04-06 00:05:00,763: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T00:05:00.778264087Z [2024-04-06 00:05:00,775: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T00:05:00.854713112Z [2024-04-06 00:05:00,851: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T00:05:00.872579620Z [2024-04-06 00:05:00,868: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T00:05:01.125535190Z [2024-04-06 00:05:01,124: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-06T00:05:01.129212350Z [2024-04-06 00:05:01,128: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:05:01.173082306Z [2024-04-06 00:05:01,172: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T00:05:01.180663963Z [2024-04-06 00:05:01,180: INFO/ForkPoolWorker-16] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T00:05:01.180946683Z [2024-04-06 00:05:01,180: INFO/ForkPoolWorker-16] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T00:05:01.181078832Z [2024-04-06 00:05:01,180: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-06T00:05:01.181486489Z [2024-04-06 00:05:01,181: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T00:05:01.292987567Z [2024-04-06 00:05:01,292: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:05:01.936562059Z [2024-04-06 00:05:01,936: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3c3e0309-e1ca-44de-b416-462fb98ded67] succeeded in 1.567279041000802s: None 2024-04-06T00:05:02.252551995Z [2024-04-06 00:05:02,251: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T00:05:02.255873900Z [2024-04-06 00:05:02,255: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:05:02.280419958Z [2024-04-06 00:05:02,280: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T00:05:02.284633575Z [2024-04-06 00:05:02,284: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:05:02.284674551Z [2024-04-06 00:05:02,284: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:05:02.284698864Z [2024-04-06 00:05:02,284: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:05:02.284708704Z [2024-04-06 00:05:02,284: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T00:05:02.284943310Z [2024-04-06 00:05:02,284: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T00:05:02.284958920Z [2024-04-06 00:05:02,284: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:05:02.380823479Z [2024-04-06 00:05:02,380: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:05:02.407713021Z [2024-04-06 00:05:02,407: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-06T00:05:02.412544357Z [2024-04-06 00:05:02,411: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:05:02.436623878Z [2024-04-06 00:05:02,436: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T00:05:02.437971616Z [2024-04-06 00:05:02,437: INFO/ForkPoolWorker-2] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:05:02.438107420Z [2024-04-06 00:05:02,437: INFO/ForkPoolWorker-2] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:05:02.438291366Z [2024-04-06 00:05:02,438: INFO/ForkPoolWorker-2] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:05:02.438393522Z [2024-04-06 00:05:02,438: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-06T00:05:02.438734142Z [2024-04-06 00:05:02,438: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-06T00:05:02.438836755Z [2024-04-06 00:05:02,438: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:05:02.462095354Z [2024-04-06 00:05:02,461: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T00:05:02.465779541Z [2024-04-06 00:05:02,465: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:05:02.498471363Z [2024-04-06 00:05:02,498: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T00:05:02.504605709Z [2024-04-06 00:05:02,504: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:05:02.504641319Z [2024-04-06 00:05:02,504: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:05:02.504786602Z [2024-04-06 00:05:02,504: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:05:02.504850910Z [2024-04-06 00:05:02,504: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T00:05:02.505260309Z [2024-04-06 00:05:02,505: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T00:05:02.505268087Z [2024-04-06 00:05:02,505: INFO/ForkPoolWorker-1] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:05:02.526692995Z [2024-04-06 00:05:02,526: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:05:02.622532063Z [2024-04-06 00:05:02,622: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:05:03.031358560Z [2024-04-06 00:05:03,030: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8afd3681-8169-4081-aec9-83226fbdf9c1] succeeded in 2.6697244759998284s: None 2024-04-06T00:05:03.293770770Z [2024-04-06 00:05:03,293: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[248c0ace-c9d4-4e69-a156-a29b7acd2480] received 2024-04-06T00:05:03.305098522Z [2024-04-06 00:05:03,304: INFO/ForkPoolWorker-15] [248c0ace-c9d4-4e69-a156-a29b7acd2480] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'split_metrics', 'scheduled__2024-04-06T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T00:05:03.581182946Z [2024-04-06 00:05:03,577: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T00:05:04.102296335Z [2024-04-06 00:05:04,101: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f28de7dd-cd59-420b-abb2-8a80aeeadd20] succeeded in 3.73072519499965s: None 2024-04-06T00:05:04.817619009Z [2024-04-06 00:05:04,817: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T00:05:04.821437053Z [2024-04-06 00:05:04,820: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:05:04.850981569Z [2024-04-06 00:05:04,848: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T00:05:04.851070393Z [2024-04-06 00:05:04,850: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:05:04.851080237Z [2024-04-06 00:05:04,850: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:05:04.851191614Z [2024-04-06 00:05:04,850: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:05:04.851307371Z [2024-04-06 00:05:04,851: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T00:05:04.851790854Z [2024-04-06 00:05:04,851: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T00:05:04.852075606Z [2024-04-06 00:05:04,851: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:05:04.939475408Z [2024-04-06 00:05:04,939: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:05:05.201233444Z [2024-04-06 00:05:05,200: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[fd0d65d0-85c9-492c-8d23-1915c46a53c5] succeeded in 4.827238006999323s: None 2024-04-06T00:05:05.535471154Z [2024-04-06 00:05:05,534: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[248c0ace-c9d4-4e69-a156-a29b7acd2480] succeeded in 2.235086343000148s: None 2024-04-06T00:05:06.162013050Z [2024-04-06 00:05:06,161: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[58960d5a-7e89-4b2f-88dd-2e6975a96006] received 2024-04-06T00:05:06.171461334Z [2024-04-06 00:05:06,171: INFO/ForkPoolWorker-15] [58960d5a-7e89-4b2f-88dd-2e6975a96006] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'collect_metrics', 'scheduled__2024-04-06T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T00:05:06.448876396Z [2024-04-06 00:05:06,445: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T00:05:07.536463337Z [2024-04-06 00:05:07,535: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T00:05:07.539537886Z [2024-04-06 00:05:07,539: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:05:07.562393932Z [2024-04-06 00:05:07,562: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T00:05:07.563955218Z [2024-04-06 00:05:07,563: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:05:07.563974779Z [2024-04-06 00:05:07,563: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:05:07.564030803Z [2024-04-06 00:05:07,563: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:05:07.564106129Z [2024-04-06 00:05:07,563: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T00:05:07.564412112Z [2024-04-06 00:05:07,564: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T00:05:07.564622596Z [2024-04-06 00:05:07,564: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:05:07.665522381Z [2024-04-06 00:05:07,665: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:05:08.314423090Z [2024-04-06 00:05:08,313: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[58960d5a-7e89-4b2f-88dd-2e6975a96006] succeeded in 2.148226121999869s: None 2024-04-06T00:05:08.519802618Z [2024-04-06 00:05:08,519: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c8e9c600-5f4a-4832-99dd-f953bfb7c660] received 2024-04-06T00:05:08.526639996Z [2024-04-06 00:05:08,526: INFO/ForkPoolWorker-15] [c8e9c600-5f4a-4832-99dd-f953bfb7c660] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'send_prometheus', 'scheduled__2024-04-06T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T00:05:08.844789088Z [2024-04-06 00:05:08,839: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T00:05:09.960622474Z [2024-04-06 00:05:09,960: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T00:05:09.964046074Z [2024-04-06 00:05:09,963: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:05:09.987761823Z [2024-04-06 00:05:09,987: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T00:05:09.989189610Z [2024-04-06 00:05:09,988: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:05:09.989207363Z [2024-04-06 00:05:09,989: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:05:09.989438956Z [2024-04-06 00:05:09,989: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:05:09.989601064Z [2024-04-06 00:05:09,989: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T00:05:09.989932486Z [2024-04-06 00:05:09,989: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T00:05:09.989945623Z [2024-04-06 00:05:09,989: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:05:10.133763732Z [2024-04-06 00:05:10,133: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:05:10.784167309Z [2024-04-06 00:05:10,783: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c8e9c600-5f4a-4832-99dd-f953bfb7c660] succeeded in 2.2618403219994434s: None 2024-04-06T00:06:00.420662755Z [2024-04-06 00:06:00,420: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[17a6f90d-9cbd-40a3-be6c-cc53fa2090fc] received 2024-04-06T00:06:00.425829930Z [2024-04-06 00:06:00,425: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[83f9bab7-1856-4e7f-b444-c2c7aa838e3c] received 2024-04-06T00:06:00.434187349Z [2024-04-06 00:06:00,433: INFO/ForkPoolWorker-15] [17a6f90d-9cbd-40a3-be6c-cc53fa2090fc] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T00:06:00.434534212Z [2024-04-06 00:06:00,434: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[479902d2-9bdf-4fc9-97de-f1f70441e910] received 2024-04-06T00:06:00.438412445Z [2024-04-06 00:06:00,438: INFO/ForkPoolWorker-16] [83f9bab7-1856-4e7f-b444-c2c7aa838e3c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T00:06:00.441304384Z [2024-04-06 00:06:00,441: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[421ffcba-499b-41d9-b0db-5e3ff4367595] received 2024-04-06T00:06:00.452539722Z [2024-04-06 00:06:00,452: INFO/ForkPoolWorker-2] [421ffcba-499b-41d9-b0db-5e3ff4367595] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T00:06:00.455961772Z [2024-04-06 00:06:00,455: INFO/ForkPoolWorker-1] [479902d2-9bdf-4fc9-97de-f1f70441e910] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T00:06:00.785840301Z [2024-04-06 00:06:00,782: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T00:06:00.825501210Z [2024-04-06 00:06:00,821: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T00:06:00.872212225Z [2024-04-06 00:06:00,868: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T00:06:00.895679897Z [2024-04-06 00:06:00,892: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T00:06:01.113092970Z [2024-04-06 00:06:01,112: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-06T00:06:01.118843526Z [2024-04-06 00:06:01,118: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:06:01.139424099Z [2024-04-06 00:06:01,139: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:06:01.154753060Z [2024-04-06 00:06:01,154: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T00:06:01.160439742Z [2024-04-06 00:06:01,160: INFO/ForkPoolWorker-2] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T00:06:01.160832213Z [2024-04-06 00:06:01,160: INFO/ForkPoolWorker-2] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T00:06:01.161023461Z [2024-04-06 00:06:01,160: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-06T00:06:01.161356393Z [2024-04-06 00:06:01,161: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T00:06:01.368661414Z [2024-04-06 00:06:01,368: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:06:01.996437077Z [2024-04-06 00:06:01,995: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[17a6f90d-9cbd-40a3-be6c-cc53fa2090fc] succeeded in 1.5691466959997342s: None 2024-04-06T00:06:02.196323279Z [2024-04-06 00:06:02,195: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[421ffcba-499b-41d9-b0db-5e3ff4367595] succeeded in 1.7509396690002177s: None 2024-04-06T00:06:02.630034834Z [2024-04-06 00:06:02,629: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T00:06:02.635508324Z [2024-04-06 00:06:02,634: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:06:02.678324399Z [2024-04-06 00:06:02,678: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T00:06:02.679720846Z [2024-04-06 00:06:02,679: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:06:02.679760125Z [2024-04-06 00:06:02,679: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:06:02.679953124Z [2024-04-06 00:06:02,679: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:06:02.680018447Z [2024-04-06 00:06:02,679: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T00:06:02.680278869Z [2024-04-06 00:06:02,680: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T00:06:02.680679289Z [2024-04-06 00:06:02,680: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:06:02.698402115Z [2024-04-06 00:06:02,698: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T00:06:02.701923862Z [2024-04-06 00:06:02,701: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:06:02.748193204Z [2024-04-06 00:06:02,747: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T00:06:02.754646519Z [2024-04-06 00:06:02,754: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:06:02.754797937Z [2024-04-06 00:06:02,754: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:06:02.754999938Z [2024-04-06 00:06:02,754: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:06:02.755123046Z [2024-04-06 00:06:02,754: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T00:06:02.755677357Z [2024-04-06 00:06:02,755: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T00:06:02.755799821Z [2024-04-06 00:06:02,755: INFO/ForkPoolWorker-1] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:06:02.814383409Z [2024-04-06 00:06:02,814: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:06:02.895967349Z [2024-04-06 00:06:02,895: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:06:04.850965879Z [2024-04-06 00:06:04,850: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[479902d2-9bdf-4fc9-97de-f1f70441e910] succeeded in 4.408295685000667s: None 2024-04-06T00:06:05.060599432Z [2024-04-06 00:06:05,060: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[83f9bab7-1856-4e7f-b444-c2c7aa838e3c] succeeded in 4.631305896999947s: None 2024-04-06T00:07:00.345252111Z [2024-04-06 00:07:00,344: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b6d0400b-0bae-4893-9166-37fe2008ae5b] received 2024-04-06T00:07:00.350216801Z [2024-04-06 00:07:00,349: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6059d952-1c03-48fe-9bd0-002acb3ac6fe] received 2024-04-06T00:07:00.353034853Z [2024-04-06 00:07:00,352: INFO/ForkPoolWorker-15] [b6d0400b-0bae-4893-9166-37fe2008ae5b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T00:07:00.357110555Z [2024-04-06 00:07:00,356: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aa7b3035-0794-4a9e-afca-7d1c28c0d968] received 2024-04-06T00:07:00.366794887Z [2024-04-06 00:07:00,366: INFO/ForkPoolWorker-16] [6059d952-1c03-48fe-9bd0-002acb3ac6fe] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T00:07:00.374526655Z [2024-04-06 00:07:00,374: INFO/ForkPoolWorker-1] [aa7b3035-0794-4a9e-afca-7d1c28c0d968] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T00:07:00.674870894Z [2024-04-06 00:07:00,671: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T00:07:00.687398258Z [2024-04-06 00:07:00,684: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T00:07:00.706985480Z [2024-04-06 00:07:00,702: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T00:07:00.863601436Z [2024-04-06 00:07:00,860: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-06T00:07:00.872275086Z [2024-04-06 00:07:00,864: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:07:00.901304940Z [2024-04-06 00:07:00,901: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T00:07:00.902876006Z [2024-04-06 00:07:00,902: INFO/ForkPoolWorker-16] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T00:07:00.903013257Z [2024-04-06 00:07:00,902: INFO/ForkPoolWorker-16] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T00:07:00.903131353Z [2024-04-06 00:07:00,902: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-06T00:07:00.903315387Z [2024-04-06 00:07:00,903: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T00:07:01.038812178Z [2024-04-06 00:07:01,038: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:07:01.705848690Z [2024-04-06 00:07:01,705: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6059d952-1c03-48fe-9bd0-002acb3ac6fe] succeeded in 1.351010191999194s: None 2024-04-06T00:07:02.043470758Z [2024-04-06 00:07:02,042: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T00:07:02.046825793Z [2024-04-06 00:07:02,046: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:07:02.075571180Z [2024-04-06 00:07:02,075: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T00:07:02.077207188Z [2024-04-06 00:07:02,076: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:07:02.077280214Z [2024-04-06 00:07:02,077: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:07:02.077518833Z [2024-04-06 00:07:02,077: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:07:02.077574436Z [2024-04-06 00:07:02,077: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T00:07:02.077915992Z [2024-04-06 00:07:02,077: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T00:07:02.077979099Z [2024-04-06 00:07:02,077: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:07:02.166918394Z [2024-04-06 00:07:02,166: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:07:02.167474288Z [2024-04-06 00:07:02,167: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T00:07:02.170806029Z [2024-04-06 00:07:02,170: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:07:02.206711215Z [2024-04-06 00:07:02,206: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T00:07:02.208343666Z [2024-04-06 00:07:02,208: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:07:02.208376952Z [2024-04-06 00:07:02,208: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:07:02.208718760Z [2024-04-06 00:07:02,208: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:07:02.209132527Z [2024-04-06 00:07:02,208: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T00:07:02.209568768Z [2024-04-06 00:07:02,209: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T00:07:02.210221407Z [2024-04-06 00:07:02,209: INFO/ForkPoolWorker-1] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:07:02.307001871Z [2024-04-06 00:07:02,306: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:07:04.101622499Z [2024-04-06 00:07:04,101: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[aa7b3035-0794-4a9e-afca-7d1c28c0d968] succeeded in 3.742308980999951s: None 2024-04-06T00:07:04.397358330Z [2024-04-06 00:07:04,396: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b6d0400b-0bae-4893-9166-37fe2008ae5b] succeeded in 4.050071947000106s: None 2024-04-06T00:08:00.372162731Z [2024-04-06 00:08:00,371: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d2e878bf-691b-4559-abdf-10e482a94aa5] received 2024-04-06T00:08:00.376405489Z [2024-04-06 00:08:00,375: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2e1a0853-ea20-4c0b-87c7-bbffb94d2038] received 2024-04-06T00:08:00.385817184Z [2024-04-06 00:08:00,385: INFO/ForkPoolWorker-16] [2e1a0853-ea20-4c0b-87c7-bbffb94d2038] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T00:08:00.386465244Z [2024-04-06 00:08:00,386: INFO/ForkPoolWorker-15] [d2e878bf-691b-4559-abdf-10e482a94aa5] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T00:08:00.391003491Z [2024-04-06 00:08:00,390: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6e87a4b7-f37c-4947-87c5-3177fd5ed95b] received 2024-04-06T00:08:00.405427175Z [2024-04-06 00:08:00,405: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9e6acdc6-b273-4288-a1ca-e9d70d133bee] received 2024-04-06T00:08:00.421111546Z [2024-04-06 00:08:00,420: INFO/ForkPoolWorker-1] [6e87a4b7-f37c-4947-87c5-3177fd5ed95b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T00:08:00.426216074Z [2024-04-06 00:08:00,425: INFO/ForkPoolWorker-2] [9e6acdc6-b273-4288-a1ca-e9d70d133bee] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T00:08:00.679317683Z [2024-04-06 00:08:00,675: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T00:08:00.815119922Z [2024-04-06 00:08:00,808: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T00:08:00.858852800Z [2024-04-06 00:08:00,853: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T00:08:00.878870021Z [2024-04-06 00:08:00,871: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T00:08:01.074281281Z [2024-04-06 00:08:01,073: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-06T00:08:01.078667020Z [2024-04-06 00:08:01,078: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:08:01.103939776Z [2024-04-06 00:08:01,103: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:08:01.104815572Z [2024-04-06 00:08:01,104: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T00:08:01.108222940Z [2024-04-06 00:08:01,107: INFO/ForkPoolWorker-2] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T00:08:01.108482088Z [2024-04-06 00:08:01,108: INFO/ForkPoolWorker-2] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T00:08:01.108628491Z [2024-04-06 00:08:01,108: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-06T00:08:01.109016488Z [2024-04-06 00:08:01,108: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T00:08:01.221520305Z [2024-04-06 00:08:01,221: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:08:01.695123936Z [2024-04-06 00:08:01,694: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d2e878bf-691b-4559-abdf-10e482a94aa5] succeeded in 1.3181512460005251s: None 2024-04-06T00:08:01.794535481Z [2024-04-06 00:08:01,794: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[9e6acdc6-b273-4288-a1ca-e9d70d133bee] succeeded in 1.3831291799997416s: None 2024-04-06T00:08:02.165919463Z [2024-04-06 00:08:02,165: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T00:08:02.169519672Z [2024-04-06 00:08:02,169: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:08:02.195040004Z [2024-04-06 00:08:02,194: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T00:08:02.196556611Z [2024-04-06 00:08:02,196: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:08:02.196686556Z [2024-04-06 00:08:02,196: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:08:02.196896163Z [2024-04-06 00:08:02,196: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:08:02.197011480Z [2024-04-06 00:08:02,196: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T00:08:02.197495441Z [2024-04-06 00:08:02,197: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T00:08:02.197649448Z [2024-04-06 00:08:02,197: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:08:02.254622722Z [2024-04-06 00:08:02,254: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T00:08:02.259019863Z [2024-04-06 00:08:02,258: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:08:02.277865692Z [2024-04-06 00:08:02,277: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T00:08:02.279417289Z [2024-04-06 00:08:02,279: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:08:02.279520076Z [2024-04-06 00:08:02,279: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:08:02.279739782Z [2024-04-06 00:08:02,279: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:08:02.279828520Z [2024-04-06 00:08:02,279: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T00:08:02.280185754Z [2024-04-06 00:08:02,280: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-06T00:08:02.280232396Z [2024-04-06 00:08:02,280: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:08:02.315210920Z [2024-04-06 00:08:02,314: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:08:02.384731304Z [2024-04-06 00:08:02,384: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:08:03.980846420Z [2024-04-06 00:08:03,980: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2e1a0853-ea20-4c0b-87c7-bbffb94d2038] succeeded in 3.6009266689998185s: None 2024-04-06T00:08:04.988643292Z [2024-04-06 00:08:04,988: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6e87a4b7-f37c-4947-87c5-3177fd5ed95b] succeeded in 4.579999460999716s: None 2024-04-06T00:09:00.341827529Z [2024-04-06 00:09:00,341: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[95e52175-ee08-4142-8745-6da7a98bb753] received 2024-04-06T00:09:00.343530784Z [2024-04-06 00:09:00,343: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7e8c243e-3ed6-483a-ad33-7e3f6f9df44b] received 2024-04-06T00:09:00.352125715Z [2024-04-06 00:09:00,351: INFO/ForkPoolWorker-15] [95e52175-ee08-4142-8745-6da7a98bb753] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T00:09:00.354319502Z [2024-04-06 00:09:00,354: INFO/ForkPoolWorker-16] [7e8c243e-3ed6-483a-ad33-7e3f6f9df44b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T00:09:00.357754159Z [2024-04-06 00:09:00,357: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f4700ffa-1fdc-4f0b-8d5a-62bdc32df6ab] received 2024-04-06T00:09:00.366098748Z [2024-04-06 00:09:00,365: INFO/ForkPoolWorker-1] [f4700ffa-1fdc-4f0b-8d5a-62bdc32df6ab] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T00:09:00.643325821Z [2024-04-06 00:09:00,640: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T00:09:00.653413978Z [2024-04-06 00:09:00,650: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T00:09:00.661759882Z [2024-04-06 00:09:00,658: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T00:09:00.841019847Z [2024-04-06 00:09:00,840: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-06T00:09:00.845751322Z [2024-04-06 00:09:00,845: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:09:00.872000922Z [2024-04-06 00:09:00,871: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T00:09:00.873207689Z [2024-04-06 00:09:00,872: INFO/ForkPoolWorker-16] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T00:09:00.873369016Z [2024-04-06 00:09:00,873: INFO/ForkPoolWorker-16] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T00:09:00.873472652Z [2024-04-06 00:09:00,873: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-06T00:09:00.873773496Z [2024-04-06 00:09:00,873: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T00:09:00.992770082Z [2024-04-06 00:09:00,992: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:09:01.635682498Z [2024-04-06 00:09:01,635: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7e8c243e-3ed6-483a-ad33-7e3f6f9df44b] succeeded in 1.2891763349998655s: None 2024-04-06T00:09:01.829254824Z [2024-04-06 00:09:01,828: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T00:09:01.832473355Z [2024-04-06 00:09:01,831: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:09:01.852617645Z [2024-04-06 00:09:01,852: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T00:09:01.853974415Z [2024-04-06 00:09:01,853: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:09:01.853989784Z [2024-04-06 00:09:01,853: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:09:01.854125050Z [2024-04-06 00:09:01,853: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:09:01.854138203Z [2024-04-06 00:09:01,854: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T00:09:01.854394321Z [2024-04-06 00:09:01,854: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T00:09:01.854405599Z [2024-04-06 00:09:01,854: INFO/ForkPoolWorker-1] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:09:01.907541128Z [2024-04-06 00:09:01,905: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T00:09:01.915391957Z [2024-04-06 00:09:01,910: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:09:01.957638541Z [2024-04-06 00:09:01,955: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T00:09:01.958222656Z [2024-04-06 00:09:01,957: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:09:01.958233026Z [2024-04-06 00:09:01,957: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:09:01.959535410Z [2024-04-06 00:09:01,958: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:09:01.959633792Z [2024-04-06 00:09:01,959: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T00:09:01.959885328Z [2024-04-06 00:09:01,959: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T00:09:01.959939697Z [2024-04-06 00:09:01,959: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:09:01.976978050Z [2024-04-06 00:09:01,975: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:09:02.076032143Z [2024-04-06 00:09:02,075: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:09:03.570273454Z [2024-04-06 00:09:03,569: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f4700ffa-1fdc-4f0b-8d5a-62bdc32df6ab] succeeded in 3.210726362999594s: None 2024-04-06T00:09:04.059524109Z [2024-04-06 00:09:04,058: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[95e52175-ee08-4142-8745-6da7a98bb753] succeeded in 3.7158819280002717s: None 2024-04-06T00:10:00.815045416Z [2024-04-06 00:10:00,814: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9bdc4db7-92b0-496a-9e7c-b84cca8139cf] received 2024-04-06T00:10:00.823512789Z [2024-04-06 00:10:00,822: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4164e30b-f6a9-41d1-9fd1-10ec673e030e] received 2024-04-06T00:10:00.829156053Z [2024-04-06 00:10:00,828: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7f3ad78b-9d5e-45da-b82a-5be264387eb5] received 2024-04-06T00:10:00.830876462Z [2024-04-06 00:10:00,830: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d07b3422-4ee4-4693-873b-73ca6bb05d1c] received 2024-04-06T00:10:00.835781762Z [2024-04-06 00:10:00,835: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[843d0255-ca42-4b40-b78f-dcbedafddd1a] received 2024-04-06T00:10:00.842764273Z [2024-04-06 00:10:00,842: INFO/ForkPoolWorker-16] [4164e30b-f6a9-41d1-9fd1-10ec673e030e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T00:10:00.847038783Z [2024-04-06 00:10:00,846: INFO/ForkPoolWorker-1] [7f3ad78b-9d5e-45da-b82a-5be264387eb5] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T00:10:00.847222725Z [2024-04-06 00:10:00,847: INFO/ForkPoolWorker-15] [9bdc4db7-92b0-496a-9e7c-b84cca8139cf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T00:10:00.855726425Z [2024-04-06 00:10:00,854: INFO/ForkPoolWorker-3] [843d0255-ca42-4b40-b78f-dcbedafddd1a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T00:10:00.860610705Z [2024-04-06 00:10:00,860: INFO/ForkPoolWorker-2] [d07b3422-4ee4-4693-873b-73ca6bb05d1c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T00:10:01.202285631Z [2024-04-06 00:10:01,197: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T00:10:01.275289509Z [2024-04-06 00:10:01,272: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T00:10:01.282864932Z [2024-04-06 00:10:01,277: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T00:10:01.290852425Z [2024-04-06 00:10:01,287: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T00:10:01.416194872Z [2024-04-06 00:10:01,415: INFO/ForkPoolWorker-3] Getting SDNC list 2024-04-06T00:10:01.416315521Z [2024-04-06 00:10:01,413: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T00:10:01.420513430Z [2024-04-06 00:10:01,420: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:10:01.460521740Z [2024-04-06 00:10:01,460: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-06T00:10:01.462497366Z [2024-04-06 00:10:01,462: INFO/ForkPoolWorker-3] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T00:10:01.462813110Z [2024-04-06 00:10:01,462: INFO/ForkPoolWorker-3] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T00:10:01.463025216Z [2024-04-06 00:10:01,462: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-04-06T00:10:01.464118541Z [2024-04-06 00:10:01,463: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T00:10:01.570364018Z [2024-04-06 00:10:01,570: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:10:01.756958546Z [2024-04-06 00:10:01,756: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:10:02.405027785Z [2024-04-06 00:10:02,404: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[843d0255-ca42-4b40-b78f-dcbedafddd1a] succeeded in 1.5614416159996836s: None 2024-04-06T00:10:02.437467213Z [2024-04-06 00:10:02,436: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7f3ad78b-9d5e-45da-b82a-5be264387eb5] succeeded in 1.604274259999329s: None 2024-04-06T00:10:02.797279613Z [2024-04-06 00:10:02,796: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T00:10:02.800704228Z [2024-04-06 00:10:02,800: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:10:02.814469648Z [2024-04-06 00:10:02,814: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-06T00:10:02.820433916Z [2024-04-06 00:10:02,818: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:10:02.828642770Z [2024-04-06 00:10:02,828: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T00:10:02.830174330Z [2024-04-06 00:10:02,829: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:10:02.830301913Z [2024-04-06 00:10:02,830: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:10:02.830484517Z [2024-04-06 00:10:02,830: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:10:02.830588559Z [2024-04-06 00:10:02,830: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T00:10:02.830897032Z [2024-04-06 00:10:02,830: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T00:10:02.831038490Z [2024-04-06 00:10:02,830: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:10:02.872134426Z [2024-04-06 00:10:02,871: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T00:10:02.875800324Z [2024-04-06 00:10:02,875: INFO/ForkPoolWorker-2] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:10:02.876168698Z [2024-04-06 00:10:02,875: INFO/ForkPoolWorker-2] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:10:02.876468338Z [2024-04-06 00:10:02,876: INFO/ForkPoolWorker-2] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:10:02.876668162Z [2024-04-06 00:10:02,876: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-06T00:10:02.877160625Z [2024-04-06 00:10:02,876: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T00:10:02.877492163Z [2024-04-06 00:10:02,877: INFO/ForkPoolWorker-2] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:10:02.894795829Z [2024-04-06 00:10:02,894: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T00:10:02.898769366Z [2024-04-06 00:10:02,897: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:10:02.936032793Z [2024-04-06 00:10:02,935: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T00:10:02.937793704Z [2024-04-06 00:10:02,937: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:10:02.937804570Z [2024-04-06 00:10:02,937: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:10:02.937997713Z [2024-04-06 00:10:02,937: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:10:02.938045624Z [2024-04-06 00:10:02,937: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T00:10:02.938369087Z [2024-04-06 00:10:02,938: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T00:10:02.938441391Z [2024-04-06 00:10:02,938: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:10:02.940079581Z [2024-04-06 00:10:02,939: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:10:03.032815226Z [2024-04-06 00:10:03,031: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:10:03.109183082Z [2024-04-06 00:10:03,107: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:10:03.586271384Z [2024-04-06 00:10:03,585: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9bdc4db7-92b0-496a-9e7c-b84cca8139cf] succeeded in 2.7593595400003323s: None 2024-04-06T00:10:04.084394289Z [2024-04-06 00:10:04,084: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9833424c-f003-4793-96b6-1dc84a012349] received 2024-04-06T00:10:04.095507617Z [2024-04-06 00:10:04,095: INFO/ForkPoolWorker-15] [9833424c-f003-4793-96b6-1dc84a012349] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'split_metrics', 'scheduled__2024-04-06T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T00:10:04.410393125Z [2024-04-06 00:10:04,406: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T00:10:04.515747860Z [2024-04-06 00:10:04,512: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d07b3422-4ee4-4693-873b-73ca6bb05d1c] succeeded in 3.67926471499959s: None 2024-04-06T00:10:05.599566507Z [2024-04-06 00:10:05,598: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T00:10:05.602912375Z [2024-04-06 00:10:05,602: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:10:05.629817075Z [2024-04-06 00:10:05,629: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T00:10:05.631548160Z [2024-04-06 00:10:05,631: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:10:05.631617898Z [2024-04-06 00:10:05,631: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:10:05.631734718Z [2024-04-06 00:10:05,631: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:10:05.631759238Z [2024-04-06 00:10:05,631: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T00:10:05.632075453Z [2024-04-06 00:10:05,631: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T00:10:05.632083107Z [2024-04-06 00:10:05,631: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:10:05.747661703Z [2024-04-06 00:10:05,746: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:10:05.976675274Z [2024-04-06 00:10:05,976: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4164e30b-f6a9-41d1-9fd1-10ec673e030e] succeeded in 5.149949528999969s: None 2024-04-06T00:10:06.467518425Z [2024-04-06 00:10:06,467: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9ac3131d-ad4f-4144-b02e-acb4bb0a9d7c] received 2024-04-06T00:10:06.474360513Z [2024-04-06 00:10:06,474: INFO/ForkPoolWorker-16] [9ac3131d-ad4f-4144-b02e-acb4bb0a9d7c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'collect_metrics', 'scheduled__2024-04-06T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T00:10:06.517899807Z [2024-04-06 00:10:06,517: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9833424c-f003-4793-96b6-1dc84a012349] succeeded in 2.429296961999171s: None 2024-04-06T00:10:06.748516201Z [2024-04-06 00:10:06,745: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T00:10:07.816110080Z [2024-04-06 00:10:07,815: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T00:10:07.819472445Z [2024-04-06 00:10:07,818: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:10:07.845685204Z [2024-04-06 00:10:07,845: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T00:10:07.847097962Z [2024-04-06 00:10:07,846: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:10:07.847339416Z [2024-04-06 00:10:07,847: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:10:07.847758516Z [2024-04-06 00:10:07,847: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:10:07.847919404Z [2024-04-06 00:10:07,847: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T00:10:07.848406217Z [2024-04-06 00:10:07,848: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T00:10:07.848614404Z [2024-04-06 00:10:07,848: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:10:07.960402329Z [2024-04-06 00:10:07,959: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:10:08.523387305Z [2024-04-06 00:10:08,522: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4456b945-83d7-4803-bd3c-b7151a3ba255] received 2024-04-06T00:10:08.533894520Z [2024-04-06 00:10:08,533: INFO/ForkPoolWorker-15] [4456b945-83d7-4803-bd3c-b7151a3ba255] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'send_prometheus', 'scheduled__2024-04-06T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T00:10:08.566419950Z [2024-04-06 00:10:08,564: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9ac3131d-ad4f-4144-b02e-acb4bb0a9d7c] succeeded in 2.095621668999229s: None 2024-04-06T00:10:08.837143761Z [2024-04-06 00:10:08,834: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T00:10:09.949966218Z [2024-04-06 00:10:09,949: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T00:10:09.953413917Z [2024-04-06 00:10:09,952: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:10:09.989502824Z [2024-04-06 00:10:09,989: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T00:10:09.991108239Z [2024-04-06 00:10:09,990: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:10:09.991123042Z [2024-04-06 00:10:09,991: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:10:09.991234295Z [2024-04-06 00:10:09,991: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:10:09.991376223Z [2024-04-06 00:10:09,991: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T00:10:09.992125053Z [2024-04-06 00:10:09,991: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T00:10:09.992259266Z [2024-04-06 00:10:09,992: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:10:10.165848916Z [2024-04-06 00:10:10,165: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:10:10.755698165Z [2024-04-06 00:10:10,754: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4456b945-83d7-4803-bd3c-b7151a3ba255] succeeded in 2.22930246299984s: None 2024-04-06T00:11:01.227716434Z [2024-04-06 00:11:01,227: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[389a106a-d106-4631-9b48-32cc671d5a2d] received 2024-04-06T00:11:01.229710720Z [2024-04-06 00:11:01,229: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4dc2de2d-2c83-4ea4-a0c0-427e6ec92eb2] received 2024-04-06T00:11:01.242450920Z [2024-04-06 00:11:01,242: INFO/ForkPoolWorker-15] [389a106a-d106-4631-9b48-32cc671d5a2d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T00:11:01.248366260Z [2024-04-06 00:11:01,248: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[38b41be2-947e-4834-a18e-d395cc6cfd0a] received 2024-04-06T00:11:01.253838219Z [2024-04-06 00:11:01,250: INFO/ForkPoolWorker-16] [4dc2de2d-2c83-4ea4-a0c0-427e6ec92eb2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T00:11:01.257194003Z [2024-04-06 00:11:01,256: INFO/ForkPoolWorker-1] [38b41be2-947e-4834-a18e-d395cc6cfd0a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T00:11:01.555137307Z [2024-04-06 00:11:01,551: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T00:11:01.587892143Z [2024-04-06 00:11:01,584: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T00:11:01.609202076Z [2024-04-06 00:11:01,605: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T00:11:01.726049924Z [2024-04-06 00:11:01,725: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-06T00:11:01.730288655Z [2024-04-06 00:11:01,729: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:11:01.764392819Z [2024-04-06 00:11:01,764: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T00:11:01.768145876Z [2024-04-06 00:11:01,767: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T00:11:01.768354787Z [2024-04-06 00:11:01,768: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T00:11:01.768524954Z [2024-04-06 00:11:01,768: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-06T00:11:01.768869740Z [2024-04-06 00:11:01,768: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T00:11:01.875340982Z [2024-04-06 00:11:01,874: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:11:02.517957287Z [2024-04-06 00:11:02,517: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[38b41be2-947e-4834-a18e-d395cc6cfd0a] succeeded in 1.2678146599992033s: None 2024-04-06T00:11:02.867303433Z [2024-04-06 00:11:02,866: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T00:11:02.870377243Z [2024-04-06 00:11:02,869: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:11:02.900587001Z [2024-04-06 00:11:02,900: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T00:11:02.902332052Z [2024-04-06 00:11:02,902: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:11:02.902376599Z [2024-04-06 00:11:02,902: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:11:02.902548308Z [2024-04-06 00:11:02,902: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:11:02.902613375Z [2024-04-06 00:11:02,902: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T00:11:02.902901467Z [2024-04-06 00:11:02,902: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T00:11:02.902978745Z [2024-04-06 00:11:02,902: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:11:02.942566679Z [2024-04-06 00:11:02,942: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T00:11:02.948696503Z [2024-04-06 00:11:02,948: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:11:02.978363692Z [2024-04-06 00:11:02,978: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T00:11:02.993018901Z [2024-04-06 00:11:02,992: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:11:02.993344468Z [2024-04-06 00:11:02,993: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:11:02.993721656Z [2024-04-06 00:11:02,993: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:11:02.993807105Z [2024-04-06 00:11:02,993: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T00:11:02.994385199Z [2024-04-06 00:11:02,994: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T00:11:02.994400313Z [2024-04-06 00:11:02,994: INFO/ForkPoolWorker-15] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:11:03.020529279Z [2024-04-06 00:11:03,020: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:11:03.127957980Z [2024-04-06 00:11:03,127: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:11:04.890619744Z [2024-04-06 00:11:04,889: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[389a106a-d106-4631-9b48-32cc671d5a2d] succeeded in 3.6575533420000284s: None 2024-04-06T00:11:05.100660225Z [2024-04-06 00:11:05,100: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4dc2de2d-2c83-4ea4-a0c0-427e6ec92eb2] succeeded in 3.8614646490004816s: None 2024-04-06T00:12:01.113405632Z [2024-04-06 00:12:01,112: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6ac8907b-eb84-42bf-91e2-70809191f2de] received 2024-04-06T00:12:01.118727773Z [2024-04-06 00:12:01,118: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b05c6152-66ad-4e15-9c18-15285b26541c] received 2024-04-06T00:12:01.127965750Z [2024-04-06 00:12:01,127: INFO/ForkPoolWorker-16] [b05c6152-66ad-4e15-9c18-15285b26541c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T00:12:01.128527144Z [2024-04-06 00:12:01,127: INFO/ForkPoolWorker-15] [6ac8907b-eb84-42bf-91e2-70809191f2de] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T00:12:01.135367557Z [2024-04-06 00:12:01,134: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9b57cac5-6401-4e9b-a4c5-21293a5a16f4] received 2024-04-06T00:12:01.142182892Z [2024-04-06 00:12:01,141: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0f7acf52-6cc4-4fe4-8b6a-6944b949a3b9] received 2024-04-06T00:12:01.151984648Z [2024-04-06 00:12:01,151: INFO/ForkPoolWorker-1] [9b57cac5-6401-4e9b-a4c5-21293a5a16f4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T00:12:01.154052816Z [2024-04-06 00:12:01,153: INFO/ForkPoolWorker-2] [0f7acf52-6cc4-4fe4-8b6a-6944b949a3b9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T00:12:01.452990369Z [2024-04-06 00:12:01,449: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T00:12:01.489937340Z [2024-04-06 00:12:01,486: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T00:12:01.583095201Z [2024-04-06 00:12:01,578: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T00:12:01.628219855Z [2024-04-06 00:12:01,623: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T00:12:01.733529633Z [2024-04-06 00:12:01,733: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-06T00:12:01.737730467Z [2024-04-06 00:12:01,737: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:12:01.795934459Z [2024-04-06 00:12:01,795: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T00:12:01.797422020Z [2024-04-06 00:12:01,797: INFO/ForkPoolWorker-2] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T00:12:01.797700468Z [2024-04-06 00:12:01,797: INFO/ForkPoolWorker-2] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T00:12:01.797931822Z [2024-04-06 00:12:01,797: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-06T00:12:01.798287639Z [2024-04-06 00:12:01,798: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T00:12:01.809974925Z [2024-04-06 00:12:01,809: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:12:01.918497339Z [2024-04-06 00:12:01,918: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:12:02.455007217Z [2024-04-06 00:12:02,454: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6ac8907b-eb84-42bf-91e2-70809191f2de] succeeded in 1.339886024000407s: None 2024-04-06T00:12:02.642737245Z [2024-04-06 00:12:02,642: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[0f7acf52-6cc4-4fe4-8b6a-6944b949a3b9] succeeded in 1.496935189999931s: None 2024-04-06T00:12:02.937734198Z [2024-04-06 00:12:02,937: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T00:12:02.941117250Z [2024-04-06 00:12:02,940: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:12:02.968491696Z [2024-04-06 00:12:02,968: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T00:12:02.972433581Z [2024-04-06 00:12:02,972: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:12:02.972496604Z [2024-04-06 00:12:02,972: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:12:02.972836847Z [2024-04-06 00:12:02,972: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:12:02.972939052Z [2024-04-06 00:12:02,972: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T00:12:02.973428056Z [2024-04-06 00:12:02,973: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T00:12:02.973628681Z [2024-04-06 00:12:02,973: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:12:03.065990091Z [2024-04-06 00:12:03,065: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T00:12:03.069556268Z [2024-04-06 00:12:03,068: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:12:03.089641187Z [2024-04-06 00:12:03,089: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T00:12:03.090883529Z [2024-04-06 00:12:03,090: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:12:03.090908058Z [2024-04-06 00:12:03,090: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:12:03.091118658Z [2024-04-06 00:12:03,090: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:12:03.091132548Z [2024-04-06 00:12:03,091: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T00:12:03.091774734Z [2024-04-06 00:12:03,091: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T00:12:03.091785755Z [2024-04-06 00:12:03,091: INFO/ForkPoolWorker-1] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:12:03.100810350Z [2024-04-06 00:12:03,100: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:12:03.178379585Z [2024-04-06 00:12:03,177: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:12:05.323460491Z [2024-04-06 00:12:05,320: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9b57cac5-6401-4e9b-a4c5-21293a5a16f4] succeeded in 4.17781068900058s: None 2024-04-06T00:12:05.721672429Z [2024-04-06 00:12:05,721: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b05c6152-66ad-4e15-9c18-15285b26541c] succeeded in 4.600915089999944s: None 2024-04-06T00:13:01.040106036Z [2024-04-06 00:13:01,039: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2be2e143-dbfc-4ffe-8d91-334717c25714] received 2024-04-06T00:13:01.047451501Z [2024-04-06 00:13:01,046: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bd308612-9bb1-425b-8703-385b74415b07] received 2024-04-06T00:13:01.054294569Z [2024-04-06 00:13:01,053: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e3c9c125-45de-43a4-8b65-97820c287c05] received 2024-04-06T00:13:01.056006150Z [2024-04-06 00:13:01,055: INFO/ForkPoolWorker-15] [2be2e143-dbfc-4ffe-8d91-334717c25714] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T00:13:01.059144816Z [2024-04-06 00:13:01,058: INFO/ForkPoolWorker-16] [bd308612-9bb1-425b-8703-385b74415b07] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T00:13:01.078507145Z [2024-04-06 00:13:01,077: INFO/ForkPoolWorker-1] [e3c9c125-45de-43a4-8b65-97820c287c05] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T00:13:01.382431962Z [2024-04-06 00:13:01,378: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T00:13:01.386544944Z [2024-04-06 00:13:01,382: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T00:13:01.408322790Z [2024-04-06 00:13:01,404: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T00:13:01.555817795Z [2024-04-06 00:13:01,555: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-06T00:13:01.560261635Z [2024-04-06 00:13:01,559: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:13:01.583610717Z [2024-04-06 00:13:01,583: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T00:13:01.584895246Z [2024-04-06 00:13:01,584: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T00:13:01.585146718Z [2024-04-06 00:13:01,584: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T00:13:01.585481343Z [2024-04-06 00:13:01,585: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-06T00:13:01.585770484Z [2024-04-06 00:13:01,585: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T00:13:01.705011718Z [2024-04-06 00:13:01,704: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:13:02.454244872Z [2024-04-06 00:13:02,453: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e3c9c125-45de-43a4-8b65-97820c287c05] succeeded in 1.3961233119998724s: None 2024-04-06T00:13:02.741619405Z [2024-04-06 00:13:02,741: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T00:13:02.745377675Z [2024-04-06 00:13:02,744: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:13:02.767620933Z [2024-04-06 00:13:02,767: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T00:13:02.769261407Z [2024-04-06 00:13:02,769: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:13:02.769398924Z [2024-04-06 00:13:02,769: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:13:02.769609536Z [2024-04-06 00:13:02,769: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:13:02.769757865Z [2024-04-06 00:13:02,769: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T00:13:02.770200051Z [2024-04-06 00:13:02,769: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T00:13:02.770307491Z [2024-04-06 00:13:02,770: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:13:02.779042499Z [2024-04-06 00:13:02,778: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T00:13:02.783130768Z [2024-04-06 00:13:02,782: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:13:02.805650951Z [2024-04-06 00:13:02,805: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T00:13:02.806922169Z [2024-04-06 00:13:02,806: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:13:02.806928953Z [2024-04-06 00:13:02,806: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:13:02.807037345Z [2024-04-06 00:13:02,806: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:13:02.807042887Z [2024-04-06 00:13:02,806: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T00:13:02.807299021Z [2024-04-06 00:13:02,807: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T00:13:02.807349781Z [2024-04-06 00:13:02,807: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:13:02.871416517Z [2024-04-06 00:13:02,871: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:13:02.905425583Z [2024-04-06 00:13:02,905: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:13:04.918170486Z [2024-04-06 00:13:04,917: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[bd308612-9bb1-425b-8703-385b74415b07] succeeded in 3.868951602999914s: None 2024-04-06T00:13:06.046184043Z [2024-04-06 00:13:06,044: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2be2e143-dbfc-4ffe-8d91-334717c25714] succeeded in 5.001225183000315s: None 2024-04-06T00:14:00.472543482Z [2024-04-06 00:14:00,472: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c271b3cc-d3bc-4eb1-846b-014d1a29b4ee] received 2024-04-06T00:14:00.478357821Z [2024-04-06 00:14:00,478: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[84885298-5ca7-42ab-8ac4-6aa7521b487e] received 2024-04-06T00:14:00.485102997Z [2024-04-06 00:14:00,484: INFO/ForkPoolWorker-15] [c271b3cc-d3bc-4eb1-846b-014d1a29b4ee] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T00:14:00.486095872Z [2024-04-06 00:14:00,485: INFO/ForkPoolWorker-16] [84885298-5ca7-42ab-8ac4-6aa7521b487e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T00:14:00.491921098Z [2024-04-06 00:14:00,491: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[466f89fb-b15c-4e70-8247-0a4bc2fb3afd] received 2024-04-06T00:14:00.499666286Z [2024-04-06 00:14:00,499: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3d1b109a-744d-49d5-853c-00007ea6389a] received 2024-04-06T00:14:00.502195196Z [2024-04-06 00:14:00,501: INFO/ForkPoolWorker-1] [466f89fb-b15c-4e70-8247-0a4bc2fb3afd] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T00:14:00.513486564Z [2024-04-06 00:14:00,513: INFO/ForkPoolWorker-2] [3d1b109a-744d-49d5-853c-00007ea6389a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T00:14:00.878237526Z [2024-04-06 00:14:00,874: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T00:14:00.989039670Z [2024-04-06 00:14:00,980: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T00:14:01.045753979Z [2024-04-06 00:14:01,037: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T00:14:01.095583711Z [2024-04-06 00:14:01,089: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T00:14:01.318789916Z [2024-04-06 00:14:01,318: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-06T00:14:01.323053132Z [2024-04-06 00:14:01,322: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:14:01.380446521Z [2024-04-06 00:14:01,380: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T00:14:01.384223925Z [2024-04-06 00:14:01,383: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T00:14:01.384457715Z [2024-04-06 00:14:01,384: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T00:14:01.384630499Z [2024-04-06 00:14:01,384: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-06T00:14:01.384923828Z [2024-04-06 00:14:01,384: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T00:14:01.491898130Z [2024-04-06 00:14:01,491: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:14:01.502774982Z [2024-04-06 00:14:01,502: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:14:02.096719950Z [2024-04-06 00:14:02,096: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[466f89fb-b15c-4e70-8247-0a4bc2fb3afd] succeeded in 1.6022579549999136s: None 2024-04-06T00:14:02.107407745Z [2024-04-06 00:14:02,106: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c271b3cc-d3bc-4eb1-846b-014d1a29b4ee] succeeded in 1.632010676000391s: None 2024-04-06T00:14:02.505521468Z [2024-04-06 00:14:02,504: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-06T00:14:02.506937225Z [2024-04-06 00:14:02,506: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T00:14:02.510539737Z [2024-04-06 00:14:02,510: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:14:02.511806591Z [2024-04-06 00:14:02,511: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:14:02.530225859Z [2024-04-06 00:14:02,529: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T00:14:02.531678864Z [2024-04-06 00:14:02,531: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:14:02.531695317Z [2024-04-06 00:14:02,531: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:14:02.531864433Z [2024-04-06 00:14:02,531: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:14:02.531949771Z [2024-04-06 00:14:02,531: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T00:14:02.532243975Z [2024-04-06 00:14:02,532: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T00:14:02.532297149Z [2024-04-06 00:14:02,532: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:14:02.533769318Z [2024-04-06 00:14:02,533: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T00:14:02.534950502Z [2024-04-06 00:14:02,534: INFO/ForkPoolWorker-2] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:14:02.534961730Z [2024-04-06 00:14:02,534: INFO/ForkPoolWorker-2] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:14:02.535372188Z [2024-04-06 00:14:02,535: INFO/ForkPoolWorker-2] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:14:02.535394869Z [2024-04-06 00:14:02,535: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-06T00:14:02.535990746Z [2024-04-06 00:14:02,535: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T00:14:02.536002562Z [2024-04-06 00:14:02,535: INFO/ForkPoolWorker-2] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:14:02.621599771Z [2024-04-06 00:14:02,621: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:14:02.628989584Z [2024-04-06 00:14:02,628: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:14:05.198796152Z [2024-04-06 00:14:05,198: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[3d1b109a-744d-49d5-853c-00007ea6389a] succeeded in 4.694385382999826s: None 2024-04-06T00:14:05.928738748Z [2024-04-06 00:14:05,928: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[84885298-5ca7-42ab-8ac4-6aa7521b487e] succeeded in 5.448398464000093s: None 2024-04-06T00:15:01.026732089Z [2024-04-06 00:15:01,026: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[700177ab-9b4c-4217-b45e-242a971d4c72] received 2024-04-06T00:15:01.032961929Z [2024-04-06 00:15:01,032: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[04c99a2a-aba2-44ea-b92f-aafb63f144c4] received 2024-04-06T00:15:01.035398104Z [2024-04-06 00:15:01,035: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ad4e4366-e2e9-48d4-8b8c-7c3e70401378] received 2024-04-06T00:15:01.036165862Z [2024-04-06 00:15:01,035: INFO/ForkPoolWorker-15] [700177ab-9b4c-4217-b45e-242a971d4c72] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T00:15:01.045163512Z [2024-04-06 00:15:01,044: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[959ad5de-eef6-43e0-8ee3-07c8f703b516] received 2024-04-06T00:15:01.050401779Z [2024-04-06 00:15:01,050: INFO/ForkPoolWorker-1] [ad4e4366-e2e9-48d4-8b8c-7c3e70401378] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T00:15:01.054721840Z [2024-04-06 00:15:01,053: INFO/ForkPoolWorker-16] [04c99a2a-aba2-44ea-b92f-aafb63f144c4] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T00:15:01.057172086Z [2024-04-06 00:15:01,056: INFO/ForkPoolWorker-2] [959ad5de-eef6-43e0-8ee3-07c8f703b516] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T00:15:01.422993354Z [2024-04-06 00:15:01,418: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T00:15:01.427107967Z [2024-04-06 00:15:01,423: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T00:15:01.490408946Z [2024-04-06 00:15:01,486: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T00:15:01.498567196Z [2024-04-06 00:15:01,495: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T00:15:01.596338994Z [2024-04-06 00:15:01,595: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-06T00:15:01.600414669Z [2024-04-06 00:15:01,599: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:15:01.640174193Z [2024-04-06 00:15:01,639: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T00:15:01.641432103Z [2024-04-06 00:15:01,641: INFO/ForkPoolWorker-16] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T00:15:01.641584616Z [2024-04-06 00:15:01,641: INFO/ForkPoolWorker-16] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T00:15:01.641646454Z [2024-04-06 00:15:01,641: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-06T00:15:01.641908364Z [2024-04-06 00:15:01,641: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T00:15:01.756980069Z [2024-04-06 00:15:01,756: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:15:02.655403045Z [2024-04-06 00:15:02,654: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[04c99a2a-aba2-44ea-b92f-aafb63f144c4] succeeded in 1.619805604999783s: None 2024-04-06T00:15:03.138274141Z [2024-04-06 00:15:03,137: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-06T00:15:03.141692136Z [2024-04-06 00:15:03,141: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:15:03.171606536Z [2024-04-06 00:15:03,171: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T00:15:03.172839650Z [2024-04-06 00:15:03,172: INFO/ForkPoolWorker-2] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:15:03.172851923Z [2024-04-06 00:15:03,172: INFO/ForkPoolWorker-2] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:15:03.172976723Z [2024-04-06 00:15:03,172: INFO/ForkPoolWorker-2] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:15:03.173119843Z [2024-04-06 00:15:03,172: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-06T00:15:03.174031221Z [2024-04-06 00:15:03,173: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T00:15:03.174069023Z [2024-04-06 00:15:03,173: INFO/ForkPoolWorker-2] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:15:03.338209692Z [2024-04-06 00:15:03,337: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T00:15:03.341505497Z [2024-04-06 00:15:03,341: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:15:03.392041192Z [2024-04-06 00:15:03,391: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T00:15:03.397091123Z [2024-04-06 00:15:03,396: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:15:03.397630445Z [2024-04-06 00:15:03,397: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:15:03.398010761Z [2024-04-06 00:15:03,397: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:15:03.398291465Z [2024-04-06 00:15:03,398: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T00:15:03.399144808Z [2024-04-06 00:15:03,398: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T00:15:03.399500502Z [2024-04-06 00:15:03,399: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:15:03.420262525Z [2024-04-06 00:15:03,420: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:15:03.495316460Z [2024-04-06 00:15:03,494: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:15:03.825791455Z [2024-04-06 00:15:03,825: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T00:15:03.831499927Z [2024-04-06 00:15:03,831: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:15:03.856878833Z [2024-04-06 00:15:03,856: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T00:15:03.858151153Z [2024-04-06 00:15:03,857: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:15:03.858357298Z [2024-04-06 00:15:03,858: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:15:03.858557803Z [2024-04-06 00:15:03,858: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:15:03.858694886Z [2024-04-06 00:15:03,858: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T00:15:03.859012035Z [2024-04-06 00:15:03,858: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T00:15:03.859310914Z [2024-04-06 00:15:03,859: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:15:03.959675485Z [2024-04-06 00:15:03,959: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:15:04.403333163Z [2024-04-06 00:15:04,402: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ad4e4366-e2e9-48d4-8b8c-7c3e70401378] succeeded in 3.365985587999603s: None 2024-04-06T00:15:04.499377222Z [2024-04-06 00:15:04,499: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9d568224-96ff-4b35-90c0-9b12218ecdd7] received 2024-04-06T00:15:04.536886198Z [2024-04-06 00:15:04,528: INFO/ForkPoolWorker-16] [9d568224-96ff-4b35-90c0-9b12218ecdd7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'split_metrics', 'scheduled__2024-04-06T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T00:15:04.967128024Z [2024-04-06 00:15:04,963: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T00:15:05.313935190Z [2024-04-06 00:15:05,313: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[959ad5de-eef6-43e0-8ee3-07c8f703b516] succeeded in 4.266218652999669s: None 2024-04-06T00:15:06.350411771Z [2024-04-06 00:15:06,349: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T00:15:06.353930241Z [2024-04-06 00:15:06,353: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:15:06.376423174Z [2024-04-06 00:15:06,376: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T00:15:06.378000817Z [2024-04-06 00:15:06,377: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:15:06.378317114Z [2024-04-06 00:15:06,378: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:15:06.378493238Z [2024-04-06 00:15:06,378: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:15:06.378564836Z [2024-04-06 00:15:06,378: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T00:15:06.378868204Z [2024-04-06 00:15:06,378: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T00:15:06.379041984Z [2024-04-06 00:15:06,378: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:15:06.436523711Z [2024-04-06 00:15:06,435: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[700177ab-9b4c-4217-b45e-242a971d4c72] succeeded in 5.406188957000268s: None 2024-04-06T00:15:06.468406089Z [2024-04-06 00:15:06,468: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:15:07.000129054Z [2024-04-06 00:15:06,999: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7e52c119-adcf-46cf-ab0e-6e2904ec68d9] received 2024-04-06T00:15:07.020188026Z [2024-04-06 00:15:07,019: INFO/ForkPoolWorker-15] [7e52c119-adcf-46cf-ab0e-6e2904ec68d9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'collect_metrics', 'scheduled__2024-04-06T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T00:15:07.114978703Z [2024-04-06 00:15:07,113: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9d568224-96ff-4b35-90c0-9b12218ecdd7] succeeded in 2.61198060300012s: None 2024-04-06T00:15:07.304999701Z [2024-04-06 00:15:07,301: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T00:15:08.605491154Z [2024-04-06 00:15:08,605: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T00:15:08.609669525Z [2024-04-06 00:15:08,609: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:15:08.640566609Z [2024-04-06 00:15:08,640: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T00:15:08.643804344Z [2024-04-06 00:15:08,643: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:15:08.643931501Z [2024-04-06 00:15:08,643: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:15:08.644201601Z [2024-04-06 00:15:08,643: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:15:08.644326968Z [2024-04-06 00:15:08,644: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T00:15:08.644800995Z [2024-04-06 00:15:08,644: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T00:15:08.644925722Z [2024-04-06 00:15:08,644: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:15:08.761557484Z [2024-04-06 00:15:08,761: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:15:09.293956624Z [2024-04-06 00:15:09,293: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7e52c119-adcf-46cf-ab0e-6e2904ec68d9] succeeded in 2.291007611999703s: None 2024-04-06T00:15:09.372114302Z [2024-04-06 00:15:09,371: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[18f39425-6301-41a4-8efe-6b4fb0d41753] received 2024-04-06T00:15:09.380674518Z [2024-04-06 00:15:09,380: INFO/ForkPoolWorker-15] [18f39425-6301-41a4-8efe-6b4fb0d41753] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'send_prometheus', 'scheduled__2024-04-06T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T00:15:09.664484400Z [2024-04-06 00:15:09,661: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T00:15:10.861396433Z [2024-04-06 00:15:10,861: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T00:15:10.864450435Z [2024-04-06 00:15:10,864: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:15:10.885137836Z [2024-04-06 00:15:10,884: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T00:15:10.886386211Z [2024-04-06 00:15:10,886: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:15:10.886400857Z [2024-04-06 00:15:10,886: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:15:10.886484873Z [2024-04-06 00:15:10,886: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:15:10.886541004Z [2024-04-06 00:15:10,886: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T00:15:10.886972589Z [2024-04-06 00:15:10,886: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T00:15:10.886988359Z [2024-04-06 00:15:10,886: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:15:10.974212083Z [2024-04-06 00:15:10,973: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:15:11.676423644Z [2024-04-06 00:15:11,675: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[18f39425-6301-41a4-8efe-6b4fb0d41753] succeeded in 2.3012470539997594s: None 2024-04-06T00:16:00.392966204Z [2024-04-06 00:16:00,392: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7c45ab23-0aee-4b2c-87b6-de7962a47a6f] received 2024-04-06T00:16:00.397464992Z [2024-04-06 00:16:00,397: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f50d3f50-ee6d-4cfc-b75a-cf74a99aaddf] received 2024-04-06T00:16:00.404646567Z [2024-04-06 00:16:00,403: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f9472d95-5187-416f-9b60-10024ee9e362] received 2024-04-06T00:16:00.412325170Z [2024-04-06 00:16:00,411: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c356f955-cf33-441f-88d3-8d4a58cfa126] received 2024-04-06T00:16:00.413102306Z [2024-04-06 00:16:00,412: INFO/ForkPoolWorker-15] [7c45ab23-0aee-4b2c-87b6-de7962a47a6f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T00:16:00.418284625Z [2024-04-06 00:16:00,417: INFO/ForkPoolWorker-16] [f50d3f50-ee6d-4cfc-b75a-cf74a99aaddf] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T00:16:00.422824228Z [2024-04-06 00:16:00,422: INFO/ForkPoolWorker-1] [f9472d95-5187-416f-9b60-10024ee9e362] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T00:16:00.427579850Z [2024-04-06 00:16:00,424: INFO/ForkPoolWorker-2] [c356f955-cf33-441f-88d3-8d4a58cfa126] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T00:16:00.706120961Z [2024-04-06 00:16:00,701: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T00:16:00.805934978Z [2024-04-06 00:16:00,802: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T00:16:00.880575286Z [2024-04-06 00:16:00,880: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-06T00:16:00.884713776Z [2024-04-06 00:16:00,884: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:16:00.949116965Z [2024-04-06 00:16:00,948: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T00:16:00.950651477Z [2024-04-06 00:16:00,950: INFO/ForkPoolWorker-15] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T00:16:00.950711755Z [2024-04-06 00:16:00,950: INFO/ForkPoolWorker-15] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T00:16:00.950773276Z [2024-04-06 00:16:00,950: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-06T00:16:00.950928908Z [2024-04-06 00:16:00,950: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T00:16:00.954388631Z [2024-04-06 00:16:00,950: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T00:16:01.063390750Z [2024-04-06 00:16:01,063: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:16:01.281890220Z [2024-04-06 00:16:01,277: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T00:16:01.601603462Z [2024-04-06 00:16:01,601: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:16:01.675181241Z [2024-04-06 00:16:01,674: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7c45ab23-0aee-4b2c-87b6-de7962a47a6f] succeeded in 1.2787790560005305s: None 2024-04-06T00:16:02.135725224Z [2024-04-06 00:16:02,135: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-06T00:16:02.137507503Z [2024-04-06 00:16:02,137: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f50d3f50-ee6d-4cfc-b75a-cf74a99aaddf] succeeded in 1.7371346800000538s: None 2024-04-06T00:16:02.138754078Z [2024-04-06 00:16:02,138: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:16:02.156206970Z [2024-04-06 00:16:02,155: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T00:16:02.157319483Z [2024-04-06 00:16:02,157: INFO/ForkPoolWorker-2] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:16:02.157330760Z [2024-04-06 00:16:02,157: INFO/ForkPoolWorker-2] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:16:02.157454475Z [2024-04-06 00:16:02,157: INFO/ForkPoolWorker-2] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:16:02.157464030Z [2024-04-06 00:16:02,157: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-06T00:16:02.157708588Z [2024-04-06 00:16:02,157: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T00:16:02.157712013Z [2024-04-06 00:16:02,157: INFO/ForkPoolWorker-2] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:16:02.233437308Z [2024-04-06 00:16:02,233: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:16:02.301353189Z [2024-04-06 00:16:02,300: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T00:16:02.304354124Z [2024-04-06 00:16:02,303: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:16:02.327428070Z [2024-04-06 00:16:02,326: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T00:16:02.329274135Z [2024-04-06 00:16:02,329: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:16:02.329341499Z [2024-04-06 00:16:02,329: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:16:02.329473579Z [2024-04-06 00:16:02,329: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:16:02.329545824Z [2024-04-06 00:16:02,329: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T00:16:02.329885125Z [2024-04-06 00:16:02,329: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-06T00:16:02.329960672Z [2024-04-06 00:16:02,329: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:16:02.410724690Z [2024-04-06 00:16:02,410: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:16:03.641619199Z [2024-04-06 00:16:03,641: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[c356f955-cf33-441f-88d3-8d4a58cfa126] succeeded in 3.226869111000269s: None 2024-04-06T00:16:04.314432557Z [2024-04-06 00:16:04,314: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f9472d95-5187-416f-9b60-10024ee9e362] succeeded in 3.905637396000202s: None 2024-04-06T00:17:01.162287659Z [2024-04-06 00:17:01,161: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[302ad69a-9925-40eb-b0d5-40fc31266efa] received 2024-04-06T00:17:01.169069492Z [2024-04-06 00:17:01,168: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c8d9d28a-9791-49ff-8660-8c22fb750aba] received 2024-04-06T00:17:01.173580089Z [2024-04-06 00:17:01,173: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b90fb888-7fb2-4fd6-98d7-846db376159c] received 2024-04-06T00:17:01.177129873Z [2024-04-06 00:17:01,176: INFO/ForkPoolWorker-15] [302ad69a-9925-40eb-b0d5-40fc31266efa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T00:17:01.184203626Z [2024-04-06 00:17:01,183: INFO/ForkPoolWorker-16] [c8d9d28a-9791-49ff-8660-8c22fb750aba] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T00:17:01.194484109Z [2024-04-06 00:17:01,194: INFO/ForkPoolWorker-1] [b90fb888-7fb2-4fd6-98d7-846db376159c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T00:17:01.461736482Z [2024-04-06 00:17:01,458: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T00:17:01.475757856Z [2024-04-06 00:17:01,470: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T00:17:01.575990360Z [2024-04-06 00:17:01,572: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T00:17:01.734142236Z [2024-04-06 00:17:01,733: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-06T00:17:01.738173439Z [2024-04-06 00:17:01,737: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:17:01.764242796Z [2024-04-06 00:17:01,764: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T00:17:01.765684863Z [2024-04-06 00:17:01,765: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T00:17:01.765819593Z [2024-04-06 00:17:01,765: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T00:17:01.765877204Z [2024-04-06 00:17:01,765: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-06T00:17:01.766320861Z [2024-04-06 00:17:01,766: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T00:17:01.882919537Z [2024-04-06 00:17:01,882: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:17:02.480443314Z [2024-04-06 00:17:02,479: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b90fb888-7fb2-4fd6-98d7-846db376159c] succeeded in 1.3001031290004903s: None 2024-04-06T00:17:02.700974385Z [2024-04-06 00:17:02,700: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T00:17:02.701012116Z [2024-04-06 00:17:02,700: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T00:17:02.704486876Z [2024-04-06 00:17:02,704: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:17:02.704553422Z [2024-04-06 00:17:02,704: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:17:02.729039301Z [2024-04-06 00:17:02,728: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T00:17:02.730929028Z [2024-04-06 00:17:02,730: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:17:02.730998258Z [2024-04-06 00:17:02,730: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:17:02.731185826Z [2024-04-06 00:17:02,730: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:17:02.731291360Z [2024-04-06 00:17:02,731: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T00:17:02.731646973Z [2024-04-06 00:17:02,731: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T00:17:02.732084676Z [2024-04-06 00:17:02,731: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:17:02.736167479Z [2024-04-06 00:17:02,735: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T00:17:02.737612803Z [2024-04-06 00:17:02,737: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:17:02.737782813Z [2024-04-06 00:17:02,737: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:17:02.738006058Z [2024-04-06 00:17:02,737: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:17:02.738150508Z [2024-04-06 00:17:02,737: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T00:17:02.738578102Z [2024-04-06 00:17:02,738: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T00:17:02.738720455Z [2024-04-06 00:17:02,738: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:17:02.822073077Z [2024-04-06 00:17:02,821: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:17:02.831719672Z [2024-04-06 00:17:02,831: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:17:04.433890411Z [2024-04-06 00:17:04,433: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c8d9d28a-9791-49ff-8660-8c22fb750aba] succeeded in 3.261345609000273s: None 2024-04-06T00:17:04.629662526Z [2024-04-06 00:17:04,629: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[302ad69a-9925-40eb-b0d5-40fc31266efa] succeeded in 3.462710251000317s: None 2024-04-06T00:18:01.116161467Z [2024-04-06 00:18:01,115: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ae15d627-bfdf-4378-9c97-f8c23f05d346] received 2024-04-06T00:18:01.117541076Z [2024-04-06 00:18:01,117: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[458aeabe-c53d-43be-9dc7-222ec4c01565] received 2024-04-06T00:18:01.129876626Z [2024-04-06 00:18:01,129: INFO/ForkPoolWorker-16] [458aeabe-c53d-43be-9dc7-222ec4c01565] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T00:18:01.130538091Z [2024-04-06 00:18:01,130: INFO/ForkPoolWorker-15] [ae15d627-bfdf-4378-9c97-f8c23f05d346] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T00:18:01.134342799Z [2024-04-06 00:18:01,134: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3fbdefa2-121a-4c0e-84a1-28cd071e0b16] received 2024-04-06T00:18:01.140824278Z [2024-04-06 00:18:01,140: INFO/ForkPoolWorker-1] [3fbdefa2-121a-4c0e-84a1-28cd071e0b16] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T00:18:01.141781594Z [2024-04-06 00:18:01,141: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2a464e4f-69c8-4b9f-b218-36fd216817e2] received 2024-04-06T00:18:01.159736245Z [2024-04-06 00:18:01,159: INFO/ForkPoolWorker-2] [2a464e4f-69c8-4b9f-b218-36fd216817e2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T00:18:01.495474999Z [2024-04-06 00:18:01,492: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T00:18:01.518498415Z [2024-04-06 00:18:01,514: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T00:18:01.520476582Z [2024-04-06 00:18:01,516: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T00:18:01.576993751Z [2024-04-06 00:18:01,573: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T00:18:01.818444628Z [2024-04-06 00:18:01,818: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:18:01.868011150Z [2024-04-06 00:18:01,867: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-06T00:18:01.883476075Z [2024-04-06 00:18:01,882: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:18:01.919787739Z [2024-04-06 00:18:01,919: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T00:18:01.934505221Z [2024-04-06 00:18:01,934: INFO/ForkPoolWorker-2] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T00:18:01.935082396Z [2024-04-06 00:18:01,934: INFO/ForkPoolWorker-2] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T00:18:01.935168602Z [2024-04-06 00:18:01,935: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-06T00:18:01.936352900Z [2024-04-06 00:18:01,936: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T00:18:02.026592717Z [2024-04-06 00:18:02,026: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:18:02.426832784Z [2024-04-06 00:18:02,426: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ae15d627-bfdf-4378-9c97-f8c23f05d346] succeeded in 1.3061274140000023s: None 2024-04-06T00:18:02.605669018Z [2024-04-06 00:18:02,605: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[2a464e4f-69c8-4b9f-b218-36fd216817e2] succeeded in 1.4615927099994224s: None 2024-04-06T00:18:02.798347177Z [2024-04-06 00:18:02,797: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T00:18:02.801935295Z [2024-04-06 00:18:02,801: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:18:02.820223286Z [2024-04-06 00:18:02,819: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T00:18:02.821561768Z [2024-04-06 00:18:02,821: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:18:02.821575482Z [2024-04-06 00:18:02,821: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:18:02.821699233Z [2024-04-06 00:18:02,821: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:18:02.821704940Z [2024-04-06 00:18:02,821: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T00:18:02.821973785Z [2024-04-06 00:18:02,821: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T00:18:02.821981568Z [2024-04-06 00:18:02,821: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:18:02.912120141Z [2024-04-06 00:18:02,911: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:18:02.976284348Z [2024-04-06 00:18:02,975: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T00:18:02.980040063Z [2024-04-06 00:18:02,979: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:18:03.001066528Z [2024-04-06 00:18:03,000: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T00:18:03.006322935Z [2024-04-06 00:18:03,006: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:18:03.006668676Z [2024-04-06 00:18:03,006: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:18:03.006924858Z [2024-04-06 00:18:03,006: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:18:03.007103797Z [2024-04-06 00:18:03,006: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T00:18:03.007586067Z [2024-04-06 00:18:03,007: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T00:18:03.007889611Z [2024-04-06 00:18:03,007: INFO/ForkPoolWorker-1] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:18:03.104119261Z [2024-04-06 00:18:03,103: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:18:05.092991481Z [2024-04-06 00:18:05,092: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[458aeabe-c53d-43be-9dc7-222ec4c01565] succeeded in 3.971659510999416s: None 2024-04-06T00:18:05.298218184Z [2024-04-06 00:18:05,297: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3fbdefa2-121a-4c0e-84a1-28cd071e0b16] succeeded in 4.162212488000478s: None 2024-04-06T00:18:28.932071142Z [2024-04-06 00:18:28,931: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6a5adbd7-b509-4bff-ba50-1c615b7eeb45] received 2024-04-06T00:18:28.940613457Z [2024-04-06 00:18:28,940: INFO/ForkPoolWorker-15] [6a5adbd7-b509-4bff-ba50-1c615b7eeb45] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1203a42b-a223-457f-91c6-a1e2c3fbd36d', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T00:18:29.233838825Z [2024-04-06 00:18:29,230: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T00:18:29.379522353Z [2024-04-06 00:18:29,378: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-06T00:18:29.383117440Z [2024-04-06 00:18:29,382: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:18:29.405590085Z [2024-04-06 00:18:29,405: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T00:18:29.407051443Z [2024-04-06 00:18:29,406: INFO/ForkPoolWorker-15] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T00:18:29.407077952Z [2024-04-06 00:18:29,406: INFO/ForkPoolWorker-15] Read SDNC 1203a42b-a223-457f-91c6-a1e2c3fbd36d (epa_03) 2024-04-06T00:18:29.407327173Z [2024-04-06 00:18:29,406: INFO/ForkPoolWorker-15] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}, {'_id': '1203a42b-a223-457f-91c6-a1e2c3fbd36d', 'name': 'epa_03', 'type': 'onos_vpls'}] 2024-04-06T00:18:29.407411367Z [2024-04-06 00:18:29,407: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-06T00:18:29.407720159Z [2024-04-06 00:18:29,407: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T00:18:29.414768742Z [2024-04-06 00:18:29,414: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_1203a42b-a223-457f-91c6-a1e2c3fbd36d 2024-04-06T00:18:29.533477860Z [2024-04-06 00:18:29,532: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:18:30.280312039Z [2024-04-06 00:18:30,279: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6a5adbd7-b509-4bff-ba50-1c615b7eeb45] succeeded in 1.3463475919998018s: None 2024-04-06T00:19:00.420592636Z [2024-04-06 00:19:00,420: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[edc0417d-4aad-4ef2-aedf-8d4be67641e7] received 2024-04-06T00:19:00.425419731Z [2024-04-06 00:19:00,424: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c3985aa7-b2b5-449b-9b9f-c6312140b65f] received 2024-04-06T00:19:00.428849983Z [2024-04-06 00:19:00,428: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[31ee5a49-d160-45e1-9622-6742d1be93ab] received 2024-04-06T00:19:00.433881420Z [2024-04-06 00:19:00,433: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7cdc66ee-9cb8-400a-b2f1-f7f3aa228d77] received 2024-04-06T00:19:00.437393697Z [2024-04-06 00:19:00,437: INFO/ForkPoolWorker-15] [edc0417d-4aad-4ef2-aedf-8d4be67641e7] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1203a42b-a223-457f-91c6-a1e2c3fbd36d', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T00:19:00.437682654Z [2024-04-06 00:19:00,437: INFO/ForkPoolWorker-1] [31ee5a49-d160-45e1-9622-6742d1be93ab] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T00:19:00.439782212Z [2024-04-06 00:19:00,439: INFO/ForkPoolWorker-16] [c3985aa7-b2b5-449b-9b9f-c6312140b65f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T00:19:00.446107268Z [2024-04-06 00:19:00,445: INFO/ForkPoolWorker-2] [7cdc66ee-9cb8-400a-b2f1-f7f3aa228d77] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T00:19:00.729423524Z [2024-04-06 00:19:00,726: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T00:19:00.756979681Z [2024-04-06 00:19:00,753: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T00:19:00.759152548Z [2024-04-06 00:19:00,756: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T00:19:00.824113635Z [2024-04-06 00:19:00,820: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T00:19:00.920251536Z [2024-04-06 00:19:00,919: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-06T00:19:00.928770326Z [2024-04-06 00:19:00,928: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:19:00.964318897Z [2024-04-06 00:19:00,964: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T00:19:00.968186390Z [2024-04-06 00:19:00,967: INFO/ForkPoolWorker-2] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T00:19:00.968309619Z [2024-04-06 00:19:00,968: INFO/ForkPoolWorker-2] Read SDNC 1203a42b-a223-457f-91c6-a1e2c3fbd36d (epa_03) 2024-04-06T00:19:00.968332904Z [2024-04-06 00:19:00,968: INFO/ForkPoolWorker-2] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}, {'_id': '1203a42b-a223-457f-91c6-a1e2c3fbd36d', 'name': 'epa_03', 'type': 'onos_vpls'}] 2024-04-06T00:19:00.968459937Z [2024-04-06 00:19:00,968: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-06T00:19:00.968633124Z [2024-04-06 00:19:00,968: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T00:19:00.975072415Z [2024-04-06 00:19:00,974: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_1203a42b-a223-457f-91c6-a1e2c3fbd36d 2024-04-06T00:19:01.014891949Z [2024-04-06 00:19:01,014: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-06T00:19:01.018807604Z [2024-04-06 00:19:01,018: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:19:01.050323415Z [2024-04-06 00:19:01,050: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T00:19:01.051909992Z [2024-04-06 00:19:01,051: INFO/ForkPoolWorker-15] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T00:19:01.052026354Z [2024-04-06 00:19:01,051: INFO/ForkPoolWorker-15] Read SDNC 1203a42b-a223-457f-91c6-a1e2c3fbd36d (epa_03) 2024-04-06T00:19:01.052205706Z [2024-04-06 00:19:01,052: INFO/ForkPoolWorker-15] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}, {'_id': '1203a42b-a223-457f-91c6-a1e2c3fbd36d', 'name': 'epa_03', 'type': 'onos_vpls'}] 2024-04-06T00:19:01.052303902Z [2024-04-06 00:19:01,052: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-06T00:19:01.052819148Z [2024-04-06 00:19:01,052: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T00:19:01.059031142Z [2024-04-06 00:19:01,058: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_1203a42b-a223-457f-91c6-a1e2c3fbd36d 2024-04-06T00:19:01.072181171Z [2024-04-06 00:19:01,071: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:19:01.136934377Z [2024-04-06 00:19:01,136: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:19:01.658367468Z [2024-04-06 00:19:01,657: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[7cdc66ee-9cb8-400a-b2f1-f7f3aa228d77] succeeded in 1.2223423019995607s: None 2024-04-06T00:19:01.802905649Z [2024-04-06 00:19:01,802: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[edc0417d-4aad-4ef2-aedf-8d4be67641e7] succeeded in 1.3791157039995596s: None 2024-04-06T00:19:02.167711435Z [2024-04-06 00:19:02,167: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T00:19:02.170959432Z [2024-04-06 00:19:02,170: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:19:02.195977488Z [2024-04-06 00:19:02,195: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T00:19:02.197982652Z [2024-04-06 00:19:02,197: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:19:02.198092015Z [2024-04-06 00:19:02,197: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:19:02.198277909Z [2024-04-06 00:19:02,198: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:19:02.198373287Z [2024-04-06 00:19:02,198: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T00:19:02.198665410Z [2024-04-06 00:19:02,198: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-06T00:19:02.199085487Z [2024-04-06 00:19:02,198: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:19:02.230925111Z [2024-04-06 00:19:02,230: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T00:19:02.234390448Z [2024-04-06 00:19:02,233: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:19:02.264891939Z [2024-04-06 00:19:02,264: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T00:19:02.266223141Z [2024-04-06 00:19:02,265: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:19:02.266245021Z [2024-04-06 00:19:02,266: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:19:02.266394125Z [2024-04-06 00:19:02,266: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:19:02.266437186Z [2024-04-06 00:19:02,266: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T00:19:02.266674825Z [2024-04-06 00:19:02,266: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T00:19:02.269651089Z [2024-04-06 00:19:02,266: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:19:02.299393830Z [2024-04-06 00:19:02,297: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:19:02.439288897Z [2024-04-06 00:19:02,438: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:19:03.901454082Z [2024-04-06 00:19:03,900: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c3985aa7-b2b5-449b-9b9f-c6312140b65f] succeeded in 3.4700154649999604s: None 2024-04-06T00:19:05.201654571Z [2024-04-06 00:19:05,200: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[31ee5a49-d160-45e1-9622-6742d1be93ab] succeeded in 4.771036181000454s: None 2024-04-06T00:20:00.737340450Z [2024-04-06 00:20:00,736: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e7d9e001-34de-45dc-b140-4ff30db34a48] received 2024-04-06T00:20:00.743847063Z [2024-04-06 00:20:00,743: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0ecfa8de-4866-4c50-936d-c8a90b12dc4e] received 2024-04-06T00:20:00.745873856Z [2024-04-06 00:20:00,745: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8c123d42-d7be-482a-8074-561fc32f4c6b] received 2024-04-06T00:20:00.746207377Z [2024-04-06 00:20:00,745: INFO/ForkPoolWorker-15] [e7d9e001-34de-45dc-b140-4ff30db34a48] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1203a42b-a223-457f-91c6-a1e2c3fbd36d', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T00:20:00.748110497Z [2024-04-06 00:20:00,747: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c0ad66d3-05d1-42ea-8ea6-41cfece54cdf] received 2024-04-06T00:20:00.749486988Z [2024-04-06 00:20:00,749: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cab25a1c-6767-496b-b8a8-b3c7938d11f8] received 2024-04-06T00:20:00.757467960Z [2024-04-06 00:20:00,757: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f6e8cd86-bb32-4274-a9d0-b7cd65c61231] received 2024-04-06T00:20:00.758266591Z [2024-04-06 00:20:00,757: INFO/ForkPoolWorker-1] [8c123d42-d7be-482a-8074-561fc32f4c6b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T00:20:00.768759273Z [2024-04-06 00:20:00,768: INFO/ForkPoolWorker-2] [c0ad66d3-05d1-42ea-8ea6-41cfece54cdf] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T00:20:00.771857323Z [2024-04-06 00:20:00,771: INFO/ForkPoolWorker-16] [0ecfa8de-4866-4c50-936d-c8a90b12dc4e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T00:20:00.777851721Z [2024-04-06 00:20:00,777: INFO/ForkPoolWorker-3] [cab25a1c-6767-496b-b8a8-b3c7938d11f8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T00:20:00.782495664Z [2024-04-06 00:20:00,782: INFO/ForkPoolWorker-4] [f6e8cd86-bb32-4274-a9d0-b7cd65c61231] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T00:20:01.175335154Z [2024-04-06 00:20:01,172: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T00:20:01.282518668Z [2024-04-06 00:20:01,278: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T00:20:01.293858594Z [2024-04-06 00:20:01,280: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T00:20:01.369811157Z [2024-04-06 00:20:01,360: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T00:20:01.375032584Z [2024-04-06 00:20:01,374: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-06T00:20:01.378971058Z [2024-04-06 00:20:01,378: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:20:01.437112924Z [2024-04-06 00:20:01,436: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T00:20:01.438493293Z [2024-04-06 00:20:01,433: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T00:20:01.443995074Z [2024-04-06 00:20:01,443: INFO/ForkPoolWorker-15] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T00:20:01.444219613Z [2024-04-06 00:20:01,443: INFO/ForkPoolWorker-15] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T00:20:01.444362129Z [2024-04-06 00:20:01,444: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-06T00:20:01.444729760Z [2024-04-06 00:20:01,444: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T00:20:01.454066829Z [2024-04-06 00:20:01,453: WARNING/ForkPoolWorker-15] Dag 'sdnc_status_1203a42b-a223-457f-91c6-a1e2c3fbd36d' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T00:20:01.459869892Z [2024-04-06 00:20:01,459: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T00:20:01.460883152Z [2024-04-06 00:20:01,460: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-06T00:20:01.463905553Z [2024-04-06 00:20:01,463: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:20:01.503050857Z [2024-04-06 00:20:01,502: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T00:20:01.508331191Z [2024-04-06 00:20:01,508: INFO/ForkPoolWorker-15] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T00:20:01.508506589Z [2024-04-06 00:20:01,508: INFO/ForkPoolWorker-15] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T00:20:01.508620797Z [2024-04-06 00:20:01,508: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-06T00:20:01.508895456Z [2024-04-06 00:20:01,508: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T00:20:01.512760698Z [2024-04-06 00:20:01,512: ERROR/ForkPoolWorker-15] [e7d9e001-34de-45dc-b140-4ff30db34a48] Failed to execute task Dag 'sdnc_status_1203a42b-a223-457f-91c6-a1e2c3fbd36d' could not be found; either it does not exist or it failed to parse.. 2024-04-06T00:20:01.512777411Z Traceback (most recent call last): 2024-04-06T00:20:01.512781749Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-06T00:20:01.512786303Z args.func(args) 2024-04-06T00:20:01.512790483Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-06T00:20:01.512794401Z return func(*args, **kwargs) 2024-04-06T00:20:01.512797866Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-06T00:20:01.512801270Z return f(*args, **kwargs) 2024-04-06T00:20:01.512804373Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-06T00:20:01.512819597Z dag = get_dag(args.subdir, args.dag_id) 2024-04-06T00:20:01.512822956Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-06T00:20:01.512825998Z raise AirflowException( 2024-04-06T00:20:01.512829456Z airflow.exceptions.AirflowException: Dag 'sdnc_status_1203a42b-a223-457f-91c6-a1e2c3fbd36d' could not be found; either it does not exist or it failed to parse. 2024-04-06T00:20:01.517084445Z [2024-04-06 00:20:01,513: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T00:20:01.538105723Z [2024-04-06 00:20:01,537: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e7d9e001-34de-45dc-b140-4ff30db34a48] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id e7d9e001-34de-45dc-b140-4ff30db34a48') 2024-04-06T00:20:01.538140626Z Traceback (most recent call last): 2024-04-06T00:20:01.538145054Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-06T00:20:01.538148244Z R = retval = fun(*args, **kwargs) 2024-04-06T00:20:01.538151339Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-06T00:20:01.538154340Z return self.run(*args, **kwargs) 2024-04-06T00:20:01.538158150Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-06T00:20:01.538162287Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-06T00:20:01.538165448Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-06T00:20:01.538169391Z raise AirflowException(msg) 2024-04-06T00:20:01.538173328Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id e7d9e001-34de-45dc-b140-4ff30db34a48 2024-04-06T00:20:01.702815508Z [2024-04-06 00:20:01,702: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:20:01.826189160Z [2024-04-06 00:20:01,825: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-06T00:20:01.837200991Z [2024-04-06 00:20:01,836: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:20:01.910588235Z [2024-04-06 00:20:01,910: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T00:20:01.912088589Z [2024-04-06 00:20:01,911: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T00:20:01.912374425Z [2024-04-06 00:20:01,912: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T00:20:01.912491501Z [2024-04-06 00:20:01,912: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-06T00:20:01.912772645Z [2024-04-06 00:20:01,912: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T00:20:02.009205536Z [2024-04-06 00:20:02,008: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:20:02.353100054Z [2024-04-06 00:20:02,352: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[c0ad66d3-05d1-42ea-8ea6-41cfece54cdf] succeeded in 1.6020432369996342s: None 2024-04-06T00:20:02.655310709Z [2024-04-06 00:20:02,654: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8c123d42-d7be-482a-8074-561fc32f4c6b] succeeded in 1.9075460880003448s: None 2024-04-06T00:20:02.792429876Z [2024-04-06 00:20:02,792: INFO/ForkPoolWorker-3] Getting VIM list 2024-04-06T00:20:02.796021525Z [2024-04-06 00:20:02,795: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:20:02.819597757Z [2024-04-06 00:20:02,819: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-06T00:20:02.821109222Z [2024-04-06 00:20:02,820: INFO/ForkPoolWorker-3] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:20:02.821356450Z [2024-04-06 00:20:02,821: INFO/ForkPoolWorker-3] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:20:02.821675146Z [2024-04-06 00:20:02,821: INFO/ForkPoolWorker-3] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:20:02.821845739Z [2024-04-06 00:20:02,821: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-04-06T00:20:02.822170095Z [2024-04-06 00:20:02,822: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-04-06T00:20:02.822338086Z [2024-04-06 00:20:02,822: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:20:02.936672222Z [2024-04-06 00:20:02,936: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:20:03.063389488Z [2024-04-06 00:20:03,062: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T00:20:03.066909206Z [2024-04-06 00:20:03,066: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:20:03.090597483Z [2024-04-06 00:20:03,090: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T00:20:03.091942703Z [2024-04-06 00:20:03,091: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:20:03.091964478Z [2024-04-06 00:20:03,091: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:20:03.092084193Z [2024-04-06 00:20:03,091: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:20:03.092130362Z [2024-04-06 00:20:03,092: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T00:20:03.092386915Z [2024-04-06 00:20:03,092: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T00:20:03.092391931Z [2024-04-06 00:20:03,092: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:20:03.177082498Z [2024-04-06 00:20:03,176: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:20:03.274706545Z [2024-04-06 00:20:03,274: INFO/ForkPoolWorker-4] Getting VIM list 2024-04-06T00:20:03.279379623Z [2024-04-06 00:20:03,278: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:20:03.298891212Z [2024-04-06 00:20:03,298: INFO/ForkPoolWorker-4] Connected to database osm version 1.2 2024-04-06T00:20:03.300541152Z [2024-04-06 00:20:03,300: INFO/ForkPoolWorker-4] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:20:03.300723621Z [2024-04-06 00:20:03,300: INFO/ForkPoolWorker-4] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:20:03.300938044Z [2024-04-06 00:20:03,300: INFO/ForkPoolWorker-4] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:20:03.301158480Z [2024-04-06 00:20:03,301: INFO/ForkPoolWorker-4] Getting VIM list OK 2024-04-06T00:20:03.303703218Z [2024-04-06 00:20:03,302: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T00:20:03.303847711Z [2024-04-06 00:20:03,303: INFO/ForkPoolWorker-4] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:20:03.429121279Z [2024-04-06 00:20:03,428: INFO/ForkPoolWorker-4] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:20:03.890351326Z [2024-04-06 00:20:03,889: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0ecfa8de-4866-4c50-936d-c8a90b12dc4e] succeeded in 3.1439855100006753s: None 2024-04-06T00:20:04.081941838Z [2024-04-06 00:20:04,081: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0761ce3e-0244-44d5-a12a-deda9350dc07] received 2024-04-06T00:20:04.088012789Z [2024-04-06 00:20:04,087: INFO/ForkPoolWorker-15] [0761ce3e-0244-44d5-a12a-deda9350dc07] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'split_metrics', 'scheduled__2024-04-06T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T00:20:04.407001089Z [2024-04-06 00:20:04,403: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T00:20:05.023166767Z [2024-04-06 00:20:05,022: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[cab25a1c-6767-496b-b8a8-b3c7938d11f8] succeeded in 4.269098431000202s: None 2024-04-06T00:20:05.072937555Z [2024-04-06 00:20:05,072: INFO/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[f6e8cd86-bb32-4274-a9d0-b7cd65c61231] succeeded in 4.311472676000449s: None 2024-04-06T00:20:05.637185244Z [2024-04-06 00:20:05,636: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T00:20:05.640494864Z [2024-04-06 00:20:05,640: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:20:05.665499085Z [2024-04-06 00:20:05,665: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T00:20:05.667597144Z [2024-04-06 00:20:05,667: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:20:05.667870081Z [2024-04-06 00:20:05,667: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:20:05.668199639Z [2024-04-06 00:20:05,667: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:20:05.668442092Z [2024-04-06 00:20:05,668: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T00:20:05.669012907Z [2024-04-06 00:20:05,668: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T00:20:05.669297413Z [2024-04-06 00:20:05,669: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:20:05.758464593Z [2024-04-06 00:20:05,758: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:20:06.469771985Z [2024-04-06 00:20:06,468: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0761ce3e-0244-44d5-a12a-deda9350dc07] succeeded in 2.38557599700016s: None 2024-04-06T00:20:06.601549993Z [2024-04-06 00:20:06,601: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a10e371d-6062-4bbb-a954-5e1a2abd064c] received 2024-04-06T00:20:06.608706328Z [2024-04-06 00:20:06,608: INFO/ForkPoolWorker-15] [a10e371d-6062-4bbb-a954-5e1a2abd064c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'collect_metrics', 'scheduled__2024-04-06T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T00:20:06.951115009Z [2024-04-06 00:20:06,947: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T00:20:08.074979078Z [2024-04-06 00:20:08,074: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T00:20:08.078461985Z [2024-04-06 00:20:08,077: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:20:08.108441347Z [2024-04-06 00:20:08,108: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T00:20:08.110127034Z [2024-04-06 00:20:08,109: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:20:08.110393616Z [2024-04-06 00:20:08,110: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:20:08.110683750Z [2024-04-06 00:20:08,110: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:20:08.110849460Z [2024-04-06 00:20:08,110: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T00:20:08.111214419Z [2024-04-06 00:20:08,111: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T00:20:08.111540914Z [2024-04-06 00:20:08,111: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:20:08.209628251Z [2024-04-06 00:20:08,209: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:20:08.871237013Z [2024-04-06 00:20:08,870: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a10e371d-6062-4bbb-a954-5e1a2abd064c] succeeded in 2.2679650330001095s: None 2024-04-06T00:20:09.070994145Z [2024-04-06 00:20:09,070: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[efbe8c2c-23ce-4cdf-b0b6-c10e37af444c] received 2024-04-06T00:20:09.078023704Z [2024-04-06 00:20:09,077: INFO/ForkPoolWorker-15] [efbe8c2c-23ce-4cdf-b0b6-c10e37af444c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'send_prometheus', 'scheduled__2024-04-06T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T00:20:09.382186890Z [2024-04-06 00:20:09,379: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T00:20:10.494202055Z [2024-04-06 00:20:10,493: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T00:20:10.497181281Z [2024-04-06 00:20:10,496: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:20:10.520713371Z [2024-04-06 00:20:10,520: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T00:20:10.522418231Z [2024-04-06 00:20:10,522: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:20:10.522686238Z [2024-04-06 00:20:10,522: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:20:10.522905717Z [2024-04-06 00:20:10,522: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:20:10.523088923Z [2024-04-06 00:20:10,522: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T00:20:10.523664490Z [2024-04-06 00:20:10,523: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T00:20:10.523901158Z [2024-04-06 00:20:10,523: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:20:10.632878011Z [2024-04-06 00:20:10,632: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:20:11.293089309Z [2024-04-06 00:20:11,292: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[efbe8c2c-23ce-4cdf-b0b6-c10e37af444c] succeeded in 2.21964629500053s: None 2024-04-06T00:20:11.915971165Z [2024-04-06 00:20:11,915: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c4c8664a-18b2-4c0e-9407-8a2d4c9d10d8] received 2024-04-06T00:20:11.933641099Z [2024-04-06 00:20:11,933: INFO/ForkPoolWorker-15] [c4c8664a-18b2-4c0e-9407-8a2d4c9d10d8] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1203a42b-a223-457f-91c6-a1e2c3fbd36d', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T00:20:12.211896621Z [2024-04-06 00:20:12,208: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T00:20:12.377768909Z [2024-04-06 00:20:12,377: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-06T00:20:12.381618541Z [2024-04-06 00:20:12,381: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:20:12.408856219Z [2024-04-06 00:20:12,408: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T00:20:12.410269238Z [2024-04-06 00:20:12,409: INFO/ForkPoolWorker-15] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T00:20:12.410571135Z [2024-04-06 00:20:12,410: INFO/ForkPoolWorker-15] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T00:20:12.410820535Z [2024-04-06 00:20:12,410: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-06T00:20:12.411688615Z [2024-04-06 00:20:12,411: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T00:20:12.421650091Z [2024-04-06 00:20:12,421: WARNING/ForkPoolWorker-15] Dag 'sdnc_status_1203a42b-a223-457f-91c6-a1e2c3fbd36d' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T00:20:12.422023430Z [2024-04-06 00:20:12,421: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T00:20:12.422968603Z [2024-04-06 00:20:12,422: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-06T00:20:12.425728915Z [2024-04-06 00:20:12,425: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:20:12.453967692Z [2024-04-06 00:20:12,453: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T00:20:12.456272689Z [2024-04-06 00:20:12,455: INFO/ForkPoolWorker-15] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T00:20:12.456897841Z [2024-04-06 00:20:12,456: INFO/ForkPoolWorker-15] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T00:20:12.457369781Z [2024-04-06 00:20:12,457: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-06T00:20:12.458106313Z [2024-04-06 00:20:12,457: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T00:20:12.464124201Z [2024-04-06 00:20:12,463: ERROR/ForkPoolWorker-15] [c4c8664a-18b2-4c0e-9407-8a2d4c9d10d8] Failed to execute task Dag 'sdnc_status_1203a42b-a223-457f-91c6-a1e2c3fbd36d' could not be found; either it does not exist or it failed to parse.. 2024-04-06T00:20:12.464144479Z Traceback (most recent call last): 2024-04-06T00:20:12.464149708Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-06T00:20:12.464154416Z args.func(args) 2024-04-06T00:20:12.464159271Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-06T00:20:12.464163938Z return func(*args, **kwargs) 2024-04-06T00:20:12.464167913Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-06T00:20:12.464171481Z return f(*args, **kwargs) 2024-04-06T00:20:12.464175186Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-06T00:20:12.464194694Z dag = get_dag(args.subdir, args.dag_id) 2024-04-06T00:20:12.464198453Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-06T00:20:12.464202060Z raise AirflowException( 2024-04-06T00:20:12.464206873Z airflow.exceptions.AirflowException: Dag 'sdnc_status_1203a42b-a223-457f-91c6-a1e2c3fbd36d' could not be found; either it does not exist or it failed to parse. 2024-04-06T00:20:12.500324474Z [2024-04-06 00:20:12,499: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c4c8664a-18b2-4c0e-9407-8a2d4c9d10d8] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id c4c8664a-18b2-4c0e-9407-8a2d4c9d10d8') 2024-04-06T00:20:12.500420119Z Traceback (most recent call last): 2024-04-06T00:20:12.500437286Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-06T00:20:12.500450116Z R = retval = fun(*args, **kwargs) 2024-04-06T00:20:12.500542032Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-06T00:20:12.500556060Z return self.run(*args, **kwargs) 2024-04-06T00:20:12.500610083Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-06T00:20:12.500626028Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-06T00:20:12.500638350Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-06T00:20:12.500652878Z raise AirflowException(msg) 2024-04-06T00:20:12.500705785Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id c4c8664a-18b2-4c0e-9407-8a2d4c9d10d8 2024-04-06T00:21:00.915939968Z [2024-04-06 00:21:00,915: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[85be48e3-9320-436a-8564-b8b50ba451f0] received 2024-04-06T00:21:00.918691816Z [2024-04-06 00:21:00,918: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[14bb98e6-e2e2-4833-ac7c-9a426215366a] received 2024-04-06T00:21:00.920503259Z [2024-04-06 00:21:00,920: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5a3bb533-0f64-4eac-a7c0-06a6fd3a25da] received 2024-04-06T00:21:00.927064910Z [2024-04-06 00:21:00,926: INFO/ForkPoolWorker-16] [14bb98e6-e2e2-4833-ac7c-9a426215366a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T00:21:00.934421307Z [2024-04-06 00:21:00,933: INFO/ForkPoolWorker-1] [5a3bb533-0f64-4eac-a7c0-06a6fd3a25da] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T00:21:00.934985208Z [2024-04-06 00:21:00,934: INFO/ForkPoolWorker-15] [85be48e3-9320-436a-8564-b8b50ba451f0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T00:21:01.251142094Z [2024-04-06 00:21:01,248: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T00:21:01.353494730Z [2024-04-06 00:21:01,350: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T00:21:01.357025391Z [2024-04-06 00:21:01,353: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T00:21:01.532057764Z [2024-04-06 00:21:01,531: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-06T00:21:01.537502577Z [2024-04-06 00:21:01,537: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:21:01.564751949Z [2024-04-06 00:21:01,564: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T00:21:01.566218019Z [2024-04-06 00:21:01,566: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T00:21:01.566421150Z [2024-04-06 00:21:01,566: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T00:21:01.566569371Z [2024-04-06 00:21:01,566: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-06T00:21:01.566855603Z [2024-04-06 00:21:01,566: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T00:21:01.649940495Z [2024-04-06 00:21:01,649: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:21:02.200970585Z [2024-04-06 00:21:02,200: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5a3bb533-0f64-4eac-a7c0-06a6fd3a25da] succeeded in 1.27270445799968s: None 2024-04-06T00:21:02.468915857Z [2024-04-06 00:21:02,468: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T00:21:02.471975174Z [2024-04-06 00:21:02,471: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:21:02.489793037Z [2024-04-06 00:21:02,489: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T00:21:02.491016061Z [2024-04-06 00:21:02,490: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:21:02.491102408Z [2024-04-06 00:21:02,491: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:21:02.491283100Z [2024-04-06 00:21:02,491: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:21:02.491399967Z [2024-04-06 00:21:02,491: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T00:21:02.491696226Z [2024-04-06 00:21:02,491: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T00:21:02.492084177Z [2024-04-06 00:21:02,491: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:21:02.570839497Z [2024-04-06 00:21:02,570: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:21:02.573998585Z [2024-04-06 00:21:02,573: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T00:21:02.577429762Z [2024-04-06 00:21:02,576: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:21:02.596963419Z [2024-04-06 00:21:02,596: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T00:21:02.598467168Z [2024-04-06 00:21:02,598: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:21:02.598498685Z [2024-04-06 00:21:02,598: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:21:02.598523227Z [2024-04-06 00:21:02,598: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:21:02.598532977Z [2024-04-06 00:21:02,598: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T00:21:02.598762918Z [2024-04-06 00:21:02,598: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T00:21:02.598809644Z [2024-04-06 00:21:02,598: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:21:02.683696770Z [2024-04-06 00:21:02,683: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:21:04.436703112Z [2024-04-06 00:21:04,433: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[85be48e3-9320-436a-8564-b8b50ba451f0] succeeded in 3.515180213000349s: None 2024-04-06T00:21:05.175932199Z [2024-04-06 00:21:05,175: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[14bb98e6-e2e2-4833-ac7c-9a426215366a] succeeded in 4.254488276999837s: None 2024-04-06T00:22:01.271482473Z [2024-04-06 00:22:01,270: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a22fb4cb-fa6d-46c8-9863-db2982be146c] received 2024-04-06T00:22:01.282366616Z [2024-04-06 00:22:01,281: INFO/ForkPoolWorker-15] [a22fb4cb-fa6d-46c8-9863-db2982be146c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T00:22:01.283344475Z [2024-04-06 00:22:01,283: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a60ee20e-4ef7-42b4-b731-d470f7422e74] received 2024-04-06T00:22:01.287050054Z [2024-04-06 00:22:01,286: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0b86039f-44a1-4045-81d9-1484bfb09aeb] received 2024-04-06T00:22:01.291946376Z [2024-04-06 00:22:01,291: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cfefbbc0-ad4e-430e-aba5-649b4e7933f1] received 2024-04-06T00:22:01.302800975Z [2024-04-06 00:22:01,302: INFO/ForkPoolWorker-16] [a60ee20e-4ef7-42b4-b731-d470f7422e74] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T00:22:01.307637614Z [2024-04-06 00:22:01,306: INFO/ForkPoolWorker-2] [cfefbbc0-ad4e-430e-aba5-649b4e7933f1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T00:22:01.308100123Z [2024-04-06 00:22:01,307: INFO/ForkPoolWorker-1] [0b86039f-44a1-4045-81d9-1484bfb09aeb] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T00:22:01.585095559Z [2024-04-06 00:22:01,581: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T00:22:01.680313786Z [2024-04-06 00:22:01,675: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T00:22:01.770302702Z [2024-04-06 00:22:01,767: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T00:22:01.786064497Z [2024-04-06 00:22:01,782: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T00:22:01.948372047Z [2024-04-06 00:22:01,947: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-06T00:22:01.953999630Z [2024-04-06 00:22:01,953: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:22:01.989681896Z [2024-04-06 00:22:01,989: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T00:22:01.993515546Z [2024-04-06 00:22:01,993: INFO/ForkPoolWorker-16] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T00:22:01.993648452Z [2024-04-06 00:22:01,993: INFO/ForkPoolWorker-16] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T00:22:01.993774335Z [2024-04-06 00:22:01,993: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-06T00:22:01.994137251Z [2024-04-06 00:22:01,993: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T00:22:02.000448047Z [2024-04-06 00:22:02,000: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:22:02.088302484Z [2024-04-06 00:22:02,088: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:22:02.736393497Z [2024-04-06 00:22:02,735: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0b86039f-44a1-4045-81d9-1484bfb09aeb] succeeded in 1.4462754309997763s: None 2024-04-06T00:22:02.786287468Z [2024-04-06 00:22:02,785: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a60ee20e-4ef7-42b4-b731-d470f7422e74] succeeded in 1.499836181000319s: None 2024-04-06T00:22:03.042639966Z [2024-04-06 00:22:03,042: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T00:22:03.046158395Z [2024-04-06 00:22:03,045: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:22:03.084087189Z [2024-04-06 00:22:03,083: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T00:22:03.086068935Z [2024-04-06 00:22:03,085: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:22:03.086180474Z [2024-04-06 00:22:03,086: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:22:03.086345509Z [2024-04-06 00:22:03,086: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:22:03.086375620Z [2024-04-06 00:22:03,086: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T00:22:03.086653125Z [2024-04-06 00:22:03,086: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T00:22:03.086743300Z [2024-04-06 00:22:03,086: INFO/ForkPoolWorker-15] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:22:03.189148759Z [2024-04-06 00:22:03,188: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:22:03.259222940Z [2024-04-06 00:22:03,258: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-06T00:22:03.263155763Z [2024-04-06 00:22:03,262: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:22:03.291274786Z [2024-04-06 00:22:03,291: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T00:22:03.292826943Z [2024-04-06 00:22:03,292: INFO/ForkPoolWorker-2] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:22:03.293027832Z [2024-04-06 00:22:03,292: INFO/ForkPoolWorker-2] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:22:03.293145522Z [2024-04-06 00:22:03,292: INFO/ForkPoolWorker-2] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:22:03.293295185Z [2024-04-06 00:22:03,293: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-06T00:22:03.293515526Z [2024-04-06 00:22:03,293: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-06T00:22:03.293533044Z [2024-04-06 00:22:03,293: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:22:03.381318439Z [2024-04-06 00:22:03,380: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:22:05.282918168Z [2024-04-06 00:22:05,281: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a22fb4cb-fa6d-46c8-9863-db2982be146c] succeeded in 4.007376391999969s: None 2024-04-06T00:22:06.802319664Z [2024-04-06 00:22:06,801: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[cfefbbc0-ad4e-430e-aba5-649b4e7933f1] succeeded in 5.503618819000621s: None 2024-04-06T00:23:00.353635381Z [2024-04-06 00:23:00,353: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4bec3749-fad3-46ab-8d07-692dd697dc64] received 2024-04-06T00:23:00.356526989Z [2024-04-06 00:23:00,356: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ceb49a68-1c47-4844-bb06-ac83b50fc1a2] received 2024-04-06T00:23:00.365916921Z [2024-04-06 00:23:00,365: INFO/ForkPoolWorker-15] [4bec3749-fad3-46ab-8d07-692dd697dc64] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T00:23:00.368921128Z [2024-04-06 00:23:00,368: INFO/ForkPoolWorker-16] [ceb49a68-1c47-4844-bb06-ac83b50fc1a2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T00:23:00.375345079Z [2024-04-06 00:23:00,375: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[15971f33-3ef7-424d-857e-3606b9350173] received 2024-04-06T00:23:00.389274976Z [2024-04-06 00:23:00,388: INFO/ForkPoolWorker-1] [15971f33-3ef7-424d-857e-3606b9350173] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T00:23:00.656191340Z [2024-04-06 00:23:00,652: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T00:23:00.699371579Z [2024-04-06 00:23:00,695: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T00:23:00.749783566Z [2024-04-06 00:23:00,746: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T00:23:00.887755746Z [2024-04-06 00:23:00,887: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-06T00:23:00.892253653Z [2024-04-06 00:23:00,891: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:23:00.928407450Z [2024-04-06 00:23:00,928: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T00:23:00.932177639Z [2024-04-06 00:23:00,931: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T00:23:00.932402967Z [2024-04-06 00:23:00,932: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T00:23:00.932561783Z [2024-04-06 00:23:00,932: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-06T00:23:00.932893646Z [2024-04-06 00:23:00,932: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T00:23:01.039632829Z [2024-04-06 00:23:01,039: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:23:01.632227381Z [2024-04-06 00:23:01,631: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[15971f33-3ef7-424d-857e-3606b9350173] succeeded in 1.2520070919999853s: None 2024-04-06T00:23:01.881675036Z [2024-04-06 00:23:01,880: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T00:23:01.885283999Z [2024-04-06 00:23:01,884: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:23:01.903020433Z [2024-04-06 00:23:01,902: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T00:23:01.904576103Z [2024-04-06 00:23:01,904: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:23:01.904653932Z [2024-04-06 00:23:01,904: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:23:01.904793800Z [2024-04-06 00:23:01,904: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:23:01.904879483Z [2024-04-06 00:23:01,904: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T00:23:01.905119955Z [2024-04-06 00:23:01,905: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T00:23:01.905213355Z [2024-04-06 00:23:01,905: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:23:01.928689412Z [2024-04-06 00:23:01,928: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T00:23:01.931946410Z [2024-04-06 00:23:01,931: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:23:01.955141092Z [2024-04-06 00:23:01,954: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T00:23:01.956618405Z [2024-04-06 00:23:01,956: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:23:01.956636721Z [2024-04-06 00:23:01,956: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:23:01.956758083Z [2024-04-06 00:23:01,956: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:23:01.956801898Z [2024-04-06 00:23:01,956: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T00:23:01.957052225Z [2024-04-06 00:23:01,956: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T00:23:01.957094548Z [2024-04-06 00:23:01,957: INFO/ForkPoolWorker-15] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:23:01.993158397Z [2024-04-06 00:23:01,992: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:23:02.049771026Z [2024-04-06 00:23:02,049: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:23:03.509860138Z [2024-04-06 00:23:03,509: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4bec3749-fad3-46ab-8d07-692dd697dc64] succeeded in 3.1533019389999026s: None 2024-04-06T00:23:03.943905420Z [2024-04-06 00:23:03,943: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ceb49a68-1c47-4844-bb06-ac83b50fc1a2] succeeded in 3.584581875999902s: None 2024-04-06T00:24:00.930780671Z [2024-04-06 00:24:00,930: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[11d37c25-25c7-43dc-9603-46e0a082a30c] received 2024-04-06T00:24:00.932955420Z [2024-04-06 00:24:00,932: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e0f5c27d-93a1-4c9a-b280-710a20efc2ad] received 2024-04-06T00:24:00.943716147Z [2024-04-06 00:24:00,941: INFO/ForkPoolWorker-15] [11d37c25-25c7-43dc-9603-46e0a082a30c] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T00:24:00.945795016Z [2024-04-06 00:24:00,945: INFO/ForkPoolWorker-16] [e0f5c27d-93a1-4c9a-b280-710a20efc2ad] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T00:24:00.960239327Z [2024-04-06 00:24:00,959: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d65c3226-a360-4828-902c-d905fc177337] received 2024-04-06T00:24:00.967156493Z [2024-04-06 00:24:00,965: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e181ac06-9c7f-41b2-9862-b1e2935598aa] received 2024-04-06T00:24:00.976802316Z [2024-04-06 00:24:00,976: INFO/ForkPoolWorker-1] [d65c3226-a360-4828-902c-d905fc177337] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T00:24:00.988630273Z [2024-04-06 00:24:00,988: INFO/ForkPoolWorker-2] [e181ac06-9c7f-41b2-9862-b1e2935598aa] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T00:24:01.308083421Z [2024-04-06 00:24:01,297: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T00:24:01.327852615Z [2024-04-06 00:24:01,322: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T00:24:01.349873486Z [2024-04-06 00:24:01,345: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T00:24:01.458628389Z [2024-04-06 00:24:01,455: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T00:24:01.509513024Z [2024-04-06 00:24:01,509: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-06T00:24:01.513342658Z [2024-04-06 00:24:01,512: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:24:01.544580020Z [2024-04-06 00:24:01,544: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T00:24:01.547743437Z [2024-04-06 00:24:01,547: INFO/ForkPoolWorker-2] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T00:24:01.547813365Z [2024-04-06 00:24:01,547: INFO/ForkPoolWorker-2] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T00:24:01.547818459Z [2024-04-06 00:24:01,547: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-06T00:24:01.548053712Z [2024-04-06 00:24:01,547: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T00:24:01.640537908Z [2024-04-06 00:24:01,640: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:24:01.843772208Z [2024-04-06 00:24:01,843: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:24:02.441923916Z [2024-04-06 00:24:02,441: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[11d37c25-25c7-43dc-9603-46e0a082a30c] succeeded in 1.5093988999997237s: None 2024-04-06T00:24:02.511328568Z [2024-04-06 00:24:02,510: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[e181ac06-9c7f-41b2-9862-b1e2935598aa] succeeded in 1.5397921000003407s: None 2024-04-06T00:24:02.948981704Z [2024-04-06 00:24:02,948: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T00:24:02.952583326Z [2024-04-06 00:24:02,952: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:24:02.970270407Z [2024-04-06 00:24:02,969: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T00:24:02.975035191Z [2024-04-06 00:24:02,974: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T00:24:02.975335574Z [2024-04-06 00:24:02,974: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:24:02.976603184Z [2024-04-06 00:24:02,976: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:24:02.976863540Z [2024-04-06 00:24:02,976: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:24:02.977046867Z [2024-04-06 00:24:02,976: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:24:02.977065872Z [2024-04-06 00:24:02,976: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T00:24:02.977793846Z [2024-04-06 00:24:02,977: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-06T00:24:02.977851348Z [2024-04-06 00:24:02,977: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:24:02.997007903Z [2024-04-06 00:24:02,996: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T00:24:02.998314164Z [2024-04-06 00:24:02,998: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:24:02.998463624Z [2024-04-06 00:24:02,998: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:24:02.998611889Z [2024-04-06 00:24:02,998: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:24:02.998672902Z [2024-04-06 00:24:02,998: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T00:24:02.998961000Z [2024-04-06 00:24:02,998: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T00:24:02.999420384Z [2024-04-06 00:24:02,999: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:24:03.066181402Z [2024-04-06 00:24:03,065: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:24:03.131221060Z [2024-04-06 00:24:03,130: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:24:04.720557664Z [2024-04-06 00:24:04,719: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e0f5c27d-93a1-4c9a-b280-710a20efc2ad] succeeded in 3.7837104959999124s: None 2024-04-06T00:24:04.963809558Z [2024-04-06 00:24:04,963: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d65c3226-a360-4828-902c-d905fc177337] succeeded in 3.998926977999872s: None 2024-04-06T00:25:00.730843438Z [2024-04-06 00:25:00,730: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[09c64fd1-5cfd-4e34-a90f-d25c908fbb4e] received 2024-04-06T00:25:00.733677329Z [2024-04-06 00:25:00,733: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[87be8f86-205f-4a17-91ee-7140da0a3199] received 2024-04-06T00:25:00.740404323Z [2024-04-06 00:25:00,740: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0f456159-80a9-4616-b487-813214fbbfcf] received 2024-04-06T00:25:00.742444626Z [2024-04-06 00:25:00,742: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4f9c2e5c-b9a6-4677-9440-99ae2c4dffd3] received 2024-04-06T00:25:00.744210836Z [2024-04-06 00:25:00,743: INFO/ForkPoolWorker-16] [87be8f86-205f-4a17-91ee-7140da0a3199] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T00:25:00.748436632Z [2024-04-06 00:25:00,747: INFO/ForkPoolWorker-15] [09c64fd1-5cfd-4e34-a90f-d25c908fbb4e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T00:25:00.749056679Z [2024-04-06 00:25:00,748: INFO/ForkPoolWorker-1] [0f456159-80a9-4616-b487-813214fbbfcf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T00:25:00.755634058Z [2024-04-06 00:25:00,755: INFO/ForkPoolWorker-2] [4f9c2e5c-b9a6-4677-9440-99ae2c4dffd3] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T00:25:01.043130553Z [2024-04-06 00:25:01,039: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T00:25:01.073436849Z [2024-04-06 00:25:01,069: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T00:25:01.117339909Z [2024-04-06 00:25:01,110: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T00:25:01.133946517Z [2024-04-06 00:25:01,130: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T00:25:01.334812385Z [2024-04-06 00:25:01,334: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-06T00:25:01.339331245Z [2024-04-06 00:25:01,338: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:25:01.383351865Z [2024-04-06 00:25:01,383: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T00:25:01.386355247Z [2024-04-06 00:25:01,386: INFO/ForkPoolWorker-2] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T00:25:01.386553892Z [2024-04-06 00:25:01,386: INFO/ForkPoolWorker-2] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T00:25:01.386718312Z [2024-04-06 00:25:01,386: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-06T00:25:01.387099009Z [2024-04-06 00:25:01,386: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T00:25:01.498055447Z [2024-04-06 00:25:01,497: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:25:02.179085860Z [2024-04-06 00:25:02,178: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[4f9c2e5c-b9a6-4677-9440-99ae2c4dffd3] succeeded in 1.434717352000007s: None 2024-04-06T00:25:02.427532751Z [2024-04-06 00:25:02,427: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T00:25:02.431113381Z [2024-04-06 00:25:02,430: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:25:02.464366870Z [2024-04-06 00:25:02,464: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T00:25:02.465881400Z [2024-04-06 00:25:02,465: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:25:02.465977450Z [2024-04-06 00:25:02,465: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:25:02.466159090Z [2024-04-06 00:25:02,465: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:25:02.466269878Z [2024-04-06 00:25:02,466: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T00:25:02.466604550Z [2024-04-06 00:25:02,466: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T00:25:02.466665970Z [2024-04-06 00:25:02,466: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:25:02.557620322Z [2024-04-06 00:25:02,557: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:25:02.583989865Z [2024-04-06 00:25:02,583: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T00:25:02.587609137Z [2024-04-06 00:25:02,587: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:25:02.613141358Z [2024-04-06 00:25:02,612: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T00:25:02.614607145Z [2024-04-06 00:25:02,614: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:25:02.614767240Z [2024-04-06 00:25:02,614: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:25:02.614920593Z [2024-04-06 00:25:02,614: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:25:02.615043118Z [2024-04-06 00:25:02,614: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T00:25:02.615809546Z [2024-04-06 00:25:02,615: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-06T00:25:02.616184587Z [2024-04-06 00:25:02,616: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:25:02.713385876Z [2024-04-06 00:25:02,712: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T00:25:02.724035259Z [2024-04-06 00:25:02,721: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:25:02.729867799Z [2024-04-06 00:25:02,727: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:25:02.754454432Z [2024-04-06 00:25:02,754: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T00:25:02.762324871Z [2024-04-06 00:25:02,761: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:25:02.764333169Z [2024-04-06 00:25:02,762: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:25:02.764637537Z [2024-04-06 00:25:02,764: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:25:02.764980387Z [2024-04-06 00:25:02,764: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T00:25:02.765331593Z [2024-04-06 00:25:02,765: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T00:25:02.765446562Z [2024-04-06 00:25:02,765: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:25:02.874276895Z [2024-04-06 00:25:02,873: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:25:03.618172147Z [2024-04-06 00:25:03,617: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[09c64fd1-5cfd-4e34-a90f-d25c908fbb4e] succeeded in 2.883042186000239s: None 2024-04-06T00:25:03.676883859Z [2024-04-06 00:25:03,676: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[19c800a9-9bd6-4659-861a-107ebc50e242] received 2024-04-06T00:25:03.711458219Z [2024-04-06 00:25:03,708: INFO/ForkPoolWorker-15] [19c800a9-9bd6-4659-861a-107ebc50e242] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'split_metrics', 'scheduled__2024-04-06T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T00:25:04.056031007Z [2024-04-06 00:25:04,052: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T00:25:04.160286789Z [2024-04-06 00:25:04,159: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[87be8f86-205f-4a17-91ee-7140da0a3199] succeeded in 3.4236457529996187s: None 2024-04-06T00:25:04.633941213Z [2024-04-06 00:25:04,631: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0f456159-80a9-4616-b487-813214fbbfcf] succeeded in 3.890211335999993s: None 2024-04-06T00:25:05.335959830Z [2024-04-06 00:25:05,335: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T00:25:05.339056187Z [2024-04-06 00:25:05,338: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:25:05.359021850Z [2024-04-06 00:25:05,358: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T00:25:05.360215361Z [2024-04-06 00:25:05,360: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:25:05.360231969Z [2024-04-06 00:25:05,360: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:25:05.360361432Z [2024-04-06 00:25:05,360: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:25:05.360386938Z [2024-04-06 00:25:05,360: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T00:25:05.360592148Z [2024-04-06 00:25:05,360: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T00:25:05.360632797Z [2024-04-06 00:25:05,360: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:25:05.461606845Z [2024-04-06 00:25:05,461: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:25:06.215497177Z [2024-04-06 00:25:06,211: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[19c800a9-9bd6-4659-861a-107ebc50e242] succeeded in 2.530432971000664s: None 2024-04-06T00:25:06.507513680Z [2024-04-06 00:25:06,506: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c12ab8f7-0077-4b45-8b0c-23553c528114] received 2024-04-06T00:25:06.518933546Z [2024-04-06 00:25:06,518: INFO/ForkPoolWorker-15] [c12ab8f7-0077-4b45-8b0c-23553c528114] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'collect_metrics', 'scheduled__2024-04-06T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T00:25:06.830101950Z [2024-04-06 00:25:06,826: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T00:25:07.966784558Z [2024-04-06 00:25:07,966: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T00:25:07.970270928Z [2024-04-06 00:25:07,969: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:25:07.995697297Z [2024-04-06 00:25:07,995: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T00:25:07.997073924Z [2024-04-06 00:25:07,996: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:25:07.997210222Z [2024-04-06 00:25:07,997: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:25:07.997426677Z [2024-04-06 00:25:07,997: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:25:07.997560887Z [2024-04-06 00:25:07,997: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T00:25:07.997872211Z [2024-04-06 00:25:07,997: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T00:25:07.998018585Z [2024-04-06 00:25:07,997: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:25:08.108818996Z [2024-04-06 00:25:08,108: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:25:08.692086802Z [2024-04-06 00:25:08,691: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4e702569-d2c8-4645-9040-342e01a09882] received 2024-04-06T00:25:08.699648627Z [2024-04-06 00:25:08,699: INFO/ForkPoolWorker-16] [4e702569-d2c8-4645-9040-342e01a09882] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'send_prometheus', 'scheduled__2024-04-06T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T00:25:08.753452969Z [2024-04-06 00:25:08,753: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c12ab8f7-0077-4b45-8b0c-23553c528114] succeeded in 2.24302383200029s: None 2024-04-06T00:25:09.021819096Z [2024-04-06 00:25:09,018: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T00:25:10.161975149Z [2024-04-06 00:25:10,161: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T00:25:10.165420976Z [2024-04-06 00:25:10,164: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:25:10.189049759Z [2024-04-06 00:25:10,188: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T00:25:10.190258792Z [2024-04-06 00:25:10,190: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:25:10.190271976Z [2024-04-06 00:25:10,190: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:25:10.190373457Z [2024-04-06 00:25:10,190: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:25:10.190393444Z [2024-04-06 00:25:10,190: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T00:25:10.190667374Z [2024-04-06 00:25:10,190: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T00:25:10.190676583Z [2024-04-06 00:25:10,190: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:25:10.266480596Z [2024-04-06 00:25:10,266: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:25:10.943565940Z [2024-04-06 00:25:10,942: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4e702569-d2c8-4645-9040-342e01a09882] succeeded in 2.2495138949998363s: None 2024-04-06T00:26:00.810130364Z [2024-04-06 00:26:00,809: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4900e0f9-111a-49ea-a313-51dacda83f86] received 2024-04-06T00:26:00.813702219Z [2024-04-06 00:26:00,813: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4d937e44-9ab8-4be9-91bf-714a4f12176f] received 2024-04-06T00:26:00.820913092Z [2024-04-06 00:26:00,820: INFO/ForkPoolWorker-15] [4900e0f9-111a-49ea-a313-51dacda83f86] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T00:26:00.823685472Z [2024-04-06 00:26:00,823: INFO/ForkPoolWorker-16] [4d937e44-9ab8-4be9-91bf-714a4f12176f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T00:26:00.824200211Z [2024-04-06 00:26:00,823: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b8648af0-e99f-4f89-8cd1-34a6e7c5f6d2] received 2024-04-06T00:26:00.829854399Z [2024-04-06 00:26:00,829: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[405e0122-cd1f-4dda-bd9f-598325b0911e] received 2024-04-06T00:26:00.839207230Z [2024-04-06 00:26:00,838: INFO/ForkPoolWorker-1] [b8648af0-e99f-4f89-8cd1-34a6e7c5f6d2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T00:26:00.843344174Z [2024-04-06 00:26:00,842: INFO/ForkPoolWorker-2] [405e0122-cd1f-4dda-bd9f-598325b0911e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T00:26:01.174426381Z [2024-04-06 00:26:01,171: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T00:26:01.248340449Z [2024-04-06 00:26:01,245: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T00:26:01.285765464Z [2024-04-06 00:26:01,282: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T00:26:01.313990117Z [2024-04-06 00:26:01,310: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T00:26:01.457149582Z [2024-04-06 00:26:01,456: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-06T00:26:01.461093479Z [2024-04-06 00:26:01,460: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:26:01.494925941Z [2024-04-06 00:26:01,494: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:26:01.501476625Z [2024-04-06 00:26:01,501: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T00:26:01.503360373Z [2024-04-06 00:26:01,503: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T00:26:01.503492076Z [2024-04-06 00:26:01,503: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T00:26:01.503560766Z [2024-04-06 00:26:01,503: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-06T00:26:01.503815604Z [2024-04-06 00:26:01,503: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T00:26:01.603733311Z [2024-04-06 00:26:01,603: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:26:02.227011888Z [2024-04-06 00:26:02,226: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4900e0f9-111a-49ea-a313-51dacda83f86] succeeded in 1.412467875999937s: None 2024-04-06T00:26:02.252069198Z [2024-04-06 00:26:02,251: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b8648af0-e99f-4f89-8cd1-34a6e7c5f6d2] succeeded in 1.425896302000183s: None 2024-04-06T00:26:02.538252001Z [2024-04-06 00:26:02,537: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T00:26:02.541650099Z [2024-04-06 00:26:02,541: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:26:02.565909690Z [2024-04-06 00:26:02,565: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T00:26:02.568515895Z [2024-04-06 00:26:02,568: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:26:02.568593891Z [2024-04-06 00:26:02,568: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:26:02.568774333Z [2024-04-06 00:26:02,568: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:26:02.568830881Z [2024-04-06 00:26:02,568: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T00:26:02.569116599Z [2024-04-06 00:26:02,568: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T00:26:02.569244191Z [2024-04-06 00:26:02,569: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:26:02.627498333Z [2024-04-06 00:26:02,626: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-06T00:26:02.630554716Z [2024-04-06 00:26:02,629: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:26:02.661709736Z [2024-04-06 00:26:02,661: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T00:26:02.663739803Z [2024-04-06 00:26:02,663: INFO/ForkPoolWorker-2] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:26:02.663840138Z [2024-04-06 00:26:02,663: INFO/ForkPoolWorker-2] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:26:02.664300450Z [2024-04-06 00:26:02,663: INFO/ForkPoolWorker-2] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:26:02.664482959Z [2024-04-06 00:26:02,664: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-06T00:26:02.665421086Z [2024-04-06 00:26:02,665: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T00:26:02.665602639Z [2024-04-06 00:26:02,665: INFO/ForkPoolWorker-2] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:26:02.675583344Z [2024-04-06 00:26:02,675: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:26:02.783912582Z [2024-04-06 00:26:02,783: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:26:04.453185430Z [2024-04-06 00:26:04,452: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[405e0122-cd1f-4dda-bd9f-598325b0911e] succeeded in 3.6213989240004594s: None 2024-04-06T00:26:04.523711554Z [2024-04-06 00:26:04,523: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4d937e44-9ab8-4be9-91bf-714a4f12176f] succeeded in 3.7074013910005306s: None 2024-04-06T00:27:00.793843100Z [2024-04-06 00:27:00,793: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9d8335e2-ac2b-489b-9f5f-7be28995b893] received 2024-04-06T00:27:00.795767685Z [2024-04-06 00:27:00,795: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[38cf79c1-3bc9-4e86-82a6-42e181d11d95] received 2024-04-06T00:27:00.807445637Z [2024-04-06 00:27:00,807: INFO/ForkPoolWorker-15] [9d8335e2-ac2b-489b-9f5f-7be28995b893] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T00:27:00.813637413Z [2024-04-06 00:27:00,813: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c4161579-bc77-4fb9-bd7b-70a9e46acbed] received 2024-04-06T00:27:00.817269502Z [2024-04-06 00:27:00,816: INFO/ForkPoolWorker-16] [38cf79c1-3bc9-4e86-82a6-42e181d11d95] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T00:27:00.824206459Z [2024-04-06 00:27:00,823: INFO/ForkPoolWorker-1] [c4161579-bc77-4fb9-bd7b-70a9e46acbed] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T00:27:01.168969162Z [2024-04-06 00:27:01,165: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T00:27:01.242609306Z [2024-04-06 00:27:01,239: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T00:27:01.258460670Z [2024-04-06 00:27:01,255: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T00:27:01.322392390Z [2024-04-06 00:27:01,321: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-06T00:27:01.326343838Z [2024-04-06 00:27:01,325: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:27:01.359160683Z [2024-04-06 00:27:01,358: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T00:27:01.360513498Z [2024-04-06 00:27:01,360: INFO/ForkPoolWorker-16] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T00:27:01.360668092Z [2024-04-06 00:27:01,360: INFO/ForkPoolWorker-16] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T00:27:01.360791217Z [2024-04-06 00:27:01,360: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-06T00:27:01.361094846Z [2024-04-06 00:27:01,360: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T00:27:01.489633650Z [2024-04-06 00:27:01,489: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:27:02.083763369Z [2024-04-06 00:27:02,083: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[38cf79c1-3bc9-4e86-82a6-42e181d11d95] succeeded in 1.2753836539995973s: None 2024-04-06T00:27:02.482934196Z [2024-04-06 00:27:02,482: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T00:27:02.486211563Z [2024-04-06 00:27:02,485: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:27:02.517560797Z [2024-04-06 00:27:02,517: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T00:27:02.520861963Z [2024-04-06 00:27:02,520: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:27:02.523826624Z [2024-04-06 00:27:02,523: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T00:27:02.530943705Z [2024-04-06 00:27:02,530: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:27:02.531140380Z [2024-04-06 00:27:02,530: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:27:02.531869852Z [2024-04-06 00:27:02,531: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:27:02.532170826Z [2024-04-06 00:27:02,531: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T00:27:02.532941455Z [2024-04-06 00:27:02,532: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T00:27:02.533261644Z [2024-04-06 00:27:02,532: INFO/ForkPoolWorker-1] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:27:02.542710963Z [2024-04-06 00:27:02,542: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T00:27:02.543994922Z [2024-04-06 00:27:02,543: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:27:02.544077324Z [2024-04-06 00:27:02,543: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:27:02.544223614Z [2024-04-06 00:27:02,544: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:27:02.544295958Z [2024-04-06 00:27:02,544: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T00:27:02.544625144Z [2024-04-06 00:27:02,544: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T00:27:02.544711874Z [2024-04-06 00:27:02,544: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:27:02.620892706Z [2024-04-06 00:27:02,620: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:27:02.643685132Z [2024-04-06 00:27:02,643: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:27:04.229199935Z [2024-04-06 00:27:04,228: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c4161579-bc77-4fb9-bd7b-70a9e46acbed] succeeded in 3.4134337739997136s: None 2024-04-06T00:27:04.685771719Z [2024-04-06 00:27:04,685: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9d8335e2-ac2b-489b-9f5f-7be28995b893] succeeded in 3.8883481160000883s: None 2024-04-06T00:28:00.920295113Z [2024-04-06 00:28:00,919: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e82e1fe8-e1ee-4815-936f-2e55dc2eab7b] received 2024-04-06T00:28:00.924443770Z [2024-04-06 00:28:00,924: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f4ed3429-0f72-4b8b-929e-801a786b6ed0] received 2024-04-06T00:28:00.936053071Z [2024-04-06 00:28:00,935: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8517473d-6963-4c60-99c3-74f2a36cfe2c] received 2024-04-06T00:28:00.945445962Z [2024-04-06 00:28:00,945: INFO/ForkPoolWorker-1] [8517473d-6963-4c60-99c3-74f2a36cfe2c] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T00:28:00.947323704Z [2024-04-06 00:28:00,947: INFO/ForkPoolWorker-16] [f4ed3429-0f72-4b8b-929e-801a786b6ed0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T00:28:00.948133101Z [2024-04-06 00:28:00,947: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6e20a77a-bff1-4ea7-bded-2e2ebccfe0f7] received 2024-04-06T00:28:00.948897844Z [2024-04-06 00:28:00,948: INFO/ForkPoolWorker-15] [e82e1fe8-e1ee-4815-936f-2e55dc2eab7b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T00:28:00.974268835Z [2024-04-06 00:28:00,973: INFO/ForkPoolWorker-2] [6e20a77a-bff1-4ea7-bded-2e2ebccfe0f7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T00:28:01.259174206Z [2024-04-06 00:28:01,255: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T00:28:01.364835510Z [2024-04-06 00:28:01,361: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T00:28:01.388806269Z [2024-04-06 00:28:01,385: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T00:28:01.397251272Z [2024-04-06 00:28:01,393: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T00:28:01.536158064Z [2024-04-06 00:28:01,535: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:28:01.550181042Z [2024-04-06 00:28:01,549: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-06T00:28:01.554451849Z [2024-04-06 00:28:01,553: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:28:01.588632994Z [2024-04-06 00:28:01,588: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T00:28:01.590361431Z [2024-04-06 00:28:01,590: INFO/ForkPoolWorker-15] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T00:28:01.590493794Z [2024-04-06 00:28:01,590: INFO/ForkPoolWorker-15] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T00:28:01.590567646Z [2024-04-06 00:28:01,590: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-06T00:28:01.590786480Z [2024-04-06 00:28:01,590: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T00:28:01.690677927Z [2024-04-06 00:28:01,690: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:28:02.268847914Z [2024-04-06 00:28:02,268: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8517473d-6963-4c60-99c3-74f2a36cfe2c] succeeded in 1.3302337309996801s: None 2024-04-06T00:28:02.405747465Z [2024-04-06 00:28:02,405: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e82e1fe8-e1ee-4815-936f-2e55dc2eab7b] succeeded in 1.4824963580003896s: None 2024-04-06T00:28:02.960819199Z [2024-04-06 00:28:02,960: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-06T00:28:02.964076053Z [2024-04-06 00:28:02,963: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:28:02.982637143Z [2024-04-06 00:28:02,982: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T00:28:02.984428310Z [2024-04-06 00:28:02,984: INFO/ForkPoolWorker-2] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:28:02.984664810Z [2024-04-06 00:28:02,984: INFO/ForkPoolWorker-2] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:28:02.984888536Z [2024-04-06 00:28:02,984: INFO/ForkPoolWorker-2] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:28:02.984943487Z [2024-04-06 00:28:02,984: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-06T00:28:02.985308868Z [2024-04-06 00:28:02,985: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-06T00:28:02.985366503Z [2024-04-06 00:28:02,985: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:28:03.006249372Z [2024-04-06 00:28:03,005: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T00:28:03.009735604Z [2024-04-06 00:28:03,009: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:28:03.028793570Z [2024-04-06 00:28:03,028: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T00:28:03.029835280Z [2024-04-06 00:28:03,029: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:28:03.029876140Z [2024-04-06 00:28:03,029: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:28:03.029942890Z [2024-04-06 00:28:03,029: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:28:03.029953340Z [2024-04-06 00:28:03,029: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T00:28:03.030200305Z [2024-04-06 00:28:03,030: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T00:28:03.030212060Z [2024-04-06 00:28:03,030: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:28:03.083484918Z [2024-04-06 00:28:03,082: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:28:03.108509892Z [2024-04-06 00:28:03,108: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:28:05.226054680Z [2024-04-06 00:28:05,225: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f4ed3429-0f72-4b8b-929e-801a786b6ed0] succeeded in 4.29099560099985s: None 2024-04-06T00:28:05.513217219Z [2024-04-06 00:28:05,512: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[6e20a77a-bff1-4ea7-bded-2e2ebccfe0f7] succeeded in 4.561852117999479s: None 2024-04-06T00:29:00.570156042Z [2024-04-06 00:29:00,569: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0df11ea2-3573-46f2-b5f4-67faa27ebb9c] received 2024-04-06T00:29:00.572011950Z [2024-04-06 00:29:00,571: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9b1771bd-471b-4507-9741-fd4520c236bc] received 2024-04-06T00:29:00.573447038Z [2024-04-06 00:29:00,573: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e38cb651-5ee4-4d8c-904e-f966a04c5f82] received 2024-04-06T00:29:00.584644830Z [2024-04-06 00:29:00,584: INFO/ForkPoolWorker-16] [9b1771bd-471b-4507-9741-fd4520c236bc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T00:29:00.587369128Z [2024-04-06 00:29:00,587: INFO/ForkPoolWorker-1] [e38cb651-5ee4-4d8c-904e-f966a04c5f82] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T00:29:00.590951234Z [2024-04-06 00:29:00,590: INFO/ForkPoolWorker-15] [0df11ea2-3573-46f2-b5f4-67faa27ebb9c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T00:29:00.851458740Z [2024-04-06 00:29:00,848: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T00:29:00.851506648Z [2024-04-06 00:29:00,848: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T00:29:00.913738979Z [2024-04-06 00:29:00,909: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T00:29:01.048434518Z [2024-04-06 00:29:01,037: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-06T00:29:01.048499272Z [2024-04-06 00:29:01,042: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:29:01.070582643Z [2024-04-06 00:29:01,070: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T00:29:01.072129635Z [2024-04-06 00:29:01,071: INFO/ForkPoolWorker-15] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T00:29:01.072346929Z [2024-04-06 00:29:01,072: INFO/ForkPoolWorker-15] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T00:29:01.072526589Z [2024-04-06 00:29:01,072: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-06T00:29:01.072851691Z [2024-04-06 00:29:01,072: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T00:29:01.171221607Z [2024-04-06 00:29:01,170: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:29:01.795557845Z [2024-04-06 00:29:01,795: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0df11ea2-3573-46f2-b5f4-67faa27ebb9c] succeeded in 1.213489856000706s: None 2024-04-06T00:29:02.053504993Z [2024-04-06 00:29:02,053: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T00:29:02.056987516Z [2024-04-06 00:29:02,056: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:29:02.080833725Z [2024-04-06 00:29:02,080: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T00:29:02.082030635Z [2024-04-06 00:29:02,081: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:29:02.082191106Z [2024-04-06 00:29:02,082: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:29:02.082451502Z [2024-04-06 00:29:02,082: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:29:02.084063949Z [2024-04-06 00:29:02,083: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T00:29:02.084709769Z [2024-04-06 00:29:02,084: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T00:29:02.084906727Z [2024-04-06 00:29:02,084: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:29:02.180021718Z [2024-04-06 00:29:02,179: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T00:29:02.187691541Z [2024-04-06 00:29:02,187: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:29:02.208784464Z [2024-04-06 00:29:02,208: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:29:02.222936989Z [2024-04-06 00:29:02,222: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T00:29:02.225947674Z [2024-04-06 00:29:02,225: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:29:02.227080844Z [2024-04-06 00:29:02,226: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:29:02.227334832Z [2024-04-06 00:29:02,227: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:29:02.227506692Z [2024-04-06 00:29:02,227: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T00:29:02.227841221Z [2024-04-06 00:29:02,227: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-06T00:29:02.228358655Z [2024-04-06 00:29:02,228: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:29:02.315060100Z [2024-04-06 00:29:02,314: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:29:04.106551661Z [2024-04-06 00:29:04,105: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9b1771bd-471b-4507-9741-fd4520c236bc] succeeded in 3.5313942869997845s: None 2024-04-06T00:29:04.550977528Z [2024-04-06 00:29:04,538: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e38cb651-5ee4-4d8c-904e-f966a04c5f82] succeeded in 3.9632458900005076s: None 2024-04-06T00:30:00.566901401Z [2024-04-06 00:30:00,566: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[52d62077-2620-4b49-bbd8-c0193ada3334] received 2024-04-06T00:30:00.568809643Z [2024-04-06 00:30:00,568: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ee6b96f1-2332-4229-96da-64772838be94] received 2024-04-06T00:30:00.572088698Z [2024-04-06 00:30:00,571: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c3cd2299-7621-4fba-b76d-e33367797b5a] received 2024-04-06T00:30:00.573970730Z [2024-04-06 00:30:00,573: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[31ff4f8b-3d0b-4948-a1fd-6050c78186b0] received 2024-04-06T00:30:00.578104832Z [2024-04-06 00:30:00,577: INFO/ForkPoolWorker-15] [52d62077-2620-4b49-bbd8-c0193ada3334] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T00:30:00.579644106Z [2024-04-06 00:30:00,577: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5231dcd4-fa44-43cc-b524-51067b66c503] received 2024-04-06T00:30:00.581844187Z [2024-04-06 00:30:00,581: INFO/ForkPoolWorker-2] [31ff4f8b-3d0b-4948-a1fd-6050c78186b0] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T00:30:00.592867195Z [2024-04-06 00:30:00,589: INFO/ForkPoolWorker-1] [c3cd2299-7621-4fba-b76d-e33367797b5a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T00:30:00.592945772Z [2024-04-06 00:30:00,590: INFO/ForkPoolWorker-16] [ee6b96f1-2332-4229-96da-64772838be94] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T00:30:00.615470377Z [2024-04-06 00:30:00,615: INFO/ForkPoolWorker-3] [5231dcd4-fa44-43cc-b524-51067b66c503] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T00:30:00.981684085Z [2024-04-06 00:30:00,977: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T00:30:01.024509196Z [2024-04-06 00:30:01,016: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T00:30:01.031064640Z [2024-04-06 00:30:01,027: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T00:30:01.062303881Z [2024-04-06 00:30:01,056: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T00:30:01.318874512Z [2024-04-06 00:30:01,314: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T00:30:01.424359554Z [2024-04-06 00:30:01,423: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-06T00:30:01.428435078Z [2024-04-06 00:30:01,427: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:30:01.470637375Z [2024-04-06 00:30:01,470: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T00:30:01.476379365Z [2024-04-06 00:30:01,476: INFO/ForkPoolWorker-16] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T00:30:01.476624058Z [2024-04-06 00:30:01,476: INFO/ForkPoolWorker-16] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T00:30:01.476775739Z [2024-04-06 00:30:01,476: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-06T00:30:01.477142272Z [2024-04-06 00:30:01,476: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T00:30:01.640095214Z [2024-04-06 00:30:01,639: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:30:01.693619374Z [2024-04-06 00:30:01,693: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:30:02.302108722Z [2024-04-06 00:30:02,301: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[31ff4f8b-3d0b-4948-a1fd-6050c78186b0] succeeded in 1.7264689490002638s: None 2024-04-06T00:30:02.408550056Z [2024-04-06 00:30:02,408: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ee6b96f1-2332-4229-96da-64772838be94] succeeded in 1.8365768660005415s: None 2024-04-06T00:30:02.551488639Z [2024-04-06 00:30:02,550: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T00:30:02.555468780Z [2024-04-06 00:30:02,554: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:30:02.578627600Z [2024-04-06 00:30:02,578: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T00:30:02.580876801Z [2024-04-06 00:30:02,580: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:30:02.581252841Z [2024-04-06 00:30:02,580: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:30:02.581506624Z [2024-04-06 00:30:02,581: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:30:02.581556887Z [2024-04-06 00:30:02,581: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T00:30:02.581965569Z [2024-04-06 00:30:02,581: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T00:30:02.582019071Z [2024-04-06 00:30:02,581: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:30:02.636647097Z [2024-04-06 00:30:02,635: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T00:30:02.639867642Z [2024-04-06 00:30:02,639: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:30:02.664225610Z [2024-04-06 00:30:02,664: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T00:30:02.665548816Z [2024-04-06 00:30:02,665: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:30:02.665561353Z [2024-04-06 00:30:02,665: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:30:02.665603719Z [2024-04-06 00:30:02,665: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:30:02.665659032Z [2024-04-06 00:30:02,665: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T00:30:02.665869547Z [2024-04-06 00:30:02,665: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-06T00:30:02.665902499Z [2024-04-06 00:30:02,665: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:30:02.674192325Z [2024-04-06 00:30:02,673: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:30:02.781273478Z [2024-04-06 00:30:02,780: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:30:02.830502418Z [2024-04-06 00:30:02,830: INFO/ForkPoolWorker-3] Getting VIM list 2024-04-06T00:30:02.834151318Z [2024-04-06 00:30:02,833: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:30:02.861034586Z [2024-04-06 00:30:02,860: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-06T00:30:02.862924193Z [2024-04-06 00:30:02,862: INFO/ForkPoolWorker-3] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:30:02.863009818Z [2024-04-06 00:30:02,862: INFO/ForkPoolWorker-3] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:30:02.863200644Z [2024-04-06 00:30:02,862: INFO/ForkPoolWorker-3] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:30:02.863314533Z [2024-04-06 00:30:02,863: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-04-06T00:30:02.863736289Z [2024-04-06 00:30:02,863: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T00:30:02.863866760Z [2024-04-06 00:30:02,863: INFO/ForkPoolWorker-3] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:30:02.960358630Z [2024-04-06 00:30:02,960: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:30:03.281269105Z [2024-04-06 00:30:03,280: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[52d62077-2620-4b49-bbd8-c0193ada3334] succeeded in 2.7113104410000233s: None 2024-04-06T00:30:03.369392102Z [2024-04-06 00:30:03,369: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3308492d-11a5-496f-8377-4b6fbb29f218] received 2024-04-06T00:30:03.384354440Z [2024-04-06 00:30:03,383: INFO/ForkPoolWorker-15] [3308492d-11a5-496f-8377-4b6fbb29f218] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'split_metrics', 'scheduled__2024-04-06T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T00:30:03.705737529Z [2024-04-06 00:30:03,700: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T00:30:04.608602066Z [2024-04-06 00:30:04,608: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[5231dcd4-fa44-43cc-b524-51067b66c503] succeeded in 4.016674999000315s: None 2024-04-06T00:30:04.953634423Z [2024-04-06 00:30:04,953: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c3cd2299-7621-4fba-b76d-e33367797b5a] succeeded in 4.377625625999826s: None 2024-04-06T00:30:04.956412191Z [2024-04-06 00:30:04,956: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T00:30:04.959744286Z [2024-04-06 00:30:04,959: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:30:04.981260577Z [2024-04-06 00:30:04,980: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T00:30:04.982744870Z [2024-04-06 00:30:04,982: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:30:04.982823295Z [2024-04-06 00:30:04,982: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:30:04.983046842Z [2024-04-06 00:30:04,982: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:30:04.983127622Z [2024-04-06 00:30:04,982: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T00:30:04.983456257Z [2024-04-06 00:30:04,983: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T00:30:04.983644917Z [2024-04-06 00:30:04,983: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:30:05.092988697Z [2024-04-06 00:30:05,092: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:30:05.812828473Z [2024-04-06 00:30:05,811: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3308492d-11a5-496f-8377-4b6fbb29f218] succeeded in 2.4390790870002093s: None 2024-04-06T00:30:06.857530460Z [2024-04-06 00:30:06,857: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c5ba9692-0b5e-466b-86ac-062c1741d097] received 2024-04-06T00:30:06.865114879Z [2024-04-06 00:30:06,864: INFO/ForkPoolWorker-15] [c5ba9692-0b5e-466b-86ac-062c1741d097] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'collect_metrics', 'scheduled__2024-04-06T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T00:30:07.137255868Z [2024-04-06 00:30:07,133: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T00:30:08.302895907Z [2024-04-06 00:30:08,302: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T00:30:08.306152388Z [2024-04-06 00:30:08,305: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:30:08.336057299Z [2024-04-06 00:30:08,335: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T00:30:08.337813087Z [2024-04-06 00:30:08,337: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:30:08.337827215Z [2024-04-06 00:30:08,337: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:30:08.338184424Z [2024-04-06 00:30:08,337: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:30:08.338214209Z [2024-04-06 00:30:08,337: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T00:30:08.338542586Z [2024-04-06 00:30:08,338: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T00:30:08.338554163Z [2024-04-06 00:30:08,338: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:30:08.450964792Z [2024-04-06 00:30:08,444: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:30:09.021888465Z [2024-04-06 00:30:09,021: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c5ba9692-0b5e-466b-86ac-062c1741d097] succeeded in 2.162444484999469s: None 2024-04-06T00:30:09.647492985Z [2024-04-06 00:30:09,646: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2c1b6eed-49bb-4190-9eb1-d24ed8163a3b] received 2024-04-06T00:30:09.653719057Z [2024-04-06 00:30:09,653: INFO/ForkPoolWorker-15] [2c1b6eed-49bb-4190-9eb1-d24ed8163a3b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'send_prometheus', 'scheduled__2024-04-06T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T00:30:09.944247452Z [2024-04-06 00:30:09,941: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T00:30:11.264232388Z [2024-04-06 00:30:11,263: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T00:30:11.267400863Z [2024-04-06 00:30:11,266: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:30:11.293447672Z [2024-04-06 00:30:11,293: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T00:30:11.295480587Z [2024-04-06 00:30:11,295: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:30:11.295522664Z [2024-04-06 00:30:11,295: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:30:11.295684035Z [2024-04-06 00:30:11,295: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:30:11.295700491Z [2024-04-06 00:30:11,295: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T00:30:11.296047099Z [2024-04-06 00:30:11,295: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T00:30:11.296120247Z [2024-04-06 00:30:11,295: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:30:11.401463123Z [2024-04-06 00:30:11,400: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:30:12.094525463Z [2024-04-06 00:30:12,093: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2c1b6eed-49bb-4190-9eb1-d24ed8163a3b] succeeded in 2.44471383400014s: None 2024-04-06T00:31:00.504111908Z [2024-04-06 00:31:00,503: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4ad88f72-13bc-404a-bbf0-7368d39b1a12] received 2024-04-06T00:31:00.506205335Z [2024-04-06 00:31:00,506: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d70ed022-cc7f-449f-9d1e-c04050e18e68] received 2024-04-06T00:31:00.513838142Z [2024-04-06 00:31:00,513: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[94914047-75c9-49ac-87f8-2656bfa29301] received 2024-04-06T00:31:00.521131755Z [2024-04-06 00:31:00,520: INFO/ForkPoolWorker-16] [d70ed022-cc7f-449f-9d1e-c04050e18e68] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T00:31:00.522157184Z [2024-04-06 00:31:00,521: INFO/ForkPoolWorker-15] [4ad88f72-13bc-404a-bbf0-7368d39b1a12] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T00:31:00.523839035Z [2024-04-06 00:31:00,523: INFO/ForkPoolWorker-1] [94914047-75c9-49ac-87f8-2656bfa29301] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T00:31:00.794080289Z [2024-04-06 00:31:00,790: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T00:31:00.819566288Z [2024-04-06 00:31:00,816: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T00:31:00.865561124Z [2024-04-06 00:31:00,861: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T00:31:01.038873291Z [2024-04-06 00:31:01,038: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-06T00:31:01.043353980Z [2024-04-06 00:31:01,042: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:31:01.072344334Z [2024-04-06 00:31:01,072: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T00:31:01.076276571Z [2024-04-06 00:31:01,075: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T00:31:01.076498293Z [2024-04-06 00:31:01,076: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T00:31:01.076651046Z [2024-04-06 00:31:01,076: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-06T00:31:01.077104287Z [2024-04-06 00:31:01,076: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T00:31:01.191518090Z [2024-04-06 00:31:01,191: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:31:01.811940181Z [2024-04-06 00:31:01,811: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[94914047-75c9-49ac-87f8-2656bfa29301] succeeded in 1.2957441340004152s: None 2024-04-06T00:31:02.066763228Z [2024-04-06 00:31:02,066: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T00:31:02.070151807Z [2024-04-06 00:31:02,069: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:31:02.086388538Z [2024-04-06 00:31:02,086: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T00:31:02.087624298Z [2024-04-06 00:31:02,087: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:31:02.087637532Z [2024-04-06 00:31:02,087: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:31:02.087801410Z [2024-04-06 00:31:02,087: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:31:02.087861457Z [2024-04-06 00:31:02,087: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T00:31:02.088128303Z [2024-04-06 00:31:02,087: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T00:31:02.088174361Z [2024-04-06 00:31:02,088: INFO/ForkPoolWorker-15] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:31:02.091116891Z [2024-04-06 00:31:02,090: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T00:31:02.094713254Z [2024-04-06 00:31:02,094: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:31:02.114189526Z [2024-04-06 00:31:02,113: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T00:31:02.115516973Z [2024-04-06 00:31:02,115: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:31:02.115611570Z [2024-04-06 00:31:02,115: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:31:02.115787554Z [2024-04-06 00:31:02,115: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:31:02.115886819Z [2024-04-06 00:31:02,115: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T00:31:02.116215101Z [2024-04-06 00:31:02,116: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T00:31:02.116351273Z [2024-04-06 00:31:02,116: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:31:02.159647613Z [2024-04-06 00:31:02,159: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:31:02.211148003Z [2024-04-06 00:31:02,210: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:31:03.776598882Z [2024-04-06 00:31:03,776: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4ad88f72-13bc-404a-bbf0-7368d39b1a12] succeeded in 3.2699272259997088s: None 2024-04-06T00:31:03.969824547Z [2024-04-06 00:31:03,969: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d70ed022-cc7f-449f-9d1e-c04050e18e68] succeeded in 3.459149253999385s: None 2024-04-06T00:32:00.524513179Z [2024-04-06 00:32:00,524: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e4dc1316-4297-4f4e-b57e-dbc8f3bd84bf] received 2024-04-06T00:32:00.526523158Z [2024-04-06 00:32:00,526: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a44cd73a-9b7b-4dd1-841d-16d20c24c1fe] received 2024-04-06T00:32:00.536384645Z [2024-04-06 00:32:00,536: INFO/ForkPoolWorker-16] [a44cd73a-9b7b-4dd1-841d-16d20c24c1fe] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T00:32:00.542262848Z [2024-04-06 00:32:00,541: INFO/ForkPoolWorker-15] [e4dc1316-4297-4f4e-b57e-dbc8f3bd84bf] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T00:32:00.543390284Z [2024-04-06 00:32:00,543: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e105d674-e679-4d68-b422-8325411ee913] received 2024-04-06T00:32:00.547613007Z [2024-04-06 00:32:00,547: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[df2d1409-598e-4c7a-837a-9c387a0b8e37] received 2024-04-06T00:32:00.560566224Z [2024-04-06 00:32:00,560: INFO/ForkPoolWorker-1] [e105d674-e679-4d68-b422-8325411ee913] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T00:32:00.561025198Z [2024-04-06 00:32:00,560: INFO/ForkPoolWorker-2] [df2d1409-598e-4c7a-837a-9c387a0b8e37] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T00:32:00.889541284Z [2024-04-06 00:32:00,886: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T00:32:00.933776138Z [2024-04-06 00:32:00,930: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T00:32:01.084801508Z [2024-04-06 00:32:01,081: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T00:32:01.253903480Z [2024-04-06 00:32:01,253: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:32:01.423615324Z [2024-04-06 00:32:01,419: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T00:32:01.688558263Z [2024-04-06 00:32:01,684: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-06T00:32:01.702598972Z [2024-04-06 00:32:01,701: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:32:01.738848233Z [2024-04-06 00:32:01,738: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T00:32:01.742144516Z [2024-04-06 00:32:01,741: INFO/ForkPoolWorker-2] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T00:32:01.742317788Z [2024-04-06 00:32:01,742: INFO/ForkPoolWorker-2] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T00:32:01.742428810Z [2024-04-06 00:32:01,742: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-06T00:32:01.742723262Z [2024-04-06 00:32:01,742: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T00:32:01.837327867Z [2024-04-06 00:32:01,837: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:32:01.921300970Z [2024-04-06 00:32:01,920: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e4dc1316-4297-4f4e-b57e-dbc8f3bd84bf] succeeded in 1.3928960009998264s: None 2024-04-06T00:32:02.317562220Z [2024-04-06 00:32:02,317: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T00:32:02.321214887Z [2024-04-06 00:32:02,320: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:32:02.352411002Z [2024-04-06 00:32:02,352: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T00:32:02.360384325Z [2024-04-06 00:32:02,360: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:32:02.360697655Z [2024-04-06 00:32:02,360: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:32:02.360999236Z [2024-04-06 00:32:02,360: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:32:02.361253370Z [2024-04-06 00:32:02,361: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T00:32:02.361831203Z [2024-04-06 00:32:02,361: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T00:32:02.362004445Z [2024-04-06 00:32:02,361: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:32:02.463492579Z [2024-04-06 00:32:02,463: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:32:02.487573498Z [2024-04-06 00:32:02,486: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[df2d1409-598e-4c7a-837a-9c387a0b8e37] succeeded in 1.9377474940001775s: None 2024-04-06T00:32:02.522633290Z [2024-04-06 00:32:02,522: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T00:32:02.526367805Z [2024-04-06 00:32:02,525: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:32:02.557849492Z [2024-04-06 00:32:02,557: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T00:32:02.559401756Z [2024-04-06 00:32:02,558: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:32:02.559540104Z [2024-04-06 00:32:02,559: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:32:02.559589926Z [2024-04-06 00:32:02,559: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:32:02.559596235Z [2024-04-06 00:32:02,559: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T00:32:02.559819664Z [2024-04-06 00:32:02,559: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T00:32:02.559859404Z [2024-04-06 00:32:02,559: INFO/ForkPoolWorker-1] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:32:02.664158862Z [2024-04-06 00:32:02,663: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:32:04.331857567Z [2024-04-06 00:32:04,331: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e105d674-e679-4d68-b422-8325411ee913] succeeded in 3.7819794560000446s: None 2024-04-06T00:32:04.636046276Z [2024-04-06 00:32:04,635: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a44cd73a-9b7b-4dd1-841d-16d20c24c1fe] succeeded in 4.107382340000186s: None 2024-04-06T00:33:01.169972425Z [2024-04-06 00:33:01,169: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[023b37e4-fc24-4dd1-b0b9-08b8c85110e7] received 2024-04-06T00:33:01.180700331Z [2024-04-06 00:33:01,180: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8fca991b-a71a-4c8a-9a56-e59be0cf38d6] received 2024-04-06T00:33:01.186283811Z [2024-04-06 00:33:01,185: INFO/ForkPoolWorker-15] [023b37e4-fc24-4dd1-b0b9-08b8c85110e7] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T00:33:01.200164993Z [2024-04-06 00:33:01,199: INFO/ForkPoolWorker-16] [8fca991b-a71a-4c8a-9a56-e59be0cf38d6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T00:33:01.209194766Z [2024-04-06 00:33:01,208: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f9a1e546-2fcc-4f71-b5b4-d61dd25a2292] received 2024-04-06T00:33:01.238919959Z [2024-04-06 00:33:01,238: INFO/ForkPoolWorker-1] [f9a1e546-2fcc-4f71-b5b4-d61dd25a2292] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T00:33:01.532869582Z [2024-04-06 00:33:01,529: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T00:33:01.548320636Z [2024-04-06 00:33:01,545: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T00:33:01.581203855Z [2024-04-06 00:33:01,577: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T00:33:01.671986778Z [2024-04-06 00:33:01,671: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-06T00:33:01.675321039Z [2024-04-06 00:33:01,674: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:33:01.697094790Z [2024-04-06 00:33:01,696: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T00:33:01.698233398Z [2024-04-06 00:33:01,698: INFO/ForkPoolWorker-15] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T00:33:01.698359822Z [2024-04-06 00:33:01,698: INFO/ForkPoolWorker-15] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T00:33:01.698371355Z [2024-04-06 00:33:01,698: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-06T00:33:01.698604250Z [2024-04-06 00:33:01,698: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T00:33:01.796760770Z [2024-04-06 00:33:01,796: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:33:02.453175809Z [2024-04-06 00:33:02,452: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[023b37e4-fc24-4dd1-b0b9-08b8c85110e7] succeeded in 1.2802595180000935s: None 2024-04-06T00:33:02.781506063Z [2024-04-06 00:33:02,781: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T00:33:02.785134115Z [2024-04-06 00:33:02,784: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:33:02.801088852Z [2024-04-06 00:33:02,800: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T00:33:02.804634366Z [2024-04-06 00:33:02,804: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:33:02.812008953Z [2024-04-06 00:33:02,811: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T00:33:02.813398260Z [2024-04-06 00:33:02,813: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:33:02.813411495Z [2024-04-06 00:33:02,813: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:33:02.813693487Z [2024-04-06 00:33:02,813: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:33:02.813717275Z [2024-04-06 00:33:02,813: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T00:33:02.813977254Z [2024-04-06 00:33:02,813: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T00:33:02.813990104Z [2024-04-06 00:33:02,813: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:33:02.824823307Z [2024-04-06 00:33:02,824: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T00:33:02.826145337Z [2024-04-06 00:33:02,825: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:33:02.826173570Z [2024-04-06 00:33:02,826: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:33:02.826376736Z [2024-04-06 00:33:02,826: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:33:02.826400278Z [2024-04-06 00:33:02,826: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T00:33:02.826741252Z [2024-04-06 00:33:02,826: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T00:33:02.826749008Z [2024-04-06 00:33:02,826: INFO/ForkPoolWorker-1] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:33:02.908471196Z [2024-04-06 00:33:02,908: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:33:02.917313819Z [2024-04-06 00:33:02,917: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:33:04.501178101Z [2024-04-06 00:33:04,500: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f9a1e546-2fcc-4f71-b5b4-d61dd25a2292] succeeded in 3.284022775000267s: None 2024-04-06T00:33:04.799102559Z [2024-04-06 00:33:04,798: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8fca991b-a71a-4c8a-9a56-e59be0cf38d6] succeeded in 3.615324325000074s: None 2024-04-06T00:34:00.587696277Z [2024-04-06 00:34:00,586: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e5003575-dc3b-48eb-a3c6-8082448ba276] received 2024-04-06T00:34:00.591231491Z [2024-04-06 00:34:00,591: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[723ab0b1-655b-44a0-9e47-afcdeb78f32f] received 2024-04-06T00:34:00.595417852Z [2024-04-06 00:34:00,595: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[206826b9-360d-4106-9c7a-a64d1682280f] received 2024-04-06T00:34:00.598695381Z [2024-04-06 00:34:00,598: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[89f116bd-5ea5-4cd1-8e28-25b30613a4e4] received 2024-04-06T00:34:00.606715017Z [2024-04-06 00:34:00,606: INFO/ForkPoolWorker-15] [e5003575-dc3b-48eb-a3c6-8082448ba276] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T00:34:00.610791751Z [2024-04-06 00:34:00,610: INFO/ForkPoolWorker-16] [723ab0b1-655b-44a0-9e47-afcdeb78f32f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T00:34:00.618861521Z [2024-04-06 00:34:00,618: INFO/ForkPoolWorker-2] [89f116bd-5ea5-4cd1-8e28-25b30613a4e4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T00:34:00.621189951Z [2024-04-06 00:34:00,620: INFO/ForkPoolWorker-1] [206826b9-360d-4106-9c7a-a64d1682280f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T00:34:00.960201962Z [2024-04-06 00:34:00,956: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T00:34:01.002007350Z [2024-04-06 00:34:00,993: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T00:34:01.141888527Z [2024-04-06 00:34:01,134: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T00:34:01.355012090Z [2024-04-06 00:34:01,354: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-06T00:34:01.359069888Z [2024-04-06 00:34:01,358: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:34:01.381497884Z [2024-04-06 00:34:01,372: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T00:34:01.383077985Z [2024-04-06 00:34:01,382: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T00:34:01.384235237Z [2024-04-06 00:34:01,383: INFO/ForkPoolWorker-16] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T00:34:01.384350837Z [2024-04-06 00:34:01,384: INFO/ForkPoolWorker-16] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T00:34:01.384426013Z [2024-04-06 00:34:01,384: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-06T00:34:01.384666090Z [2024-04-06 00:34:01,384: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T00:34:01.484886854Z [2024-04-06 00:34:01,484: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:34:01.486167504Z [2024-04-06 00:34:01,485: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:34:02.156116599Z [2024-04-06 00:34:02,155: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e5003575-dc3b-48eb-a3c6-8082448ba276] succeeded in 1.5649204439996538s: None 2024-04-06T00:34:02.281953845Z [2024-04-06 00:34:02,281: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[723ab0b1-655b-44a0-9e47-afcdeb78f32f] succeeded in 1.688240759999644s: None 2024-04-06T00:34:02.735092716Z [2024-04-06 00:34:02,734: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T00:34:02.738487134Z [2024-04-06 00:34:02,738: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:34:02.760782863Z [2024-04-06 00:34:02,760: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T00:34:02.761989314Z [2024-04-06 00:34:02,761: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:34:02.762009553Z [2024-04-06 00:34:02,761: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:34:02.762224641Z [2024-04-06 00:34:02,762: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:34:02.762381505Z [2024-04-06 00:34:02,762: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T00:34:02.762750387Z [2024-04-06 00:34:02,762: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-06T00:34:02.762875225Z [2024-04-06 00:34:02,762: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:34:02.852399612Z [2024-04-06 00:34:02,852: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:34:02.919852532Z [2024-04-06 00:34:02,919: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-06T00:34:02.924301875Z [2024-04-06 00:34:02,923: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:34:02.951906957Z [2024-04-06 00:34:02,951: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T00:34:02.954592734Z [2024-04-06 00:34:02,954: INFO/ForkPoolWorker-2] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:34:02.954809920Z [2024-04-06 00:34:02,954: INFO/ForkPoolWorker-2] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:34:02.955134494Z [2024-04-06 00:34:02,954: INFO/ForkPoolWorker-2] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:34:02.955370562Z [2024-04-06 00:34:02,955: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-06T00:34:02.955838136Z [2024-04-06 00:34:02,955: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T00:34:02.956061403Z [2024-04-06 00:34:02,955: INFO/ForkPoolWorker-2] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:34:03.038094643Z [2024-04-06 00:34:03,037: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:34:04.719478309Z [2024-04-06 00:34:04,716: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[89f116bd-5ea5-4cd1-8e28-25b30613a4e4] succeeded in 4.116035544000624s: None 2024-04-06T00:34:05.041005004Z [2024-04-06 00:34:05,040: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[206826b9-360d-4106-9c7a-a64d1682280f] succeeded in 4.442994584999724s: None 2024-04-06T00:35:01.101048716Z [2024-04-06 00:35:01,100: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[af65276e-bb58-40fb-b52e-ac6b1b5caf9f] received 2024-04-06T00:35:01.104153960Z [2024-04-06 00:35:01,103: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e2181128-8ed0-40e9-b9d1-04f3bfd81a24] received 2024-04-06T00:35:01.114175903Z [2024-04-06 00:35:01,113: INFO/ForkPoolWorker-16] [e2181128-8ed0-40e9-b9d1-04f3bfd81a24] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T00:35:01.116289974Z [2024-04-06 00:35:01,115: INFO/ForkPoolWorker-15] [af65276e-bb58-40fb-b52e-ac6b1b5caf9f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T00:35:01.132107092Z [2024-04-06 00:35:01,131: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6f4fa914-e4c9-45b8-9275-d256fc24e2f0] received 2024-04-06T00:35:01.133651311Z [2024-04-06 00:35:01,133: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b0d471f2-56d4-430c-8c44-6a88edcab746] received 2024-04-06T00:35:01.139430687Z [2024-04-06 00:35:01,139: INFO/ForkPoolWorker-1] [6f4fa914-e4c9-45b8-9275-d256fc24e2f0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T00:35:01.143740971Z [2024-04-06 00:35:01,143: INFO/ForkPoolWorker-2] [b0d471f2-56d4-430c-8c44-6a88edcab746] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T00:35:01.433483897Z [2024-04-06 00:35:01,429: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T00:35:01.454640527Z [2024-04-06 00:35:01,451: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T00:35:01.497398878Z [2024-04-06 00:35:01,493: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T00:35:01.502329515Z [2024-04-06 00:35:01,498: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T00:35:01.699087283Z [2024-04-06 00:35:01,698: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-06T00:35:01.703139858Z [2024-04-06 00:35:01,702: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:35:01.739681535Z [2024-04-06 00:35:01,739: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T00:35:01.744402906Z [2024-04-06 00:35:01,744: INFO/ForkPoolWorker-16] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T00:35:01.744538988Z [2024-04-06 00:35:01,744: INFO/ForkPoolWorker-16] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T00:35:01.744613912Z [2024-04-06 00:35:01,744: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-06T00:35:01.744888354Z [2024-04-06 00:35:01,744: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T00:35:01.879023579Z [2024-04-06 00:35:01,878: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:35:02.554936292Z [2024-04-06 00:35:02,554: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e2181128-8ed0-40e9-b9d1-04f3bfd81a24] succeeded in 1.4483604119996016s: None 2024-04-06T00:35:02.894991341Z [2024-04-06 00:35:02,894: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-06T00:35:02.898542037Z [2024-04-06 00:35:02,898: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:35:02.949254886Z [2024-04-06 00:35:02,948: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T00:35:02.951759921Z [2024-04-06 00:35:02,951: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T00:35:02.952291304Z [2024-04-06 00:35:02,952: INFO/ForkPoolWorker-2] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:35:02.952301417Z [2024-04-06 00:35:02,952: INFO/ForkPoolWorker-2] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:35:02.952441581Z [2024-04-06 00:35:02,952: INFO/ForkPoolWorker-2] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:35:02.952450447Z [2024-04-06 00:35:02,952: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-06T00:35:02.952715795Z [2024-04-06 00:35:02,952: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-06T00:35:02.952724150Z [2024-04-06 00:35:02,952: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:35:02.955385347Z [2024-04-06 00:35:02,954: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:35:02.988642116Z [2024-04-06 00:35:02,988: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T00:35:02.991717106Z [2024-04-06 00:35:02,991: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:35:02.991729807Z [2024-04-06 00:35:02,991: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:35:02.991871932Z [2024-04-06 00:35:02,991: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:35:02.991878375Z [2024-04-06 00:35:02,991: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T00:35:02.992104967Z [2024-04-06 00:35:02,992: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T00:35:02.992161182Z [2024-04-06 00:35:02,992: INFO/ForkPoolWorker-1] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:35:03.067691638Z [2024-04-06 00:35:03,067: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T00:35:03.074966392Z [2024-04-06 00:35:03,074: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:35:03.078652664Z [2024-04-06 00:35:03,078: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:35:03.081950456Z [2024-04-06 00:35:03,081: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:35:03.115244685Z [2024-04-06 00:35:03,114: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T00:35:03.116708896Z [2024-04-06 00:35:03,116: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:35:03.119207573Z [2024-04-06 00:35:03,116: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:35:03.119452415Z [2024-04-06 00:35:03,119: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:35:03.119670472Z [2024-04-06 00:35:03,119: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T00:35:03.120266857Z [2024-04-06 00:35:03,119: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T00:35:03.120440058Z [2024-04-06 00:35:03,120: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:35:03.240453977Z [2024-04-06 00:35:03,240: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:35:03.864644614Z [2024-04-06 00:35:03,864: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[af65276e-bb58-40fb-b52e-ac6b1b5caf9f] succeeded in 2.7589549439999246s: None 2024-04-06T00:35:03.949912068Z [2024-04-06 00:35:03,949: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[db2bd527-f19c-47a1-a91a-b073819aad10] received 2024-04-06T00:35:03.959118937Z [2024-04-06 00:35:03,958: INFO/ForkPoolWorker-15] [db2bd527-f19c-47a1-a91a-b073819aad10] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'split_metrics', 'scheduled__2024-04-06T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T00:35:04.301319092Z [2024-04-06 00:35:04,297: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T00:35:04.700147340Z [2024-04-06 00:35:04,699: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6f4fa914-e4c9-45b8-9275-d256fc24e2f0] succeeded in 3.5663099679995867s: None 2024-04-06T00:35:04.957657923Z [2024-04-06 00:35:04,957: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b0d471f2-56d4-430c-8c44-6a88edcab746] succeeded in 3.8206073989995275s: None 2024-04-06T00:35:05.714386796Z [2024-04-06 00:35:05,713: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T00:35:05.717645938Z [2024-04-06 00:35:05,717: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:35:05.740278915Z [2024-04-06 00:35:05,740: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T00:35:05.741653210Z [2024-04-06 00:35:05,741: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:35:05.741673000Z [2024-04-06 00:35:05,741: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:35:05.741820040Z [2024-04-06 00:35:05,741: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:35:05.741853071Z [2024-04-06 00:35:05,741: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T00:35:05.742212507Z [2024-04-06 00:35:05,741: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T00:35:05.742223758Z [2024-04-06 00:35:05,742: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:35:05.823036351Z [2024-04-06 00:35:05,822: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:35:06.419477670Z [2024-04-06 00:35:06,419: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[db2bd527-f19c-47a1-a91a-b073819aad10] succeeded in 2.468421118999686s: None 2024-04-06T00:35:07.193450713Z [2024-04-06 00:35:07,193: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9feb3897-bb1a-4546-a61b-a2211c8b34fe] received 2024-04-06T00:35:07.202619542Z [2024-04-06 00:35:07,202: INFO/ForkPoolWorker-15] [9feb3897-bb1a-4546-a61b-a2211c8b34fe] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'collect_metrics', 'scheduled__2024-04-06T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T00:35:07.500243531Z [2024-04-06 00:35:07,496: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T00:35:08.685611934Z [2024-04-06 00:35:08,685: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T00:35:08.688993167Z [2024-04-06 00:35:08,688: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:35:08.705075222Z [2024-04-06 00:35:08,704: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T00:35:08.706231767Z [2024-04-06 00:35:08,706: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:35:08.706277066Z [2024-04-06 00:35:08,706: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:35:08.706403803Z [2024-04-06 00:35:08,706: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:35:08.706442633Z [2024-04-06 00:35:08,706: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T00:35:08.706646317Z [2024-04-06 00:35:08,706: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T00:35:08.706687202Z [2024-04-06 00:35:08,706: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:35:08.791394316Z [2024-04-06 00:35:08,790: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:35:09.368905104Z [2024-04-06 00:35:09,368: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9feb3897-bb1a-4546-a61b-a2211c8b34fe] succeeded in 2.173656843000572s: None 2024-04-06T00:35:09.883962545Z [2024-04-06 00:35:09,883: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cd856f91-844d-4e5c-a821-fc26e2295c5a] received 2024-04-06T00:35:09.895539664Z [2024-04-06 00:35:09,895: INFO/ForkPoolWorker-15] [cd856f91-844d-4e5c-a821-fc26e2295c5a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'send_prometheus', 'scheduled__2024-04-06T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T00:35:10.183616060Z [2024-04-06 00:35:10,180: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T00:35:11.178630161Z [2024-04-06 00:35:11,178: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T00:35:11.181625209Z [2024-04-06 00:35:11,181: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:35:11.216028709Z [2024-04-06 00:35:11,215: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T00:35:11.223990488Z [2024-04-06 00:35:11,223: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:35:11.224043412Z [2024-04-06 00:35:11,223: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:35:11.224064433Z [2024-04-06 00:35:11,223: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:35:11.224072242Z [2024-04-06 00:35:11,223: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T00:35:11.224313588Z [2024-04-06 00:35:11,224: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T00:35:11.224325894Z [2024-04-06 00:35:11,224: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:35:11.305401575Z [2024-04-06 00:35:11,304: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:35:11.937564552Z [2024-04-06 00:35:11,937: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cd856f91-844d-4e5c-a821-fc26e2295c5a] succeeded in 2.051090017000206s: None 2024-04-06T00:36:00.469604126Z [2024-04-06 00:36:00,469: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[afcf3372-d42f-4520-b6c2-9bf523147fbf] received 2024-04-06T00:36:00.475824487Z [2024-04-06 00:36:00,475: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ad90e9b0-d943-4d6b-9db0-c3d2c7a80f1b] received 2024-04-06T00:36:00.484129722Z [2024-04-06 00:36:00,483: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[68222ab3-734c-472f-88c8-755c6365239e] received 2024-04-06T00:36:00.487970307Z [2024-04-06 00:36:00,487: INFO/ForkPoolWorker-15] [afcf3372-d42f-4520-b6c2-9bf523147fbf] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T00:36:00.488353079Z [2024-04-06 00:36:00,488: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bb5d9b01-5d43-4f85-90cf-ee4cc76ade67] received 2024-04-06T00:36:00.500129987Z [2024-04-06 00:36:00,499: INFO/ForkPoolWorker-2] [bb5d9b01-5d43-4f85-90cf-ee4cc76ade67] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T00:36:00.501656068Z [2024-04-06 00:36:00,501: INFO/ForkPoolWorker-16] [ad90e9b0-d943-4d6b-9db0-c3d2c7a80f1b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T00:36:00.506450329Z [2024-04-06 00:36:00,506: INFO/ForkPoolWorker-1] [68222ab3-734c-472f-88c8-755c6365239e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T00:36:00.773367587Z [2024-04-06 00:36:00,770: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T00:36:00.778398569Z [2024-04-06 00:36:00,774: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T00:36:00.852223801Z [2024-04-06 00:36:00,847: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T00:36:00.931715993Z [2024-04-06 00:36:00,928: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T00:36:01.141924437Z [2024-04-06 00:36:01,141: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:36:01.169652437Z [2024-04-06 00:36:01,169: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-06T00:36:01.174372618Z [2024-04-06 00:36:01,173: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:36:01.212543447Z [2024-04-06 00:36:01,212: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T00:36:01.215074121Z [2024-04-06 00:36:01,214: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T00:36:01.215152189Z [2024-04-06 00:36:01,214: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T00:36:01.215275854Z [2024-04-06 00:36:01,215: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-06T00:36:01.216566449Z [2024-04-06 00:36:01,215: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T00:36:01.325091581Z [2024-04-06 00:36:01,324: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:36:01.764612572Z [2024-04-06 00:36:01,764: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[afcf3372-d42f-4520-b6c2-9bf523147fbf] succeeded in 1.2919998919996942s: None 2024-04-06T00:36:01.967034728Z [2024-04-06 00:36:01,966: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[68222ab3-734c-472f-88c8-755c6365239e] succeeded in 1.4809310069995263s: None 2024-04-06T00:36:02.276689939Z [2024-04-06 00:36:02,276: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T00:36:02.279776494Z [2024-04-06 00:36:02,279: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:36:02.302399429Z [2024-04-06 00:36:02,302: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T00:36:02.303926800Z [2024-04-06 00:36:02,303: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:36:02.303943691Z [2024-04-06 00:36:02,303: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:36:02.304064819Z [2024-04-06 00:36:02,303: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:36:02.304082624Z [2024-04-06 00:36:02,303: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T00:36:02.304863236Z [2024-04-06 00:36:02,304: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T00:36:02.304939098Z [2024-04-06 00:36:02,304: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:36:02.333528251Z [2024-04-06 00:36:02,333: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-06T00:36:02.337153297Z [2024-04-06 00:36:02,336: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:36:02.380933681Z [2024-04-06 00:36:02,380: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T00:36:02.384534757Z [2024-04-06 00:36:02,384: INFO/ForkPoolWorker-2] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:36:02.384558372Z [2024-04-06 00:36:02,384: INFO/ForkPoolWorker-2] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:36:02.384863453Z [2024-04-06 00:36:02,384: INFO/ForkPoolWorker-2] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:36:02.384950611Z [2024-04-06 00:36:02,384: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-06T00:36:02.385379018Z [2024-04-06 00:36:02,385: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-06T00:36:02.385482568Z [2024-04-06 00:36:02,385: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:36:02.398870331Z [2024-04-06 00:36:02,398: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:36:02.499640685Z [2024-04-06 00:36:02,499: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:36:03.974532464Z [2024-04-06 00:36:03,973: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ad90e9b0-d943-4d6b-9db0-c3d2c7a80f1b] succeeded in 3.495775522999793s: None 2024-04-06T00:36:05.078936561Z [2024-04-06 00:36:05,078: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[bb5d9b01-5d43-4f85-90cf-ee4cc76ade67] succeeded in 4.587269403999926s: None 2024-04-06T00:37:01.027292927Z [2024-04-06 00:37:01,026: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fff2bce8-9b2b-492d-92bc-61bb41429870] received 2024-04-06T00:37:01.031917576Z [2024-04-06 00:37:01,031: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ae8580ae-433d-40de-b82f-8ff2cef8d91e] received 2024-04-06T00:37:01.033864320Z [2024-04-06 00:37:01,033: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3a4c6b35-3465-423c-90ed-854dee54cfc0] received 2024-04-06T00:37:01.041561037Z [2024-04-06 00:37:01,041: INFO/ForkPoolWorker-15] [fff2bce8-9b2b-492d-92bc-61bb41429870] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T00:37:01.046196258Z [2024-04-06 00:37:01,045: INFO/ForkPoolWorker-16] [ae8580ae-433d-40de-b82f-8ff2cef8d91e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T00:37:01.051231855Z [2024-04-06 00:37:01,050: INFO/ForkPoolWorker-1] [3a4c6b35-3465-423c-90ed-854dee54cfc0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T00:37:01.378177938Z [2024-04-06 00:37:01,374: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T00:37:01.406454682Z [2024-04-06 00:37:01,402: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T00:37:01.407137622Z [2024-04-06 00:37:01,403: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T00:37:01.574285149Z [2024-04-06 00:37:01,573: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-06T00:37:01.578390690Z [2024-04-06 00:37:01,577: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:37:01.606567959Z [2024-04-06 00:37:01,606: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T00:37:01.608068079Z [2024-04-06 00:37:01,607: INFO/ForkPoolWorker-16] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T00:37:01.608295823Z [2024-04-06 00:37:01,608: INFO/ForkPoolWorker-16] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T00:37:01.608445621Z [2024-04-06 00:37:01,608: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-06T00:37:01.608860616Z [2024-04-06 00:37:01,608: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T00:37:01.700782772Z [2024-04-06 00:37:01,700: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:37:02.336747980Z [2024-04-06 00:37:02,336: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ae8580ae-433d-40de-b82f-8ff2cef8d91e] succeeded in 1.3021721650002291s: None 2024-04-06T00:37:02.682409452Z [2024-04-06 00:37:02,681: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T00:37:02.685700933Z [2024-04-06 00:37:02,685: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:37:02.708436659Z [2024-04-06 00:37:02,708: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T00:37:02.712220575Z [2024-04-06 00:37:02,711: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:37:02.723709780Z [2024-04-06 00:37:02,723: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T00:37:02.725354323Z [2024-04-06 00:37:02,725: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:37:02.725488606Z [2024-04-06 00:37:02,725: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:37:02.725660789Z [2024-04-06 00:37:02,725: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:37:02.725729678Z [2024-04-06 00:37:02,725: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T00:37:02.726055914Z [2024-04-06 00:37:02,725: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-06T00:37:02.726136865Z [2024-04-06 00:37:02,726: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:37:02.739129740Z [2024-04-06 00:37:02,738: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T00:37:02.741279562Z [2024-04-06 00:37:02,741: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:37:02.741392295Z [2024-04-06 00:37:02,741: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:37:02.741643136Z [2024-04-06 00:37:02,741: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:37:02.741746714Z [2024-04-06 00:37:02,741: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T00:37:02.742035199Z [2024-04-06 00:37:02,741: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T00:37:02.742150131Z [2024-04-06 00:37:02,742: INFO/ForkPoolWorker-15] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:37:02.822984543Z [2024-04-06 00:37:02,822: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:37:02.841182224Z [2024-04-06 00:37:02,840: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:37:04.657948005Z [2024-04-06 00:37:04,657: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fff2bce8-9b2b-492d-92bc-61bb41429870] succeeded in 3.6280482490001305s: None 2024-04-06T00:37:05.363388839Z [2024-04-06 00:37:05,362: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3a4c6b35-3465-423c-90ed-854dee54cfc0] succeeded in 4.326675145000081s: None 2024-04-06T00:38:00.362630537Z [2024-04-06 00:38:00,361: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bc0df4e0-47a5-4b5f-869d-0630ce1c83fb] received 2024-04-06T00:38:00.365792481Z [2024-04-06 00:38:00,365: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fa760135-603e-4d72-94d9-310212a2ca33] received 2024-04-06T00:38:00.372873372Z [2024-04-06 00:38:00,372: INFO/ForkPoolWorker-15] [bc0df4e0-47a5-4b5f-869d-0630ce1c83fb] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T00:38:00.380390215Z [2024-04-06 00:38:00,380: INFO/ForkPoolWorker-16] [fa760135-603e-4d72-94d9-310212a2ca33] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T00:38:00.390844875Z [2024-04-06 00:38:00,390: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f3015f94-c247-4ca0-a18c-f76da909cc1f] received 2024-04-06T00:38:00.395189606Z [2024-04-06 00:38:00,394: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c4b474ef-8771-4f4e-8649-2803c17aaf84] received 2024-04-06T00:38:00.406618773Z [2024-04-06 00:38:00,406: INFO/ForkPoolWorker-1] [f3015f94-c247-4ca0-a18c-f76da909cc1f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T00:38:00.411308224Z [2024-04-06 00:38:00,410: INFO/ForkPoolWorker-2] [c4b474ef-8771-4f4e-8649-2803c17aaf84] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T00:38:00.709529642Z [2024-04-06 00:38:00,706: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T00:38:00.719326111Z [2024-04-06 00:38:00,712: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T00:38:00.785443769Z [2024-04-06 00:38:00,781: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T00:38:00.837769441Z [2024-04-06 00:38:00,834: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T00:38:00.980501663Z [2024-04-06 00:38:00,980: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-06T00:38:00.985394265Z [2024-04-06 00:38:00,984: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:38:01.000060266Z [2024-04-06 00:38:00,999: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:38:01.020358644Z [2024-04-06 00:38:01,020: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T00:38:01.023139624Z [2024-04-06 00:38:01,022: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T00:38:01.023163055Z [2024-04-06 00:38:01,023: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T00:38:01.023209375Z [2024-04-06 00:38:01,023: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-06T00:38:01.023522258Z [2024-04-06 00:38:01,023: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T00:38:01.136921794Z [2024-04-06 00:38:01,136: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:38:01.585732311Z [2024-04-06 00:38:01,585: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bc0df4e0-47a5-4b5f-869d-0630ce1c83fb] succeeded in 1.2182499319987983s: None 2024-04-06T00:38:01.765699278Z [2024-04-06 00:38:01,765: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f3015f94-c247-4ca0-a18c-f76da909cc1f] succeeded in 1.3721746089995577s: None 2024-04-06T00:38:02.152171773Z [2024-04-06 00:38:02,151: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T00:38:02.155637291Z [2024-04-06 00:38:02,154: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:38:02.174234150Z [2024-04-06 00:38:02,173: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T00:38:02.176011778Z [2024-04-06 00:38:02,175: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:38:02.176062349Z [2024-04-06 00:38:02,175: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:38:02.176167109Z [2024-04-06 00:38:02,175: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:38:02.176195005Z [2024-04-06 00:38:02,176: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T00:38:02.176437473Z [2024-04-06 00:38:02,176: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T00:38:02.176455706Z [2024-04-06 00:38:02,176: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:38:02.216372495Z [2024-04-06 00:38:02,215: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-06T00:38:02.223446335Z [2024-04-06 00:38:02,219: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:38:02.252016849Z [2024-04-06 00:38:02,251: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T00:38:02.256039633Z [2024-04-06 00:38:02,255: INFO/ForkPoolWorker-2] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:38:02.259755057Z [2024-04-06 00:38:02,255: INFO/ForkPoolWorker-2] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:38:02.259778543Z [2024-04-06 00:38:02,258: INFO/ForkPoolWorker-2] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:38:02.259794848Z [2024-04-06 00:38:02,258: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-06T00:38:02.260117306Z [2024-04-06 00:38:02,259: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T00:38:02.260264804Z [2024-04-06 00:38:02,260: INFO/ForkPoolWorker-2] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:38:02.314142134Z [2024-04-06 00:38:02,313: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:38:02.374355283Z [2024-04-06 00:38:02,374: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:38:03.833702039Z [2024-04-06 00:38:03,832: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[c4b474ef-8771-4f4e-8649-2803c17aaf84] succeeded in 3.4294886009993206s: None 2024-04-06T00:38:04.202773526Z [2024-04-06 00:38:04,202: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[fa760135-603e-4d72-94d9-310212a2ca33] succeeded in 3.833791820999977s: None 2024-04-06T00:39:00.367332358Z [2024-04-06 00:39:00,366: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bc1f8e5a-cd0e-426d-b6e9-c2b7ea379ca2] received 2024-04-06T00:39:00.369010739Z [2024-04-06 00:39:00,368: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[232241a2-a587-44c4-a8fd-c27edfec3eb9] received 2024-04-06T00:39:00.372956846Z [2024-04-06 00:39:00,372: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1a0fbdd8-0073-40c2-9269-3ed6031ca953] received 2024-04-06T00:39:00.382463072Z [2024-04-06 00:39:00,382: INFO/ForkPoolWorker-16] [232241a2-a587-44c4-a8fd-c27edfec3eb9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T00:39:00.382676066Z [2024-04-06 00:39:00,382: INFO/ForkPoolWorker-1] [1a0fbdd8-0073-40c2-9269-3ed6031ca953] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T00:39:00.384014557Z [2024-04-06 00:39:00,383: INFO/ForkPoolWorker-15] [bc1f8e5a-cd0e-426d-b6e9-c2b7ea379ca2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T00:39:00.636823779Z [2024-04-06 00:39:00,633: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T00:39:00.649735191Z [2024-04-06 00:39:00,646: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T00:39:00.656955854Z [2024-04-06 00:39:00,653: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T00:39:00.810053548Z [2024-04-06 00:39:00,809: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-06T00:39:00.815111790Z [2024-04-06 00:39:00,814: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:39:00.843739030Z [2024-04-06 00:39:00,843: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T00:39:00.845424178Z [2024-04-06 00:39:00,845: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T00:39:00.846989308Z [2024-04-06 00:39:00,846: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T00:39:00.847087324Z [2024-04-06 00:39:00,846: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-06T00:39:00.847461349Z [2024-04-06 00:39:00,847: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T00:39:00.936777043Z [2024-04-06 00:39:00,936: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:39:01.593766205Z [2024-04-06 00:39:01,593: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1a0fbdd8-0073-40c2-9269-3ed6031ca953] succeeded in 1.2174855549983477s: None 2024-04-06T00:39:01.833988925Z [2024-04-06 00:39:01,833: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T00:39:01.837268495Z [2024-04-06 00:39:01,836: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:39:01.860304026Z [2024-04-06 00:39:01,860: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T00:39:01.861821430Z [2024-04-06 00:39:01,861: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:39:01.861845556Z [2024-04-06 00:39:01,861: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:39:01.862009017Z [2024-04-06 00:39:01,861: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:39:01.862139561Z [2024-04-06 00:39:01,861: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T00:39:01.862486120Z [2024-04-06 00:39:01,862: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T00:39:01.862640733Z [2024-04-06 00:39:01,862: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:39:01.864160572Z [2024-04-06 00:39:01,863: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T00:39:01.867619391Z [2024-04-06 00:39:01,867: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:39:01.891814618Z [2024-04-06 00:39:01,891: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T00:39:01.894449599Z [2024-04-06 00:39:01,894: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:39:01.894551320Z [2024-04-06 00:39:01,894: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:39:01.894642554Z [2024-04-06 00:39:01,894: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:39:01.894663997Z [2024-04-06 00:39:01,894: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T00:39:01.894827959Z [2024-04-06 00:39:01,894: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T00:39:01.894844320Z [2024-04-06 00:39:01,894: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:39:01.965714610Z [2024-04-06 00:39:01,965: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:39:01.998626765Z [2024-04-06 00:39:01,998: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:39:03.528249463Z [2024-04-06 00:39:03,527: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[232241a2-a587-44c4-a8fd-c27edfec3eb9] succeeded in 3.1555661450001935s: None 2024-04-06T00:39:03.847770882Z [2024-04-06 00:39:03,847: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bc1f8e5a-cd0e-426d-b6e9-c2b7ea379ca2] succeeded in 3.477134376000322s: None 2024-04-06T00:40:00.271597721Z [2024-04-06 00:40:00,271: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[20464adc-8605-4018-8544-094380035968] received 2024-04-06T00:40:00.273732930Z [2024-04-06 00:40:00,273: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1d0abc6a-6f7a-4728-b695-047cb7e05853] received 2024-04-06T00:40:00.275415330Z [2024-04-06 00:40:00,275: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[004d2bb7-2708-4eb9-b11c-c52f2f51a7ea] received 2024-04-06T00:40:00.279594124Z [2024-04-06 00:40:00,279: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[229755a3-c39b-493f-a71e-a8e47bcf181b] received 2024-04-06T00:40:00.282182611Z [2024-04-06 00:40:00,282: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1ed3d72a-30ac-4d3b-838e-05b695aa0a3f] received 2024-04-06T00:40:00.283628223Z [2024-04-06 00:40:00,283: INFO/ForkPoolWorker-15] [20464adc-8605-4018-8544-094380035968] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T00:40:00.292244579Z [2024-04-06 00:40:00,291: INFO/ForkPoolWorker-2] [229755a3-c39b-493f-a71e-a8e47bcf181b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T00:40:00.297648626Z [2024-04-06 00:40:00,297: INFO/ForkPoolWorker-1] [004d2bb7-2708-4eb9-b11c-c52f2f51a7ea] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T00:40:00.297881829Z [2024-04-06 00:40:00,297: INFO/ForkPoolWorker-3] [1ed3d72a-30ac-4d3b-838e-05b695aa0a3f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T00:40:00.298052759Z [2024-04-06 00:40:00,297: INFO/ForkPoolWorker-16] [1d0abc6a-6f7a-4728-b695-047cb7e05853] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T00:40:00.622386343Z [2024-04-06 00:40:00,619: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T00:40:00.634671344Z [2024-04-06 00:40:00,630: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T00:40:00.682375739Z [2024-04-06 00:40:00,678: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T00:40:00.797150606Z [2024-04-06 00:40:00,793: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T00:40:00.848510444Z [2024-04-06 00:40:00,839: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T00:40:00.924788472Z [2024-04-06 00:40:00,924: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:40:01.047218911Z [2024-04-06 00:40:01,046: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-06T00:40:01.055944808Z [2024-04-06 00:40:01,055: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:40:01.123516392Z [2024-04-06 00:40:01,123: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T00:40:01.128519996Z [2024-04-06 00:40:01,127: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T00:40:01.129188536Z [2024-04-06 00:40:01,128: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T00:40:01.129281022Z [2024-04-06 00:40:01,129: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-06T00:40:01.129536549Z [2024-04-06 00:40:01,129: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T00:40:01.446732788Z [2024-04-06 00:40:01,446: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:40:01.994603465Z [2024-04-06 00:40:01,994: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1d0abc6a-6f7a-4728-b695-047cb7e05853] succeeded in 1.7193642420006654s: None 2024-04-06T00:40:02.205233076Z [2024-04-06 00:40:02,204: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T00:40:02.210560114Z [2024-04-06 00:40:02,210: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:40:02.256518677Z [2024-04-06 00:40:02,256: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T00:40:02.259004264Z [2024-04-06 00:40:02,258: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:40:02.259307536Z [2024-04-06 00:40:02,258: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:40:02.259607444Z [2024-04-06 00:40:02,259: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:40:02.259821148Z [2024-04-06 00:40:02,259: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T00:40:02.260518500Z [2024-04-06 00:40:02,260: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T00:40:02.260710649Z [2024-04-06 00:40:02,260: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:40:02.390281133Z [2024-04-06 00:40:02,389: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:40:02.405045192Z [2024-04-06 00:40:02,404: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-06T00:40:02.410573350Z [2024-04-06 00:40:02,410: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:40:02.465541786Z [2024-04-06 00:40:02,465: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T00:40:02.469184924Z [2024-04-06 00:40:02,468: INFO/ForkPoolWorker-2] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:40:02.469232670Z [2024-04-06 00:40:02,469: INFO/ForkPoolWorker-2] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:40:02.469349727Z [2024-04-06 00:40:02,469: INFO/ForkPoolWorker-2] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:40:02.469450022Z [2024-04-06 00:40:02,469: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-06T00:40:02.469860807Z [2024-04-06 00:40:02,469: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-06T00:40:02.469978853Z [2024-04-06 00:40:02,469: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:40:02.497258272Z [2024-04-06 00:40:02,495: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[004d2bb7-2708-4eb9-b11c-c52f2f51a7ea] succeeded in 2.218592422999791s: None 2024-04-06T00:40:02.554406666Z [2024-04-06 00:40:02,553: INFO/ForkPoolWorker-3] Getting VIM list 2024-04-06T00:40:02.557802061Z [2024-04-06 00:40:02,557: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:40:02.581432343Z [2024-04-06 00:40:02,581: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-06T00:40:02.582757934Z [2024-04-06 00:40:02,582: INFO/ForkPoolWorker-3] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:40:02.582781078Z [2024-04-06 00:40:02,582: INFO/ForkPoolWorker-3] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:40:02.583169395Z [2024-04-06 00:40:02,582: INFO/ForkPoolWorker-3] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:40:02.583223081Z [2024-04-06 00:40:02,582: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-04-06T00:40:02.583446716Z [2024-04-06 00:40:02,583: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T00:40:02.583463196Z [2024-04-06 00:40:02,583: INFO/ForkPoolWorker-3] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:40:02.594723341Z [2024-04-06 00:40:02,594: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:40:02.707670362Z [2024-04-06 00:40:02,707: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:40:03.082481267Z [2024-04-06 00:40:03,082: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[20464adc-8605-4018-8544-094380035968] succeeded in 2.8086143210002774s: None 2024-04-06T00:40:04.114940189Z [2024-04-06 00:40:04,114: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c75df6df-ebe2-42a1-902b-2e4696037f68] received 2024-04-06T00:40:04.129538598Z [2024-04-06 00:40:04,129: INFO/ForkPoolWorker-15] [c75df6df-ebe2-42a1-902b-2e4696037f68] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'split_metrics', 'scheduled__2024-04-06T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T00:40:04.252537261Z [2024-04-06 00:40:04,251: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[1ed3d72a-30ac-4d3b-838e-05b695aa0a3f] succeeded in 3.967053862001194s: None 2024-04-06T00:40:04.470877971Z [2024-04-06 00:40:04,461: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T00:40:04.661716995Z [2024-04-06 00:40:04,661: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[229755a3-c39b-493f-a71e-a8e47bcf181b] succeeded in 4.380347514999812s: None 2024-04-06T00:40:05.702721024Z [2024-04-06 00:40:05,702: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T00:40:05.705830415Z [2024-04-06 00:40:05,705: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:40:05.739089883Z [2024-04-06 00:40:05,738: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T00:40:05.741724807Z [2024-04-06 00:40:05,741: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:40:05.742008274Z [2024-04-06 00:40:05,741: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:40:05.742332577Z [2024-04-06 00:40:05,742: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:40:05.742580484Z [2024-04-06 00:40:05,742: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T00:40:05.743126047Z [2024-04-06 00:40:05,742: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T00:40:05.743389377Z [2024-04-06 00:40:05,743: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:40:05.834478417Z [2024-04-06 00:40:05,834: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:40:06.545479036Z [2024-04-06 00:40:06,544: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c75df6df-ebe2-42a1-902b-2e4696037f68] succeeded in 2.4255250950009213s: None 2024-04-06T00:40:07.562381273Z [2024-04-06 00:40:07,560: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3b5290af-d10e-44f5-8b62-add3a52c7170] received 2024-04-06T00:40:07.569292073Z [2024-04-06 00:40:07,569: INFO/ForkPoolWorker-15] [3b5290af-d10e-44f5-8b62-add3a52c7170] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'collect_metrics', 'scheduled__2024-04-06T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T00:40:07.834949732Z [2024-04-06 00:40:07,831: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T00:40:08.920273385Z [2024-04-06 00:40:08,919: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T00:40:08.923306477Z [2024-04-06 00:40:08,922: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:40:08.946428478Z [2024-04-06 00:40:08,946: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T00:40:08.947727300Z [2024-04-06 00:40:08,947: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:40:08.947750919Z [2024-04-06 00:40:08,947: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:40:08.947966335Z [2024-04-06 00:40:08,947: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:40:08.947982084Z [2024-04-06 00:40:08,947: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T00:40:08.948159035Z [2024-04-06 00:40:08,948: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T00:40:08.948169889Z [2024-04-06 00:40:08,948: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:40:09.040201997Z [2024-04-06 00:40:09,039: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:40:09.714640672Z [2024-04-06 00:40:09,714: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3b5290af-d10e-44f5-8b62-add3a52c7170] succeeded in 2.150388522000867s: None 2024-04-06T00:40:10.452116054Z [2024-04-06 00:40:10,451: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b7527b21-919e-4e36-ba3b-b0184cb68f76] received 2024-04-06T00:40:10.460574809Z [2024-04-06 00:40:10,460: INFO/ForkPoolWorker-15] [b7527b21-919e-4e36-ba3b-b0184cb68f76] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'send_prometheus', 'scheduled__2024-04-06T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T00:40:10.799785806Z [2024-04-06 00:40:10,795: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T00:40:11.966386812Z [2024-04-06 00:40:11,965: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T00:40:11.972737982Z [2024-04-06 00:40:11,972: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:40:12.002098699Z [2024-04-06 00:40:12,001: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T00:40:12.004760515Z [2024-04-06 00:40:12,004: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:40:12.004986695Z [2024-04-06 00:40:12,004: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:40:12.005374665Z [2024-04-06 00:40:12,005: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:40:12.005567006Z [2024-04-06 00:40:12,005: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T00:40:12.006178177Z [2024-04-06 00:40:12,005: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T00:40:12.006307267Z [2024-04-06 00:40:12,006: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:40:12.120091976Z [2024-04-06 00:40:12,119: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:40:12.811725378Z [2024-04-06 00:40:12,811: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b7527b21-919e-4e36-ba3b-b0184cb68f76] succeeded in 2.356439928000327s: None 2024-04-06T00:41:00.336175734Z [2024-04-06 00:41:00,335: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8e91509d-8d2e-4789-a3d3-74fd00e25b5c] received 2024-04-06T00:41:00.338104019Z [2024-04-06 00:41:00,337: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1acd8a4f-7914-4b3e-ab23-ea66afa5d762] received 2024-04-06T00:41:00.340223794Z [2024-04-06 00:41:00,340: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[83d4d263-3998-4207-88c1-92df0d9510f8] received 2024-04-06T00:41:00.351498333Z [2024-04-06 00:41:00,351: INFO/ForkPoolWorker-15] [8e91509d-8d2e-4789-a3d3-74fd00e25b5c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T00:41:00.356859461Z [2024-04-06 00:41:00,356: INFO/ForkPoolWorker-16] [1acd8a4f-7914-4b3e-ab23-ea66afa5d762] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T00:41:00.360146025Z [2024-04-06 00:41:00,359: INFO/ForkPoolWorker-1] [83d4d263-3998-4207-88c1-92df0d9510f8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T00:41:00.684033703Z [2024-04-06 00:41:00,680: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T00:41:00.784930513Z [2024-04-06 00:41:00,781: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T00:41:00.787605705Z [2024-04-06 00:41:00,784: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T00:41:00.842856599Z [2024-04-06 00:41:00,842: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-06T00:41:00.846550952Z [2024-04-06 00:41:00,846: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:41:00.876347057Z [2024-04-06 00:41:00,876: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T00:41:00.878094328Z [2024-04-06 00:41:00,877: INFO/ForkPoolWorker-16] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T00:41:00.878246848Z [2024-04-06 00:41:00,878: INFO/ForkPoolWorker-16] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T00:41:00.878339473Z [2024-04-06 00:41:00,878: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-06T00:41:00.878592562Z [2024-04-06 00:41:00,878: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T00:41:00.985891976Z [2024-04-06 00:41:00,985: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:41:01.620058334Z [2024-04-06 00:41:01,619: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1acd8a4f-7914-4b3e-ab23-ea66afa5d762] succeeded in 1.2785551270008s: None 2024-04-06T00:41:02.129456805Z [2024-04-06 00:41:02,129: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T00:41:02.132774761Z [2024-04-06 00:41:02,132: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:41:02.154243003Z [2024-04-06 00:41:02,154: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T00:41:02.155693480Z [2024-04-06 00:41:02,155: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:41:02.155739837Z [2024-04-06 00:41:02,155: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:41:02.155923366Z [2024-04-06 00:41:02,155: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:41:02.156055238Z [2024-04-06 00:41:02,155: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T00:41:02.156356203Z [2024-04-06 00:41:02,156: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T00:41:02.156490738Z [2024-04-06 00:41:02,156: INFO/ForkPoolWorker-15] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:41:02.159615403Z [2024-04-06 00:41:02,159: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T00:41:02.162950936Z [2024-04-06 00:41:02,162: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:41:02.181630841Z [2024-04-06 00:41:02,181: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T00:41:02.183372646Z [2024-04-06 00:41:02,183: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:41:02.183491870Z [2024-04-06 00:41:02,183: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:41:02.183676301Z [2024-04-06 00:41:02,183: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:41:02.183785103Z [2024-04-06 00:41:02,183: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T00:41:02.184145512Z [2024-04-06 00:41:02,184: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-06T00:41:02.184888527Z [2024-04-06 00:41:02,184: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:41:02.249320668Z [2024-04-06 00:41:02,249: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:41:02.306290054Z [2024-04-06 00:41:02,305: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:41:03.691837314Z [2024-04-06 00:41:03,685: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8e91509d-8d2e-4789-a3d3-74fd00e25b5c] succeeded in 3.345172643999831s: None 2024-04-06T00:41:04.167050875Z [2024-04-06 00:41:04,165: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[83d4d263-3998-4207-88c1-92df0d9510f8] succeeded in 3.8234024200010026s: None 2024-04-06T00:42:01.101207208Z [2024-04-06 00:42:01,100: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[43155f47-1971-4cd7-9176-8b5c7027b417] received 2024-04-06T00:42:01.104252504Z [2024-04-06 00:42:01,103: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c78aceb4-7895-410a-90e1-6b0bee42d989] received 2024-04-06T00:42:01.109693285Z [2024-04-06 00:42:01,109: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6cf83b16-5215-46b9-bbc0-ec8cbb06cb43] received 2024-04-06T00:42:01.110351233Z [2024-04-06 00:42:01,110: INFO/ForkPoolWorker-15] [43155f47-1971-4cd7-9176-8b5c7027b417] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T00:42:01.113401348Z [2024-04-06 00:42:01,113: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[531cba39-b230-44c3-98ff-0449c476e0ff] received 2024-04-06T00:42:01.116166847Z [2024-04-06 00:42:01,115: INFO/ForkPoolWorker-16] [c78aceb4-7895-410a-90e1-6b0bee42d989] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T00:42:01.131696821Z [2024-04-06 00:42:01,129: INFO/ForkPoolWorker-1] [6cf83b16-5215-46b9-bbc0-ec8cbb06cb43] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T00:42:01.134580332Z [2024-04-06 00:42:01,134: INFO/ForkPoolWorker-2] [531cba39-b230-44c3-98ff-0449c476e0ff] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T00:42:01.410457665Z [2024-04-06 00:42:01,406: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T00:42:01.451416388Z [2024-04-06 00:42:01,445: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T00:42:01.576781823Z [2024-04-06 00:42:01,564: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T00:42:01.627364752Z [2024-04-06 00:42:01,623: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T00:42:01.655824226Z [2024-04-06 00:42:01,655: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-06T00:42:01.660586228Z [2024-04-06 00:42:01,660: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:42:01.715679873Z [2024-04-06 00:42:01,715: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T00:42:01.717833486Z [2024-04-06 00:42:01,717: INFO/ForkPoolWorker-2] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T00:42:01.718187003Z [2024-04-06 00:42:01,717: INFO/ForkPoolWorker-2] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T00:42:01.718611706Z [2024-04-06 00:42:01,718: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-06T00:42:01.718855861Z [2024-04-06 00:42:01,718: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T00:42:01.887100260Z [2024-04-06 00:42:01,886: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:42:02.118571049Z [2024-04-06 00:42:02,118: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:42:02.632672246Z [2024-04-06 00:42:02,632: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[531cba39-b230-44c3-98ff-0449c476e0ff] succeeded in 1.5107218150005792s: None 2024-04-06T00:42:02.789497113Z [2024-04-06 00:42:02,789: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T00:42:02.793194359Z [2024-04-06 00:42:02,792: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:42:02.822103904Z [2024-04-06 00:42:02,821: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T00:42:02.824329577Z [2024-04-06 00:42:02,824: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:42:02.824485388Z [2024-04-06 00:42:02,824: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:42:02.824723301Z [2024-04-06 00:42:02,824: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:42:02.824886721Z [2024-04-06 00:42:02,824: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T00:42:02.825301126Z [2024-04-06 00:42:02,825: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T00:42:02.825499150Z [2024-04-06 00:42:02,825: INFO/ForkPoolWorker-15] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:42:02.849952844Z [2024-04-06 00:42:02,849: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c78aceb4-7895-410a-90e1-6b0bee42d989] succeeded in 1.7430227220011147s: None 2024-04-06T00:42:02.930783645Z [2024-04-06 00:42:02,930: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:42:03.208981644Z [2024-04-06 00:42:03,208: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T00:42:03.212363971Z [2024-04-06 00:42:03,211: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:42:03.233701675Z [2024-04-06 00:42:03,233: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T00:42:03.235712719Z [2024-04-06 00:42:03,235: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:42:03.235843622Z [2024-04-06 00:42:03,235: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:42:03.236133019Z [2024-04-06 00:42:03,235: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:42:03.236147332Z [2024-04-06 00:42:03,235: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T00:42:03.236384110Z [2024-04-06 00:42:03,236: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-06T00:42:03.236753069Z [2024-04-06 00:42:03,236: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:42:03.339012588Z [2024-04-06 00:42:03,338: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:42:04.445402632Z [2024-04-06 00:42:04,444: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[43155f47-1971-4cd7-9176-8b5c7027b417] succeeded in 3.3419895469996845s: None 2024-04-06T00:42:05.361012161Z [2024-04-06 00:42:05,360: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6cf83b16-5215-46b9-bbc0-ec8cbb06cb43] succeeded in 4.245488791000753s: None 2024-04-06T00:43:01.066160857Z [2024-04-06 00:43:01,064: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[78dee64d-65c3-432a-a2c7-efbe427ee6fd] received 2024-04-06T00:43:01.073695834Z [2024-04-06 00:43:01,073: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[19ffba10-bab2-4197-bca6-d92923cf1776] received 2024-04-06T00:43:01.082907633Z [2024-04-06 00:43:01,082: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[029849cb-2431-4392-a569-3813b046885b] received 2024-04-06T00:43:01.084234384Z [2024-04-06 00:43:01,084: INFO/ForkPoolWorker-16] [19ffba10-bab2-4197-bca6-d92923cf1776] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T00:43:01.097010211Z [2024-04-06 00:43:01,096: INFO/ForkPoolWorker-15] [78dee64d-65c3-432a-a2c7-efbe427ee6fd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T00:43:01.103113123Z [2024-04-06 00:43:01,102: INFO/ForkPoolWorker-1] [029849cb-2431-4392-a569-3813b046885b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T00:43:01.385272547Z [2024-04-06 00:43:01,381: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T00:43:01.398618564Z [2024-04-06 00:43:01,394: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T00:43:01.402987941Z [2024-04-06 00:43:01,399: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T00:43:01.555184605Z [2024-04-06 00:43:01,554: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-06T00:43:01.559809538Z [2024-04-06 00:43:01,559: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:43:01.591078497Z [2024-04-06 00:43:01,590: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T00:43:01.593820851Z [2024-04-06 00:43:01,593: INFO/ForkPoolWorker-16] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T00:43:01.594001752Z [2024-04-06 00:43:01,593: INFO/ForkPoolWorker-16] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T00:43:01.594121099Z [2024-04-06 00:43:01,593: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-06T00:43:01.594395935Z [2024-04-06 00:43:01,594: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T00:43:01.725470013Z [2024-04-06 00:43:01,725: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:43:02.362743930Z [2024-04-06 00:43:02,362: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[19ffba10-bab2-4197-bca6-d92923cf1776] succeeded in 1.2869693550001102s: None 2024-04-06T00:43:02.557750360Z [2024-04-06 00:43:02,557: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T00:43:02.560566229Z [2024-04-06 00:43:02,560: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:43:02.591906310Z [2024-04-06 00:43:02,591: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T00:43:02.596067474Z [2024-04-06 00:43:02,595: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:43:02.596097113Z [2024-04-06 00:43:02,595: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:43:02.596225944Z [2024-04-06 00:43:02,596: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:43:02.596237279Z [2024-04-06 00:43:02,596: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T00:43:02.596526503Z [2024-04-06 00:43:02,596: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T00:43:02.596539301Z [2024-04-06 00:43:02,596: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:43:02.636262099Z [2024-04-06 00:43:02,635: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T00:43:02.639665975Z [2024-04-06 00:43:02,639: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:43:02.675236464Z [2024-04-06 00:43:02,674: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T00:43:02.680666048Z [2024-04-06 00:43:02,680: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:43:02.681064097Z [2024-04-06 00:43:02,680: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:43:02.681337579Z [2024-04-06 00:43:02,681: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:43:02.682531144Z [2024-04-06 00:43:02,682: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T00:43:02.682938079Z [2024-04-06 00:43:02,682: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T00:43:02.683152155Z [2024-04-06 00:43:02,683: INFO/ForkPoolWorker-1] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:43:02.698244495Z [2024-04-06 00:43:02,697: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:43:02.809617030Z [2024-04-06 00:43:02,809: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:43:05.097401810Z [2024-04-06 00:43:05,096: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[78dee64d-65c3-432a-a2c7-efbe427ee6fd] succeeded in 4.0213897849989735s: None 2024-04-06T00:43:05.247877468Z [2024-04-06 00:43:05,247: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[029849cb-2431-4392-a569-3813b046885b] succeeded in 4.162474763999853s: None 2024-04-06T00:44:01.008770507Z [2024-04-06 00:44:01,008: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e2fdf834-6678-4ec2-9fa0-e9d11d9423ad] received 2024-04-06T00:44:01.012760151Z [2024-04-06 00:44:01,012: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[baf5c0f6-5209-4da9-afd5-93512118e96d] received 2024-04-06T00:44:01.019458904Z [2024-04-06 00:44:01,018: INFO/ForkPoolWorker-15] [e2fdf834-6678-4ec2-9fa0-e9d11d9423ad] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T00:44:01.025390401Z [2024-04-06 00:44:01,025: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0b095cf2-6548-4e92-a3cd-2531bc709075] received 2024-04-06T00:44:01.029453985Z [2024-04-06 00:44:01,028: INFO/ForkPoolWorker-16] [baf5c0f6-5209-4da9-afd5-93512118e96d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T00:44:01.048517077Z [2024-04-06 00:44:01,048: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[871b5e39-0195-4df7-bd40-4823f9d629b3] received 2024-04-06T00:44:01.058143456Z [2024-04-06 00:44:01,057: INFO/ForkPoolWorker-1] [0b095cf2-6548-4e92-a3cd-2531bc709075] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T00:44:01.064786754Z [2024-04-06 00:44:01,063: INFO/ForkPoolWorker-2] [871b5e39-0195-4df7-bd40-4823f9d629b3] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T00:44:01.337849263Z [2024-04-06 00:44:01,332: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T00:44:01.383888408Z [2024-04-06 00:44:01,374: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T00:44:01.478870916Z [2024-04-06 00:44:01,475: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T00:44:01.615102378Z [2024-04-06 00:44:01,610: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T00:44:01.644416171Z [2024-04-06 00:44:01,644: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:44:01.647455045Z [2024-04-06 00:44:01,646: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-06T00:44:01.651861553Z [2024-04-06 00:44:01,651: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:44:01.695114011Z [2024-04-06 00:44:01,694: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T00:44:01.697006398Z [2024-04-06 00:44:01,696: INFO/ForkPoolWorker-2] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T00:44:01.697074094Z [2024-04-06 00:44:01,696: INFO/ForkPoolWorker-2] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T00:44:01.697107791Z [2024-04-06 00:44:01,697: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-06T00:44:01.697364323Z [2024-04-06 00:44:01,697: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T00:44:01.798082254Z [2024-04-06 00:44:01,797: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:44:02.416080248Z [2024-04-06 00:44:02,415: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e2fdf834-6678-4ec2-9fa0-e9d11d9423ad] succeeded in 1.403090694000639s: None 2024-04-06T00:44:02.476951619Z [2024-04-06 00:44:02,476: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[871b5e39-0195-4df7-bd40-4823f9d629b3] succeeded in 1.426243510999484s: None 2024-04-06T00:44:02.975395000Z [2024-04-06 00:44:02,974: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T00:44:02.978560751Z [2024-04-06 00:44:02,978: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:44:03.012275015Z [2024-04-06 00:44:03,011: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T00:44:03.014391522Z [2024-04-06 00:44:03,014: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:44:03.014668776Z [2024-04-06 00:44:03,014: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:44:03.015126435Z [2024-04-06 00:44:03,014: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:44:03.015453653Z [2024-04-06 00:44:03,015: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T00:44:03.015898832Z [2024-04-06 00:44:03,015: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-06T00:44:03.016144566Z [2024-04-06 00:44:03,015: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:44:03.076831785Z [2024-04-06 00:44:03,076: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T00:44:03.081196696Z [2024-04-06 00:44:03,080: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:44:03.109728992Z [2024-04-06 00:44:03,109: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T00:44:03.112364950Z [2024-04-06 00:44:03,112: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:44:03.112414951Z [2024-04-06 00:44:03,112: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:44:03.112440498Z [2024-04-06 00:44:03,112: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:44:03.112536317Z [2024-04-06 00:44:03,112: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T00:44:03.112827440Z [2024-04-06 00:44:03,112: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T00:44:03.112950533Z [2024-04-06 00:44:03,112: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:44:03.137788554Z [2024-04-06 00:44:03,137: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:44:03.207113229Z [2024-04-06 00:44:03,206: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:44:05.479098900Z [2024-04-06 00:44:05,478: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[baf5c0f6-5209-4da9-afd5-93512118e96d] succeeded in 4.463571201000377s: None 2024-04-06T00:44:06.015291111Z [2024-04-06 00:44:06,014: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0b095cf2-6548-4e92-a3cd-2531bc709075] succeeded in 4.98491918199943s: None 2024-04-06T00:45:01.127462803Z [2024-04-06 00:45:01,126: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6a4e964b-e9ed-4032-96d1-9c596f203887] received 2024-04-06T00:45:01.131128604Z [2024-04-06 00:45:01,130: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3277f595-01d1-4e4b-85bc-ef88eb8d1d41] received 2024-04-06T00:45:01.136263268Z [2024-04-06 00:45:01,135: INFO/ForkPoolWorker-15] [6a4e964b-e9ed-4032-96d1-9c596f203887] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T00:45:01.140937093Z [2024-04-06 00:45:01,140: INFO/ForkPoolWorker-16] [3277f595-01d1-4e4b-85bc-ef88eb8d1d41] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T00:45:01.145183777Z [2024-04-06 00:45:01,144: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[62cbba7e-2eef-41a1-b198-b54d5c722361] received 2024-04-06T00:45:01.158055490Z [2024-04-06 00:45:01,157: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8c932afa-bf65-43f5-a029-a1995dae053a] received 2024-04-06T00:45:01.158745756Z [2024-04-06 00:45:01,158: INFO/ForkPoolWorker-1] [62cbba7e-2eef-41a1-b198-b54d5c722361] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T00:45:01.175562055Z [2024-04-06 00:45:01,175: INFO/ForkPoolWorker-2] [8c932afa-bf65-43f5-a029-a1995dae053a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T00:45:01.567765272Z [2024-04-06 00:45:01,560: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T00:45:01.582422157Z [2024-04-06 00:45:01,578: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T00:45:01.598436760Z [2024-04-06 00:45:01,595: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T00:45:01.664932053Z [2024-04-06 00:45:01,661: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T00:45:01.744518420Z [2024-04-06 00:45:01,744: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-06T00:45:01.748832534Z [2024-04-06 00:45:01,748: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:45:01.780944346Z [2024-04-06 00:45:01,780: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T00:45:01.782328367Z [2024-04-06 00:45:01,782: INFO/ForkPoolWorker-16] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T00:45:01.782530524Z [2024-04-06 00:45:01,782: INFO/ForkPoolWorker-16] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T00:45:01.782656654Z [2024-04-06 00:45:01,782: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-06T00:45:01.782925737Z [2024-04-06 00:45:01,782: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T00:45:01.911799266Z [2024-04-06 00:45:01,911: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:45:02.498053052Z [2024-04-06 00:45:02,497: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3277f595-01d1-4e4b-85bc-ef88eb8d1d41] succeeded in 1.3644055990007473s: None 2024-04-06T00:45:02.924043021Z [2024-04-06 00:45:02,918: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-06T00:45:02.924100046Z [2024-04-06 00:45:02,922: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:45:02.946136467Z [2024-04-06 00:45:02,945: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T00:45:02.949504697Z [2024-04-06 00:45:02,949: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:45:02.949690726Z [2024-04-06 00:45:02,949: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T00:45:02.951296156Z [2024-04-06 00:45:02,951: INFO/ForkPoolWorker-2] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:45:02.951531057Z [2024-04-06 00:45:02,951: INFO/ForkPoolWorker-2] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:45:02.951795321Z [2024-04-06 00:45:02,951: INFO/ForkPoolWorker-2] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:45:02.951952506Z [2024-04-06 00:45:02,951: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-06T00:45:02.952483002Z [2024-04-06 00:45:02,952: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T00:45:02.952766154Z [2024-04-06 00:45:02,952: INFO/ForkPoolWorker-2] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:45:02.977989397Z [2024-04-06 00:45:02,977: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T00:45:02.979489925Z [2024-04-06 00:45:02,979: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T00:45:02.980883209Z [2024-04-06 00:45:02,980: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:45:02.981118474Z [2024-04-06 00:45:02,980: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:45:02.981403374Z [2024-04-06 00:45:02,981: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:45:02.981763477Z [2024-04-06 00:45:02,981: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T00:45:02.982284478Z [2024-04-06 00:45:02,982: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T00:45:02.982478523Z [2024-04-06 00:45:02,982: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:45:02.983161477Z [2024-04-06 00:45:02,982: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:45:03.013080563Z [2024-04-06 00:45:03,012: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T00:45:03.014960988Z [2024-04-06 00:45:03,014: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:45:03.015116615Z [2024-04-06 00:45:03,014: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:45:03.015364570Z [2024-04-06 00:45:03,015: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:45:03.015461381Z [2024-04-06 00:45:03,015: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T00:45:03.015770687Z [2024-04-06 00:45:03,015: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-06T00:45:03.015861638Z [2024-04-06 00:45:03,015: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:45:03.039201084Z [2024-04-06 00:45:03,038: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:45:03.071798954Z [2024-04-06 00:45:03,071: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:45:03.150843434Z [2024-04-06 00:45:03,150: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:45:03.649179020Z [2024-04-06 00:45:03,648: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6a4e964b-e9ed-4032-96d1-9c596f203887] succeeded in 2.518405568000162s: None 2024-04-06T00:45:03.844063123Z [2024-04-06 00:45:03,843: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7e66d654-a28e-4db0-ad3e-c6f48b82c47d] received 2024-04-06T00:45:03.849411527Z [2024-04-06 00:45:03,849: INFO/ForkPoolWorker-15] [7e66d654-a28e-4db0-ad3e-c6f48b82c47d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'split_metrics', 'scheduled__2024-04-06T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T00:45:04.169006438Z [2024-04-06 00:45:04,165: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T00:45:04.537324849Z [2024-04-06 00:45:04,536: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[8c932afa-bf65-43f5-a029-a1995dae053a] succeeded in 3.371591506000186s: None 2024-04-06T00:45:05.217067350Z [2024-04-06 00:45:05,216: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[62cbba7e-2eef-41a1-b198-b54d5c722361] succeeded in 4.069185586000458s: None 2024-04-06T00:45:05.410711260Z [2024-04-06 00:45:05,410: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T00:45:05.414143424Z [2024-04-06 00:45:05,413: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:45:05.436392551Z [2024-04-06 00:45:05,436: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T00:45:05.437757526Z [2024-04-06 00:45:05,437: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:45:05.437885831Z [2024-04-06 00:45:05,437: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:45:05.438107111Z [2024-04-06 00:45:05,437: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:45:05.438232473Z [2024-04-06 00:45:05,438: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T00:45:05.438557669Z [2024-04-06 00:45:05,438: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T00:45:05.438769046Z [2024-04-06 00:45:05,438: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:45:05.541552840Z [2024-04-06 00:45:05,541: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:45:06.229138937Z [2024-04-06 00:45:06,228: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7e66d654-a28e-4db0-ad3e-c6f48b82c47d] succeeded in 2.3836294539996743s: None 2024-04-06T00:45:06.612676108Z [2024-04-06 00:45:06,612: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9fa03688-324b-424e-8c81-3772dea667fa] received 2024-04-06T00:45:06.621278908Z [2024-04-06 00:45:06,620: INFO/ForkPoolWorker-15] [9fa03688-324b-424e-8c81-3772dea667fa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'collect_metrics', 'scheduled__2024-04-06T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T00:45:06.914911270Z [2024-04-06 00:45:06,911: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T00:45:08.056621825Z [2024-04-06 00:45:08,056: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T00:45:08.059686650Z [2024-04-06 00:45:08,059: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:45:08.079326519Z [2024-04-06 00:45:08,079: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T00:45:08.080581126Z [2024-04-06 00:45:08,080: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:45:08.080603160Z [2024-04-06 00:45:08,080: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:45:08.080794094Z [2024-04-06 00:45:08,080: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:45:08.080883817Z [2024-04-06 00:45:08,080: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T00:45:08.081577099Z [2024-04-06 00:45:08,081: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T00:45:08.081671841Z [2024-04-06 00:45:08,081: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:45:08.154600688Z [2024-04-06 00:45:08,154: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:45:08.678979376Z [2024-04-06 00:45:08,678: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9fa03688-324b-424e-8c81-3772dea667fa] succeeded in 2.0643735109988484s: None 2024-04-06T00:45:09.017027328Z [2024-04-06 00:45:09,016: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dc5a7354-bad1-4b1a-82c1-4963a1584e05] received 2024-04-06T00:45:09.026290225Z [2024-04-06 00:45:09,025: INFO/ForkPoolWorker-15] [dc5a7354-bad1-4b1a-82c1-4963a1584e05] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'send_prometheus', 'scheduled__2024-04-06T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T00:45:09.289609550Z [2024-04-06 00:45:09,286: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T00:45:10.513362660Z [2024-04-06 00:45:10,512: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T00:45:10.516393206Z [2024-04-06 00:45:10,515: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:45:10.542412044Z [2024-04-06 00:45:10,542: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T00:45:10.544030313Z [2024-04-06 00:45:10,543: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:45:10.544053540Z [2024-04-06 00:45:10,543: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:45:10.544222307Z [2024-04-06 00:45:10,544: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:45:10.544273486Z [2024-04-06 00:45:10,544: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T00:45:10.544499289Z [2024-04-06 00:45:10,544: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T00:45:10.544550215Z [2024-04-06 00:45:10,544: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:45:10.638424866Z [2024-04-06 00:45:10,638: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:45:11.220853457Z [2024-04-06 00:45:11,220: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[dc5a7354-bad1-4b1a-82c1-4963a1584e05] succeeded in 2.202028342000631s: None 2024-04-06T00:46:00.258411247Z [2024-04-06 00:46:00,257: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1d63dfa4-0119-4053-ac8b-8bf7e0014360] received 2024-04-06T00:46:00.260685360Z [2024-04-06 00:46:00,260: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fe78200f-9aa7-4d19-9bfd-47212165eb68] received 2024-04-06T00:46:00.262539395Z [2024-04-06 00:46:00,262: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[460c8c29-ff7d-4dd2-a3e1-2f95e298f0a3] received 2024-04-06T00:46:00.264124084Z [2024-04-06 00:46:00,263: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d8573362-7653-4c91-9df3-209bf4c7ea94] received 2024-04-06T00:46:00.275015058Z [2024-04-06 00:46:00,274: INFO/ForkPoolWorker-1] [460c8c29-ff7d-4dd2-a3e1-2f95e298f0a3] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T00:46:00.275459797Z [2024-04-06 00:46:00,274: INFO/ForkPoolWorker-15] [1d63dfa4-0119-4053-ac8b-8bf7e0014360] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T00:46:00.276145163Z [2024-04-06 00:46:00,275: INFO/ForkPoolWorker-2] [d8573362-7653-4c91-9df3-209bf4c7ea94] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T00:46:00.276486632Z [2024-04-06 00:46:00,276: INFO/ForkPoolWorker-16] [fe78200f-9aa7-4d19-9bfd-47212165eb68] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T00:46:00.602664154Z [2024-04-06 00:46:00,593: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T00:46:00.664939482Z [2024-04-06 00:46:00,661: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T00:46:00.687139559Z [2024-04-06 00:46:00,656: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T00:46:00.738077444Z [2024-04-06 00:46:00,705: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T00:46:00.989700730Z [2024-04-06 00:46:00,989: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-06T00:46:00.994890604Z [2024-04-06 00:46:00,994: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:46:01.035942341Z [2024-04-06 00:46:01,035: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T00:46:01.037252654Z [2024-04-06 00:46:01,037: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T00:46:01.037471665Z [2024-04-06 00:46:01,037: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T00:46:01.037608120Z [2024-04-06 00:46:01,037: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-06T00:46:01.037883246Z [2024-04-06 00:46:01,037: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T00:46:01.147452095Z [2024-04-06 00:46:01,147: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:46:01.255164514Z [2024-04-06 00:46:01,254: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:46:01.841096159Z [2024-04-06 00:46:01,840: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[460c8c29-ff7d-4dd2-a3e1-2f95e298f0a3] succeeded in 1.577079935999791s: None 2024-04-06T00:46:01.902412472Z [2024-04-06 00:46:01,901: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1d63dfa4-0119-4053-ac8b-8bf7e0014360] succeeded in 1.6399877580006432s: None 2024-04-06T00:46:02.127236432Z [2024-04-06 00:46:02,126: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-06T00:46:02.130415918Z [2024-04-06 00:46:02,129: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:46:02.156583095Z [2024-04-06 00:46:02,156: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T00:46:02.158548110Z [2024-04-06 00:46:02,158: INFO/ForkPoolWorker-2] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:46:02.158665408Z [2024-04-06 00:46:02,158: INFO/ForkPoolWorker-2] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:46:02.158921962Z [2024-04-06 00:46:02,158: INFO/ForkPoolWorker-2] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:46:02.159064413Z [2024-04-06 00:46:02,158: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-06T00:46:02.159452026Z [2024-04-06 00:46:02,159: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T00:46:02.159595185Z [2024-04-06 00:46:02,159: INFO/ForkPoolWorker-2] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:46:02.197270876Z [2024-04-06 00:46:02,196: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T00:46:02.200882443Z [2024-04-06 00:46:02,200: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:46:02.227952665Z [2024-04-06 00:46:02,227: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T00:46:02.231861175Z [2024-04-06 00:46:02,231: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:46:02.231925777Z [2024-04-06 00:46:02,231: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:46:02.232091031Z [2024-04-06 00:46:02,231: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:46:02.232181347Z [2024-04-06 00:46:02,232: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T00:46:02.232434397Z [2024-04-06 00:46:02,232: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T00:46:02.232457939Z [2024-04-06 00:46:02,232: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:46:02.246777780Z [2024-04-06 00:46:02,246: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:46:02.346893402Z [2024-04-06 00:46:02,346: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:46:04.210773089Z [2024-04-06 00:46:04,210: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d8573362-7653-4c91-9df3-209bf4c7ea94] succeeded in 3.9429643530002068s: None 2024-04-06T00:46:05.326334192Z [2024-04-06 00:46:05,325: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[fe78200f-9aa7-4d19-9bfd-47212165eb68] succeeded in 5.060931449999771s: None 2024-04-06T00:47:00.311293215Z [2024-04-06 00:47:00,310: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e90d3783-7f43-4333-83bd-b639757b9291] received 2024-04-06T00:47:00.314431278Z [2024-04-06 00:47:00,314: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8a837682-fc34-40a4-831e-446099ce8038] received 2024-04-06T00:47:00.324092817Z [2024-04-06 00:47:00,323: INFO/ForkPoolWorker-16] [8a837682-fc34-40a4-831e-446099ce8038] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T00:47:00.325088338Z [2024-04-06 00:47:00,324: INFO/ForkPoolWorker-15] [e90d3783-7f43-4333-83bd-b639757b9291] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T00:47:00.327133377Z [2024-04-06 00:47:00,326: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[61f95be4-5eb5-4b27-9166-799ecd104b3d] received 2024-04-06T00:47:00.343753965Z [2024-04-06 00:47:00,343: INFO/ForkPoolWorker-1] [61f95be4-5eb5-4b27-9166-799ecd104b3d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T00:47:00.632254201Z [2024-04-06 00:47:00,629: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T00:47:00.658495033Z [2024-04-06 00:47:00,654: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T00:47:00.688893189Z [2024-04-06 00:47:00,685: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T00:47:00.836347380Z [2024-04-06 00:47:00,835: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-06T00:47:00.840513219Z [2024-04-06 00:47:00,839: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:47:00.872836714Z [2024-04-06 00:47:00,872: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T00:47:00.874280666Z [2024-04-06 00:47:00,873: INFO/ForkPoolWorker-15] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T00:47:00.874459709Z [2024-04-06 00:47:00,874: INFO/ForkPoolWorker-15] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T00:47:00.874702651Z [2024-04-06 00:47:00,874: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-06T00:47:00.875430398Z [2024-04-06 00:47:00,875: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T00:47:01.018902603Z [2024-04-06 00:47:01,018: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:47:01.597605305Z [2024-04-06 00:47:01,596: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e90d3783-7f43-4333-83bd-b639757b9291] succeeded in 1.2830484559999604s: None 2024-04-06T00:47:01.913560895Z [2024-04-06 00:47:01,911: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T00:47:01.914660195Z [2024-04-06 00:47:01,914: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:47:01.924463746Z [2024-04-06 00:47:01,923: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T00:47:01.934910606Z [2024-04-06 00:47:01,934: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:47:01.940356493Z [2024-04-06 00:47:01,940: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T00:47:01.942181257Z [2024-04-06 00:47:01,941: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:47:01.942304124Z [2024-04-06 00:47:01,942: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:47:01.942521710Z [2024-04-06 00:47:01,942: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:47:01.942639007Z [2024-04-06 00:47:01,942: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T00:47:01.942973520Z [2024-04-06 00:47:01,942: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T00:47:01.943097979Z [2024-04-06 00:47:01,942: INFO/ForkPoolWorker-1] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:47:01.977427002Z [2024-04-06 00:47:01,977: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T00:47:01.982352909Z [2024-04-06 00:47:01,982: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:47:01.982724864Z [2024-04-06 00:47:01,982: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:47:01.982971707Z [2024-04-06 00:47:01,982: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:47:01.983423953Z [2024-04-06 00:47:01,982: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T00:47:01.983921689Z [2024-04-06 00:47:01,983: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T00:47:01.984742952Z [2024-04-06 00:47:01,983: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:47:02.064947163Z [2024-04-06 00:47:02,064: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:47:02.093015594Z [2024-04-06 00:47:02,092: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:47:03.723098989Z [2024-04-06 00:47:03,722: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[61f95be4-5eb5-4b27-9166-799ecd104b3d] succeeded in 3.393955441999424s: None 2024-04-06T00:47:04.048272542Z [2024-04-06 00:47:04,047: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8a837682-fc34-40a4-831e-446099ce8038] succeeded in 3.731740446000913s: None 2024-04-06T00:48:01.292292692Z [2024-04-06 00:48:01,291: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a9ba1745-3935-4569-ac4a-a44f5ca22383] received 2024-04-06T00:48:01.295759850Z [2024-04-06 00:48:01,295: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3da7cce8-7d51-44c8-bf6d-69043ed86bc3] received 2024-04-06T00:48:01.303418871Z [2024-04-06 00:48:01,302: INFO/ForkPoolWorker-15] [a9ba1745-3935-4569-ac4a-a44f5ca22383] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T00:48:01.304909524Z [2024-04-06 00:48:01,304: INFO/ForkPoolWorker-16] [3da7cce8-7d51-44c8-bf6d-69043ed86bc3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T00:48:01.305644081Z [2024-04-06 00:48:01,305: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6454d2ac-3a84-4d29-b76b-c8beaf83322b] received 2024-04-06T00:48:01.317095218Z [2024-04-06 00:48:01,316: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a62d1f0f-581a-4857-a809-e18789df5e89] received 2024-04-06T00:48:01.327220687Z [2024-04-06 00:48:01,326: INFO/ForkPoolWorker-1] [6454d2ac-3a84-4d29-b76b-c8beaf83322b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T00:48:01.341070722Z [2024-04-06 00:48:01,340: INFO/ForkPoolWorker-2] [a62d1f0f-581a-4857-a809-e18789df5e89] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T00:48:01.654654480Z [2024-04-06 00:48:01,650: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T00:48:01.718616893Z [2024-04-06 00:48:01,713: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T00:48:01.767673671Z [2024-04-06 00:48:01,764: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T00:48:01.792015585Z [2024-04-06 00:48:01,788: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T00:48:01.916678351Z [2024-04-06 00:48:01,916: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:48:01.927462157Z [2024-04-06 00:48:01,926: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-06T00:48:01.932575357Z [2024-04-06 00:48:01,931: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:48:01.969307330Z [2024-04-06 00:48:01,969: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T00:48:01.970787445Z [2024-04-06 00:48:01,970: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T00:48:01.971034482Z [2024-04-06 00:48:01,970: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T00:48:01.972220953Z [2024-04-06 00:48:01,971: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-06T00:48:01.973300057Z [2024-04-06 00:48:01,973: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T00:48:02.114325100Z [2024-04-06 00:48:02,114: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:48:02.557087201Z [2024-04-06 00:48:02,556: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a9ba1745-3935-4569-ac4a-a44f5ca22383] succeeded in 1.2622882189989468s: None 2024-04-06T00:48:02.764453109Z [2024-04-06 00:48:02,763: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6454d2ac-3a84-4d29-b76b-c8beaf83322b] succeeded in 1.4544282070000918s: None 2024-04-06T00:48:03.270998064Z [2024-04-06 00:48:03,270: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T00:48:03.275085964Z [2024-04-06 00:48:03,274: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:48:03.303859820Z [2024-04-06 00:48:03,303: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T00:48:03.305511069Z [2024-04-06 00:48:03,305: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:48:03.305527278Z [2024-04-06 00:48:03,305: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:48:03.305652828Z [2024-04-06 00:48:03,305: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:48:03.305658634Z [2024-04-06 00:48:03,305: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T00:48:03.305905881Z [2024-04-06 00:48:03,305: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T00:48:03.305914145Z [2024-04-06 00:48:03,305: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:48:03.339843935Z [2024-04-06 00:48:03,339: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-06T00:48:03.343269641Z [2024-04-06 00:48:03,342: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:48:03.370187702Z [2024-04-06 00:48:03,369: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T00:48:03.371599648Z [2024-04-06 00:48:03,371: INFO/ForkPoolWorker-2] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:48:03.371613599Z [2024-04-06 00:48:03,371: INFO/ForkPoolWorker-2] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:48:03.371776323Z [2024-04-06 00:48:03,371: INFO/ForkPoolWorker-2] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:48:03.371789437Z [2024-04-06 00:48:03,371: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-06T00:48:03.371991731Z [2024-04-06 00:48:03,371: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T00:48:03.372039761Z [2024-04-06 00:48:03,371: INFO/ForkPoolWorker-2] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:48:03.402075788Z [2024-04-06 00:48:03,401: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:48:03.494577905Z [2024-04-06 00:48:03,494: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:48:05.666861790Z [2024-04-06 00:48:05,665: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a62d1f0f-581a-4857-a809-e18789df5e89] succeeded in 4.341917570000078s: None 2024-04-06T00:48:05.907634252Z [2024-04-06 00:48:05,907: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3da7cce8-7d51-44c8-bf6d-69043ed86bc3] succeeded in 4.608052297999166s: None 2024-04-06T00:49:01.236249513Z [2024-04-06 00:49:01,235: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f4703462-d74d-4752-93e9-0742af7064a6] received 2024-04-06T00:49:01.239962471Z [2024-04-06 00:49:01,239: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[278f7a31-e994-4d6b-950e-336573a27f81] received 2024-04-06T00:49:01.246258739Z [2024-04-06 00:49:01,245: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c7e6d29f-4edf-41da-be53-aec69b438874] received 2024-04-06T00:49:01.254680183Z [2024-04-06 00:49:01,254: INFO/ForkPoolWorker-16] [278f7a31-e994-4d6b-950e-336573a27f81] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T00:49:01.255164640Z [2024-04-06 00:49:01,254: INFO/ForkPoolWorker-1] [c7e6d29f-4edf-41da-be53-aec69b438874] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T00:49:01.256992013Z [2024-04-06 00:49:01,256: INFO/ForkPoolWorker-15] [f4703462-d74d-4752-93e9-0742af7064a6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T00:49:01.581405347Z [2024-04-06 00:49:01,576: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T00:49:01.587408303Z [2024-04-06 00:49:01,583: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T00:49:01.615031325Z [2024-04-06 00:49:01,611: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T00:49:01.761954794Z [2024-04-06 00:49:01,761: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-06T00:49:01.766357961Z [2024-04-06 00:49:01,765: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:49:01.792941859Z [2024-04-06 00:49:01,792: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T00:49:01.793411370Z [2024-04-06 00:49:01,793: INFO/ForkPoolWorker-16] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T00:49:01.793541999Z [2024-04-06 00:49:01,793: INFO/ForkPoolWorker-16] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T00:49:01.793598915Z [2024-04-06 00:49:01,793: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-06T00:49:01.793836438Z [2024-04-06 00:49:01,793: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T00:49:01.904893389Z [2024-04-06 00:49:01,904: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:49:02.582412872Z [2024-04-06 00:49:02,582: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[278f7a31-e994-4d6b-950e-336573a27f81] succeeded in 1.3404047329986497s: None 2024-04-06T00:49:02.820782683Z [2024-04-06 00:49:02,820: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T00:49:02.823903591Z [2024-04-06 00:49:02,823: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:49:02.843964706Z [2024-04-06 00:49:02,843: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T00:49:02.845291782Z [2024-04-06 00:49:02,845: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:49:02.845304568Z [2024-04-06 00:49:02,845: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:49:02.845441884Z [2024-04-06 00:49:02,845: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:49:02.845449990Z [2024-04-06 00:49:02,845: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T00:49:02.845695105Z [2024-04-06 00:49:02,845: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T00:49:02.845703432Z [2024-04-06 00:49:02,845: INFO/ForkPoolWorker-1] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:49:02.856709135Z [2024-04-06 00:49:02,856: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T00:49:02.860011151Z [2024-04-06 00:49:02,859: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:49:02.889972913Z [2024-04-06 00:49:02,889: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T00:49:02.895632193Z [2024-04-06 00:49:02,895: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:49:02.895759798Z [2024-04-06 00:49:02,895: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:49:02.896099437Z [2024-04-06 00:49:02,895: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:49:02.896215288Z [2024-04-06 00:49:02,895: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T00:49:02.896588315Z [2024-04-06 00:49:02,896: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T00:49:02.896709087Z [2024-04-06 00:49:02,896: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:49:02.956361583Z [2024-04-06 00:49:02,953: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:49:02.991844152Z [2024-04-06 00:49:02,991: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:49:04.919036074Z [2024-04-06 00:49:04,918: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c7e6d29f-4edf-41da-be53-aec69b438874] succeeded in 3.668563549999817s: None 2024-04-06T00:49:05.349154722Z [2024-04-06 00:49:05,348: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f4703462-d74d-4752-93e9-0742af7064a6] succeeded in 4.109035948999008s: None 2024-04-06T00:50:01.100763603Z [2024-04-06 00:50:01,100: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ceb58706-b3b9-475a-9551-9f2194cbe57c] received 2024-04-06T00:50:01.103108461Z [2024-04-06 00:50:01,102: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dfdb0cf8-9d4a-4a02-9d23-d1c741560d4b] received 2024-04-06T00:50:01.104828940Z [2024-04-06 00:50:01,104: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0b1bdfd5-8048-46f1-a5ca-a3ac7cde9237] received 2024-04-06T00:50:01.110270646Z [2024-04-06 00:50:01,109: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2749522e-f106-4bd7-aa85-d86814112140] received 2024-04-06T00:50:01.112248950Z [2024-04-06 00:50:01,111: INFO/ForkPoolWorker-15] [ceb58706-b3b9-475a-9551-9f2194cbe57c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T00:50:01.113643604Z [2024-04-06 00:50:01,113: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9eee3259-d850-4e9a-b58e-448e0cd7cc64] received 2024-04-06T00:50:01.117750877Z [2024-04-06 00:50:01,117: INFO/ForkPoolWorker-1] [0b1bdfd5-8048-46f1-a5ca-a3ac7cde9237] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T00:50:01.124109858Z [2024-04-06 00:50:01,123: INFO/ForkPoolWorker-16] [dfdb0cf8-9d4a-4a02-9d23-d1c741560d4b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T00:50:01.134145283Z [2024-04-06 00:50:01,133: INFO/ForkPoolWorker-3] [9eee3259-d850-4e9a-b58e-448e0cd7cc64] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T00:50:01.137286554Z [2024-04-06 00:50:01,137: INFO/ForkPoolWorker-2] [2749522e-f106-4bd7-aa85-d86814112140] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T00:50:01.500924796Z [2024-04-06 00:50:01,495: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T00:50:01.571491749Z [2024-04-06 00:50:01,564: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T00:50:01.620342163Z [2024-04-06 00:50:01,617: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T00:50:01.697218814Z [2024-04-06 00:50:01,687: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T00:50:01.750620050Z [2024-04-06 00:50:01,727: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T00:50:02.025552936Z [2024-04-06 00:50:02,025: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:50:02.083142107Z [2024-04-06 00:50:02,082: INFO/ForkPoolWorker-3] Getting SDNC list 2024-04-06T00:50:02.088324268Z [2024-04-06 00:50:02,087: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:50:02.125921724Z [2024-04-06 00:50:02,125: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-06T00:50:02.128367148Z [2024-04-06 00:50:02,128: INFO/ForkPoolWorker-3] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T00:50:02.128547270Z [2024-04-06 00:50:02,128: INFO/ForkPoolWorker-3] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T00:50:02.128655682Z [2024-04-06 00:50:02,128: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-04-06T00:50:02.129041785Z [2024-04-06 00:50:02,128: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T00:50:02.235772869Z [2024-04-06 00:50:02,235: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:50:02.662535253Z [2024-04-06 00:50:02,662: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[dfdb0cf8-9d4a-4a02-9d23-d1c741560d4b] succeeded in 1.5578598669999337s: None 2024-04-06T00:50:03.076631837Z [2024-04-06 00:50:03,076: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[9eee3259-d850-4e9a-b58e-448e0cd7cc64] succeeded in 1.9608691279991035s: None 2024-04-06T00:50:03.462669999Z [2024-04-06 00:50:03,462: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T00:50:03.466104575Z [2024-04-06 00:50:03,465: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:50:03.483482035Z [2024-04-06 00:50:03,483: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T00:50:03.485546476Z [2024-04-06 00:50:03,485: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:50:03.485589493Z [2024-04-06 00:50:03,485: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:50:03.485744166Z [2024-04-06 00:50:03,485: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:50:03.485806586Z [2024-04-06 00:50:03,485: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T00:50:03.486153661Z [2024-04-06 00:50:03,485: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T00:50:03.486222261Z [2024-04-06 00:50:03,486: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:50:03.582481835Z [2024-04-06 00:50:03,582: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:50:03.734636373Z [2024-04-06 00:50:03,732: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-06T00:50:03.738923744Z [2024-04-06 00:50:03,735: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:50:03.811207293Z [2024-04-06 00:50:03,810: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T00:50:03.813476982Z [2024-04-06 00:50:03,813: INFO/ForkPoolWorker-2] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:50:03.813647895Z [2024-04-06 00:50:03,813: INFO/ForkPoolWorker-2] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:50:03.813842980Z [2024-04-06 00:50:03,813: INFO/ForkPoolWorker-2] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:50:03.813948904Z [2024-04-06 00:50:03,813: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-06T00:50:03.814291902Z [2024-04-06 00:50:03,814: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T00:50:03.814301746Z [2024-04-06 00:50:03,814: INFO/ForkPoolWorker-2] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:50:03.891084765Z [2024-04-06 00:50:03,890: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T00:50:03.894826147Z [2024-04-06 00:50:03,894: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:50:03.942468964Z [2024-04-06 00:50:03,942: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T00:50:03.943934760Z [2024-04-06 00:50:03,943: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:50:03.943966714Z [2024-04-06 00:50:03,943: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:50:03.944145369Z [2024-04-06 00:50:03,943: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:50:03.944248305Z [2024-04-06 00:50:03,944: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T00:50:03.944545373Z [2024-04-06 00:50:03,944: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-06T00:50:03.944679037Z [2024-04-06 00:50:03,944: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:50:03.963129609Z [2024-04-06 00:50:03,962: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:50:04.072436764Z [2024-04-06 00:50:04,072: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:50:04.443214870Z [2024-04-06 00:50:04,442: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[25dc15c3-f5d2-4300-aaac-30e66b1fd778] received 2024-04-06T00:50:04.464582337Z [2024-04-06 00:50:04,464: INFO/ForkPoolWorker-16] [25dc15c3-f5d2-4300-aaac-30e66b1fd778] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'split_metrics', 'scheduled__2024-04-06T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T00:50:04.546920454Z [2024-04-06 00:50:04,546: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ceb58706-b3b9-475a-9551-9f2194cbe57c] succeeded in 3.4426373220012465s: None 2024-04-06T00:50:04.880189454Z [2024-04-06 00:50:04,876: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T00:50:05.710865693Z [2024-04-06 00:50:05,710: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[2749522e-f106-4bd7-aa85-d86814112140] succeeded in 4.597761766999611s: None 2024-04-06T00:50:06.095970254Z [2024-04-06 00:50:06,095: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T00:50:06.099455946Z [2024-04-06 00:50:06,098: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:50:06.121434960Z [2024-04-06 00:50:06,121: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T00:50:06.122944039Z [2024-04-06 00:50:06,122: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:50:06.123139691Z [2024-04-06 00:50:06,122: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:50:06.123439302Z [2024-04-06 00:50:06,123: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:50:06.123564215Z [2024-04-06 00:50:06,123: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T00:50:06.123887144Z [2024-04-06 00:50:06,123: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T00:50:06.124422766Z [2024-04-06 00:50:06,124: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:50:06.206892878Z [2024-04-06 00:50:06,206: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:50:06.508576516Z [2024-04-06 00:50:06,508: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0b1bdfd5-8048-46f1-a5ca-a3ac7cde9237] succeeded in 5.401655797000785s: None 2024-04-06T00:50:06.846167527Z [2024-04-06 00:50:06,845: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[25dc15c3-f5d2-4300-aaac-30e66b1fd778] succeeded in 2.399554225999964s: None 2024-04-06T00:50:07.241721138Z [2024-04-06 00:50:07,241: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e1494eef-effa-493b-8141-4cdfcd0bfdcf] received 2024-04-06T00:50:07.250949484Z [2024-04-06 00:50:07,250: INFO/ForkPoolWorker-15] [e1494eef-effa-493b-8141-4cdfcd0bfdcf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'collect_metrics', 'scheduled__2024-04-06T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T00:50:07.519829554Z [2024-04-06 00:50:07,516: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T00:50:08.703809952Z [2024-04-06 00:50:08,703: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T00:50:08.707114555Z [2024-04-06 00:50:08,706: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:50:08.737989001Z [2024-04-06 00:50:08,737: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T00:50:08.739536790Z [2024-04-06 00:50:08,739: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:50:08.739626356Z [2024-04-06 00:50:08,739: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:50:08.739872997Z [2024-04-06 00:50:08,739: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:50:08.739960569Z [2024-04-06 00:50:08,739: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T00:50:08.740525575Z [2024-04-06 00:50:08,740: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T00:50:08.740625854Z [2024-04-06 00:50:08,740: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:50:08.832060066Z [2024-04-06 00:50:08,831: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:50:09.476904034Z [2024-04-06 00:50:09,476: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e1494eef-effa-493b-8141-4cdfcd0bfdcf] succeeded in 2.2325326339996536s: None 2024-04-06T00:50:10.122974519Z [2024-04-06 00:50:10,122: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ea654a72-2302-47d6-9ada-8505ef5c0838] received 2024-04-06T00:50:10.133860584Z [2024-04-06 00:50:10,133: INFO/ForkPoolWorker-15] [ea654a72-2302-47d6-9ada-8505ef5c0838] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'send_prometheus', 'scheduled__2024-04-06T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T00:50:10.407883429Z [2024-04-06 00:50:10,404: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T00:50:11.547073128Z [2024-04-06 00:50:11,546: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T00:50:11.550464445Z [2024-04-06 00:50:11,549: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:50:11.582132494Z [2024-04-06 00:50:11,581: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T00:50:11.584168447Z [2024-04-06 00:50:11,583: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:50:11.584291695Z [2024-04-06 00:50:11,584: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:50:11.584533176Z [2024-04-06 00:50:11,584: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:50:11.584647267Z [2024-04-06 00:50:11,584: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T00:50:11.585025027Z [2024-04-06 00:50:11,584: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T00:50:11.585166560Z [2024-04-06 00:50:11,585: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:50:11.670924136Z [2024-04-06 00:50:11,670: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:50:12.234180066Z [2024-04-06 00:50:12,233: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ea654a72-2302-47d6-9ada-8505ef5c0838] succeeded in 2.10807023399866s: None 2024-04-06T00:51:00.412951725Z [2024-04-06 00:51:00,412: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[acd12214-17f7-4c34-9192-3db568180d04] received 2024-04-06T00:51:00.416472630Z [2024-04-06 00:51:00,416: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a0b4625d-35e1-4090-828a-a0c6382635ea] received 2024-04-06T00:51:00.427002713Z [2024-04-06 00:51:00,426: INFO/ForkPoolWorker-16] [a0b4625d-35e1-4090-828a-a0c6382635ea] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T00:51:00.427627125Z [2024-04-06 00:51:00,427: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8fd356cd-26dd-45aa-9a94-f8bf9a9cd2cd] received 2024-04-06T00:51:00.432036575Z [2024-04-06 00:51:00,431: INFO/ForkPoolWorker-15] [acd12214-17f7-4c34-9192-3db568180d04] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T00:51:00.441267884Z [2024-04-06 00:51:00,440: INFO/ForkPoolWorker-1] [8fd356cd-26dd-45aa-9a94-f8bf9a9cd2cd] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T00:51:00.738141055Z [2024-04-06 00:51:00,734: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T00:51:00.759844625Z [2024-04-06 00:51:00,756: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T00:51:00.777279481Z [2024-04-06 00:51:00,773: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T00:51:00.952313236Z [2024-04-06 00:51:00,951: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-06T00:51:00.956648873Z [2024-04-06 00:51:00,956: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:51:00.996957302Z [2024-04-06 00:51:00,996: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T00:51:01.005397272Z [2024-04-06 00:51:01,005: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T00:51:01.005496066Z [2024-04-06 00:51:01,005: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T00:51:01.005909018Z [2024-04-06 00:51:01,005: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-06T00:51:01.006211873Z [2024-04-06 00:51:01,006: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T00:51:01.121362918Z [2024-04-06 00:51:01,121: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:51:01.654750558Z [2024-04-06 00:51:01,654: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8fd356cd-26dd-45aa-9a94-f8bf9a9cd2cd] succeeded in 1.2243085419995623s: None 2024-04-06T00:51:01.973088007Z [2024-04-06 00:51:01,972: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T00:51:01.976625054Z [2024-04-06 00:51:01,976: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:51:01.997631327Z [2024-04-06 00:51:01,997: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T00:51:01.998873048Z [2024-04-06 00:51:01,998: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:51:01.998950839Z [2024-04-06 00:51:01,998: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:51:01.999101970Z [2024-04-06 00:51:01,998: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:51:01.999156530Z [2024-04-06 00:51:01,999: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T00:51:01.999418325Z [2024-04-06 00:51:01,999: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T00:51:01.999536091Z [2024-04-06 00:51:01,999: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:51:02.013831816Z [2024-04-06 00:51:02,013: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T00:51:02.017372736Z [2024-04-06 00:51:02,016: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:51:02.043219295Z [2024-04-06 00:51:02,042: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T00:51:02.044787051Z [2024-04-06 00:51:02,044: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:51:02.044930008Z [2024-04-06 00:51:02,044: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:51:02.045121520Z [2024-04-06 00:51:02,044: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:51:02.045268732Z [2024-04-06 00:51:02,045: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T00:51:02.045608397Z [2024-04-06 00:51:02,045: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T00:51:02.045726617Z [2024-04-06 00:51:02,045: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:51:02.076495365Z [2024-04-06 00:51:02,076: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:51:02.130537609Z [2024-04-06 00:51:02,130: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:51:03.602589604Z [2024-04-06 00:51:03,602: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a0b4625d-35e1-4090-828a-a0c6382635ea] succeeded in 3.1837317389999953s: None 2024-04-06T00:51:04.212934745Z [2024-04-06 00:51:04,212: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[acd12214-17f7-4c34-9192-3db568180d04] succeeded in 3.7953894509992097s: None 2024-04-06T00:52:00.830687855Z [2024-04-06 00:52:00,830: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1a077c13-282a-4736-a558-dc2e62c0a514] received 2024-04-06T00:52:00.833854629Z [2024-04-06 00:52:00,833: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5839ebcd-1eed-432e-a3d1-75450ca78461] received 2024-04-06T00:52:00.841804418Z [2024-04-06 00:52:00,841: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[431ad413-1cb2-46ae-9f68-c2e993e24d04] received 2024-04-06T00:52:00.845934998Z [2024-04-06 00:52:00,845: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9e9ea382-31cf-49bc-b7de-06a723c86291] received 2024-04-06T00:52:00.849275106Z [2024-04-06 00:52:00,849: INFO/ForkPoolWorker-1] [431ad413-1cb2-46ae-9f68-c2e993e24d04] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T00:52:00.855935221Z [2024-04-06 00:52:00,855: INFO/ForkPoolWorker-16] [5839ebcd-1eed-432e-a3d1-75450ca78461] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T00:52:00.856587775Z [2024-04-06 00:52:00,856: INFO/ForkPoolWorker-2] [9e9ea382-31cf-49bc-b7de-06a723c86291] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T00:52:00.857208673Z [2024-04-06 00:52:00,856: INFO/ForkPoolWorker-15] [1a077c13-282a-4736-a558-dc2e62c0a514] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T00:52:01.184447822Z [2024-04-06 00:52:01,180: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T00:52:01.196842233Z [2024-04-06 00:52:01,193: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T00:52:01.279337165Z [2024-04-06 00:52:01,275: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T00:52:01.325321742Z [2024-04-06 00:52:01,320: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T00:52:01.354276166Z [2024-04-06 00:52:01,353: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-06T00:52:01.358213140Z [2024-04-06 00:52:01,357: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:52:01.394922414Z [2024-04-06 00:52:01,394: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T00:52:01.399644877Z [2024-04-06 00:52:01,399: INFO/ForkPoolWorker-2] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T00:52:01.400131635Z [2024-04-06 00:52:01,399: INFO/ForkPoolWorker-2] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T00:52:01.400315138Z [2024-04-06 00:52:01,400: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-06T00:52:01.400638054Z [2024-04-06 00:52:01,400: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T00:52:01.545798565Z [2024-04-06 00:52:01,545: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:52:01.675970114Z [2024-04-06 00:52:01,675: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:52:02.239470777Z [2024-04-06 00:52:02,238: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[9e9ea382-31cf-49bc-b7de-06a723c86291] succeeded in 1.389617492999605s: None 2024-04-06T00:52:02.274700406Z [2024-04-06 00:52:02,274: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5839ebcd-1eed-432e-a3d1-75450ca78461] succeeded in 1.4312934529989434s: None 2024-04-06T00:52:02.643739543Z [2024-04-06 00:52:02,643: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T00:52:02.646945752Z [2024-04-06 00:52:02,646: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:52:02.653998921Z [2024-04-06 00:52:02,653: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T00:52:02.657286277Z [2024-04-06 00:52:02,656: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:52:02.670724225Z [2024-04-06 00:52:02,670: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T00:52:02.673101712Z [2024-04-06 00:52:02,672: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:52:02.673118507Z [2024-04-06 00:52:02,673: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:52:02.673263027Z [2024-04-06 00:52:02,673: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:52:02.673291321Z [2024-04-06 00:52:02,673: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T00:52:02.673543262Z [2024-04-06 00:52:02,673: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-06T00:52:02.673574763Z [2024-04-06 00:52:02,673: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:52:02.687002869Z [2024-04-06 00:52:02,685: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T00:52:02.687339082Z [2024-04-06 00:52:02,687: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:52:02.687382679Z [2024-04-06 00:52:02,687: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:52:02.687610610Z [2024-04-06 00:52:02,687: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:52:02.687687653Z [2024-04-06 00:52:02,687: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T00:52:02.687995004Z [2024-04-06 00:52:02,687: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T00:52:02.688082278Z [2024-04-06 00:52:02,687: INFO/ForkPoolWorker-15] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:52:02.778506541Z [2024-04-06 00:52:02,778: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:52:02.820411140Z [2024-04-06 00:52:02,820: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:52:04.537358923Z [2024-04-06 00:52:04,536: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1a077c13-282a-4736-a558-dc2e62c0a514] succeeded in 3.6938255119985115s: None 2024-04-06T00:52:04.654345596Z [2024-04-06 00:52:04,653: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[431ad413-1cb2-46ae-9f68-c2e993e24d04] succeeded in 3.809893881998505s: None 2024-04-06T00:53:01.302994421Z [2024-04-06 00:53:01,302: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1a071561-5315-4045-af98-2f9bc451f22c] received 2024-04-06T00:53:01.305730702Z [2024-04-06 00:53:01,305: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f0b749f8-4195-4d2c-90dd-9ca77ad4b32c] received 2024-04-06T00:53:01.308396234Z [2024-04-06 00:53:01,308: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a289cbbb-c9ad-47bc-a3b8-95aaa6de6186] received 2024-04-06T00:53:01.316687216Z [2024-04-06 00:53:01,316: INFO/ForkPoolWorker-16] [f0b749f8-4195-4d2c-90dd-9ca77ad4b32c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T00:53:01.322024917Z [2024-04-06 00:53:01,319: INFO/ForkPoolWorker-15] [1a071561-5315-4045-af98-2f9bc451f22c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T00:53:01.323184705Z [2024-04-06 00:53:01,322: INFO/ForkPoolWorker-1] [a289cbbb-c9ad-47bc-a3b8-95aaa6de6186] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T00:53:01.661914075Z [2024-04-06 00:53:01,658: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T00:53:01.666615129Z [2024-04-06 00:53:01,662: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T00:53:01.695020561Z [2024-04-06 00:53:01,690: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T00:53:01.827584851Z [2024-04-06 00:53:01,827: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-06T00:53:01.832259961Z [2024-04-06 00:53:01,831: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:53:01.869131082Z [2024-04-06 00:53:01,868: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T00:53:01.870751710Z [2024-04-06 00:53:01,870: INFO/ForkPoolWorker-16] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T00:53:01.871213653Z [2024-04-06 00:53:01,870: INFO/ForkPoolWorker-16] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T00:53:01.871486388Z [2024-04-06 00:53:01,871: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-06T00:53:01.871928819Z [2024-04-06 00:53:01,871: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T00:53:01.988828576Z [2024-04-06 00:53:01,988: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:53:02.555761502Z [2024-04-06 00:53:02,555: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f0b749f8-4195-4d2c-90dd-9ca77ad4b32c] succeeded in 1.2484762309995858s: None 2024-04-06T00:53:02.912284797Z [2024-04-06 00:53:02,911: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T00:53:02.915815210Z [2024-04-06 00:53:02,915: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:53:02.953952596Z [2024-04-06 00:53:02,953: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T00:53:02.955886137Z [2024-04-06 00:53:02,955: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:53:02.956057465Z [2024-04-06 00:53:02,955: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:53:02.956298307Z [2024-04-06 00:53:02,956: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:53:02.956477544Z [2024-04-06 00:53:02,956: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T00:53:02.956826197Z [2024-04-06 00:53:02,956: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-06T00:53:02.956989054Z [2024-04-06 00:53:02,956: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:53:03.045536021Z [2024-04-06 00:53:03,045: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:53:03.203688360Z [2024-04-06 00:53:03,203: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T00:53:03.207087860Z [2024-04-06 00:53:03,206: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:53:03.240329626Z [2024-04-06 00:53:03,240: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T00:53:03.241692856Z [2024-04-06 00:53:03,241: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:53:03.241853063Z [2024-04-06 00:53:03,241: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:53:03.242063434Z [2024-04-06 00:53:03,241: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:53:03.242204583Z [2024-04-06 00:53:03,242: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T00:53:03.242509994Z [2024-04-06 00:53:03,242: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T00:53:03.242675678Z [2024-04-06 00:53:03,242: INFO/ForkPoolWorker-15] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:53:03.331058321Z [2024-04-06 00:53:03,330: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:53:04.952745577Z [2024-04-06 00:53:04,952: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a289cbbb-c9ad-47bc-a3b8-95aaa6de6186] succeeded in 3.6423424940003315s: None 2024-04-06T00:53:05.218434143Z [2024-04-06 00:53:05,217: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1a071561-5315-4045-af98-2f9bc451f22c] succeeded in 3.909433748000083s: None 2024-04-06T00:54:00.628039737Z [2024-04-06 00:54:00,627: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[efda0d32-f935-4460-a308-7f77f2c16675] received 2024-04-06T00:54:00.634254800Z [2024-04-06 00:54:00,633: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[146a69e9-5dab-4c12-bb72-905b442fae20] received 2024-04-06T00:54:00.636065512Z [2024-04-06 00:54:00,635: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[08514f39-5a4c-4ae0-b0e4-d41a56d04f72] received 2024-04-06T00:54:00.640339668Z [2024-04-06 00:54:00,640: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[506a46e5-4125-48e4-9b41-d3e9199ffd4e] received 2024-04-06T00:54:00.642722817Z [2024-04-06 00:54:00,642: INFO/ForkPoolWorker-15] [efda0d32-f935-4460-a308-7f77f2c16675] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T00:54:00.651665636Z [2024-04-06 00:54:00,651: INFO/ForkPoolWorker-1] [08514f39-5a4c-4ae0-b0e4-d41a56d04f72] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T00:54:00.653542872Z [2024-04-06 00:54:00,653: INFO/ForkPoolWorker-2] [506a46e5-4125-48e4-9b41-d3e9199ffd4e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T00:54:00.654436396Z [2024-04-06 00:54:00,654: INFO/ForkPoolWorker-16] [146a69e9-5dab-4c12-bb72-905b442fae20] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T00:54:00.998253115Z [2024-04-06 00:54:00,993: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T00:54:01.040849769Z [2024-04-06 00:54:01,037: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T00:54:01.112410373Z [2024-04-06 00:54:01,108: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T00:54:01.151118100Z [2024-04-06 00:54:01,147: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T00:54:01.207660872Z [2024-04-06 00:54:01,207: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-06T00:54:01.212229918Z [2024-04-06 00:54:01,211: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:54:01.248523369Z [2024-04-06 00:54:01,248: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T00:54:01.250385884Z [2024-04-06 00:54:01,250: INFO/ForkPoolWorker-2] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T00:54:01.250493757Z [2024-04-06 00:54:01,250: INFO/ForkPoolWorker-2] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T00:54:01.250565489Z [2024-04-06 00:54:01,250: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-06T00:54:01.250803179Z [2024-04-06 00:54:01,250: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T00:54:01.368854136Z [2024-04-06 00:54:01,368: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:54:01.429541480Z [2024-04-06 00:54:01,429: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:54:01.989590550Z [2024-04-06 00:54:01,989: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[506a46e5-4125-48e4-9b41-d3e9199ffd4e] succeeded in 1.347448295000504s: None 2024-04-06T00:54:02.083679582Z [2024-04-06 00:54:02,083: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[efda0d32-f935-4460-a308-7f77f2c16675] succeeded in 1.4531110560001252s: None 2024-04-06T00:54:02.359832098Z [2024-04-06 00:54:02,359: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T00:54:02.363102303Z [2024-04-06 00:54:02,362: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:54:02.386224144Z [2024-04-06 00:54:02,385: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T00:54:02.388702227Z [2024-04-06 00:54:02,388: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:54:02.388845196Z [2024-04-06 00:54:02,388: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:54:02.389044245Z [2024-04-06 00:54:02,388: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:54:02.389150661Z [2024-04-06 00:54:02,389: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T00:54:02.389460452Z [2024-04-06 00:54:02,389: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-06T00:54:02.389550235Z [2024-04-06 00:54:02,389: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:54:02.419602518Z [2024-04-06 00:54:02,419: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T00:54:02.422972829Z [2024-04-06 00:54:02,422: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:54:02.446626543Z [2024-04-06 00:54:02,446: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T00:54:02.448045308Z [2024-04-06 00:54:02,447: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:54:02.448073530Z [2024-04-06 00:54:02,447: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:54:02.448262754Z [2024-04-06 00:54:02,448: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:54:02.448277435Z [2024-04-06 00:54:02,448: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T00:54:02.448526594Z [2024-04-06 00:54:02,448: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T00:54:02.448588858Z [2024-04-06 00:54:02,448: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:54:02.510342393Z [2024-04-06 00:54:02,510: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:54:02.539430649Z [2024-04-06 00:54:02,539: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:54:04.166599574Z [2024-04-06 00:54:04,166: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[146a69e9-5dab-4c12-bb72-905b442fae20] succeeded in 3.5286277089999203s: None 2024-04-06T00:54:04.204792615Z [2024-04-06 00:54:04,204: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[08514f39-5a4c-4ae0-b0e4-d41a56d04f72] succeeded in 3.565153180999914s: None 2024-04-06T00:55:00.464847398Z [2024-04-06 00:55:00,463: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c2115fff-d69d-4286-a3b7-40577109babd] received 2024-04-06T00:55:00.467301489Z [2024-04-06 00:55:00,465: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7bdcaf4b-610f-4144-9bcb-885b3133fef1] received 2024-04-06T00:55:00.474079930Z [2024-04-06 00:55:00,473: INFO/ForkPoolWorker-15] [c2115fff-d69d-4286-a3b7-40577109babd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T00:55:00.476482186Z [2024-04-06 00:55:00,476: INFO/ForkPoolWorker-16] [7bdcaf4b-610f-4144-9bcb-885b3133fef1] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T00:55:00.481893462Z [2024-04-06 00:55:00,481: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f72f8fa9-93ac-4c9b-93d1-3e771dd95f1f] received 2024-04-06T00:55:00.484323466Z [2024-04-06 00:55:00,484: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[110866e2-5c93-44c4-874e-cd42a473314e] received 2024-04-06T00:55:00.490802168Z [2024-04-06 00:55:00,490: INFO/ForkPoolWorker-1] [f72f8fa9-93ac-4c9b-93d1-3e771dd95f1f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T00:55:00.501223056Z [2024-04-06 00:55:00,500: INFO/ForkPoolWorker-2] [110866e2-5c93-44c4-874e-cd42a473314e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T00:55:00.830946470Z [2024-04-06 00:55:00,827: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T00:55:00.867779686Z [2024-04-06 00:55:00,863: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T00:55:00.926869848Z [2024-04-06 00:55:00,922: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T00:55:00.986516448Z [2024-04-06 00:55:00,977: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T00:55:01.107894475Z [2024-04-06 00:55:01,107: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-06T00:55:01.112192141Z [2024-04-06 00:55:01,111: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:55:01.153229591Z [2024-04-06 00:55:01,152: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T00:55:01.156552709Z [2024-04-06 00:55:01,155: INFO/ForkPoolWorker-16] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T00:55:01.157222838Z [2024-04-06 00:55:01,156: INFO/ForkPoolWorker-16] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T00:55:01.157682304Z [2024-04-06 00:55:01,157: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-06T00:55:01.158447742Z [2024-04-06 00:55:01,158: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T00:55:01.299107683Z [2024-04-06 00:55:01,298: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:55:02.006759489Z [2024-04-06 00:55:02,006: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7bdcaf4b-610f-4144-9bcb-885b3133fef1] succeeded in 1.5372278790000564s: None 2024-04-06T00:55:02.325143059Z [2024-04-06 00:55:02,324: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T00:55:02.331524952Z [2024-04-06 00:55:02,330: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:55:02.356353953Z [2024-04-06 00:55:02,356: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T00:55:02.360294974Z [2024-04-06 00:55:02,360: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:55:02.360408683Z [2024-04-06 00:55:02,360: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:55:02.360616373Z [2024-04-06 00:55:02,360: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:55:02.360654730Z [2024-04-06 00:55:02,360: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T00:55:02.360946501Z [2024-04-06 00:55:02,360: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T00:55:02.361018779Z [2024-04-06 00:55:02,360: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:55:02.375111985Z [2024-04-06 00:55:02,374: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-06T00:55:02.378567312Z [2024-04-06 00:55:02,378: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:55:02.412830498Z [2024-04-06 00:55:02,412: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T00:55:02.414832748Z [2024-04-06 00:55:02,414: INFO/ForkPoolWorker-2] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:55:02.415024060Z [2024-04-06 00:55:02,414: INFO/ForkPoolWorker-2] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:55:02.415747161Z [2024-04-06 00:55:02,415: INFO/ForkPoolWorker-2] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:55:02.416028559Z [2024-04-06 00:55:02,415: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-06T00:55:02.416739821Z [2024-04-06 00:55:02,416: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T00:55:02.416921501Z [2024-04-06 00:55:02,416: INFO/ForkPoolWorker-2] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:55:02.441237922Z [2024-04-06 00:55:02,440: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:55:02.514623555Z [2024-04-06 00:55:02,514: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:55:02.526608313Z [2024-04-06 00:55:02,526: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T00:55:02.530520975Z [2024-04-06 00:55:02,530: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:55:02.559294830Z [2024-04-06 00:55:02,559: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T00:55:02.560715655Z [2024-04-06 00:55:02,560: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:55:02.560780170Z [2024-04-06 00:55:02,560: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:55:02.561021671Z [2024-04-06 00:55:02,560: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:55:02.561091125Z [2024-04-06 00:55:02,560: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T00:55:02.561318268Z [2024-04-06 00:55:02,561: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T00:55:02.561346158Z [2024-04-06 00:55:02,561: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:55:02.656155986Z [2024-04-06 00:55:02,655: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:55:03.316713622Z [2024-04-06 00:55:03,316: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f81936ba-7810-4a3c-8c7e-9a0c458760ba] received 2024-04-06T00:55:03.333196101Z [2024-04-06 00:55:03,332: INFO/ForkPoolWorker-16] [f81936ba-7810-4a3c-8c7e-9a0c458760ba] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'split_metrics', 'scheduled__2024-04-06T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T00:55:03.369118363Z [2024-04-06 00:55:03,368: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f72f8fa9-93ac-4c9b-93d1-3e771dd95f1f] succeeded in 2.8847306210009265s: None 2024-04-06T00:55:03.596054587Z [2024-04-06 00:55:03,592: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T00:55:04.098933976Z [2024-04-06 00:55:04,098: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[110866e2-5c93-44c4-874e-cd42a473314e] succeeded in 3.6123541580000165s: None 2024-04-06T00:55:04.227034536Z [2024-04-06 00:55:04,226: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c2115fff-d69d-4286-a3b7-40577109babd] succeeded in 3.7605553020002844s: None 2024-04-06T00:55:04.862342411Z [2024-04-06 00:55:04,861: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T00:55:04.865923819Z [2024-04-06 00:55:04,865: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:55:04.890190915Z [2024-04-06 00:55:04,889: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T00:55:04.891831462Z [2024-04-06 00:55:04,891: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:55:04.891935202Z [2024-04-06 00:55:04,891: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:55:04.892147088Z [2024-04-06 00:55:04,891: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:55:04.892242226Z [2024-04-06 00:55:04,892: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T00:55:04.892655225Z [2024-04-06 00:55:04,892: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T00:55:04.892699179Z [2024-04-06 00:55:04,892: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:55:04.994287494Z [2024-04-06 00:55:04,993: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:55:05.725472243Z [2024-04-06 00:55:05,725: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4754c27e-851d-4afe-8afc-5a234e83f643] received 2024-04-06T00:55:05.748273960Z [2024-04-06 00:55:05,747: INFO/ForkPoolWorker-15] [4754c27e-851d-4afe-8afc-5a234e83f643] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'collect_metrics', 'scheduled__2024-04-06T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T00:55:05.760515815Z [2024-04-06 00:55:05,760: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f81936ba-7810-4a3c-8c7e-9a0c458760ba] succeeded in 2.437190794000344s: None 2024-04-06T00:55:06.026564141Z [2024-04-06 00:55:06,023: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T00:55:07.263826092Z [2024-04-06 00:55:07,263: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T00:55:07.267309881Z [2024-04-06 00:55:07,266: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:55:07.343014197Z [2024-04-06 00:55:07,342: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T00:55:07.345077516Z [2024-04-06 00:55:07,344: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:55:07.345469056Z [2024-04-06 00:55:07,344: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:55:07.345759511Z [2024-04-06 00:55:07,345: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:55:07.346129350Z [2024-04-06 00:55:07,345: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T00:55:07.346534907Z [2024-04-06 00:55:07,346: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T00:55:07.346771485Z [2024-04-06 00:55:07,346: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:55:07.461202606Z [2024-04-06 00:55:07,460: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:55:08.147624333Z [2024-04-06 00:55:08,147: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4754c27e-851d-4afe-8afc-5a234e83f643] succeeded in 2.4205170389996056s: None 2024-04-06T00:55:08.227402736Z [2024-04-06 00:55:08,227: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9c76e30c-d374-49c6-a4b5-9cc30cf3c179] received 2024-04-06T00:55:08.242200956Z [2024-04-06 00:55:08,241: INFO/ForkPoolWorker-15] [9c76e30c-d374-49c6-a4b5-9cc30cf3c179] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'send_prometheus', 'scheduled__2024-04-06T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T00:55:08.543330416Z [2024-04-06 00:55:08,539: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T00:55:09.754690470Z [2024-04-06 00:55:09,754: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T00:55:09.758058626Z [2024-04-06 00:55:09,757: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:55:09.781221322Z [2024-04-06 00:55:09,780: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T00:55:09.783068098Z [2024-04-06 00:55:09,782: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:55:09.783125045Z [2024-04-06 00:55:09,782: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:55:09.783434438Z [2024-04-06 00:55:09,783: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:55:09.783504664Z [2024-04-06 00:55:09,783: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T00:55:09.783875745Z [2024-04-06 00:55:09,783: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T00:55:09.784005011Z [2024-04-06 00:55:09,783: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:55:09.877407045Z [2024-04-06 00:55:09,877: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:55:10.728309859Z [2024-04-06 00:55:10,727: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9c76e30c-d374-49c6-a4b5-9cc30cf3c179] succeeded in 2.498126083000898s: None 2024-04-06T00:56:00.364871502Z [2024-04-06 00:56:00,364: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a7b860f0-cfd0-4a5f-a9a3-7bbd294a3915] received 2024-04-06T00:56:00.367787926Z [2024-04-06 00:56:00,367: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[908143f1-0c60-4b00-840f-9c341a39975f] received 2024-04-06T00:56:00.371911127Z [2024-04-06 00:56:00,371: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b360563b-44fb-4fe9-a527-f7f612da41ac] received 2024-04-06T00:56:00.373587476Z [2024-04-06 00:56:00,373: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ff706138-6189-4e10-897a-912ef8f038e4] received 2024-04-06T00:56:00.379553320Z [2024-04-06 00:56:00,379: INFO/ForkPoolWorker-16] [908143f1-0c60-4b00-840f-9c341a39975f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T00:56:00.386750413Z [2024-04-06 00:56:00,386: INFO/ForkPoolWorker-2] [ff706138-6189-4e10-897a-912ef8f038e4] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T00:56:00.387623159Z [2024-04-06 00:56:00,387: INFO/ForkPoolWorker-15] [a7b860f0-cfd0-4a5f-a9a3-7bbd294a3915] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T00:56:00.388640814Z [2024-04-06 00:56:00,388: INFO/ForkPoolWorker-1] [b360563b-44fb-4fe9-a527-f7f612da41ac] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T00:56:00.695703319Z [2024-04-06 00:56:00,692: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T00:56:00.754298948Z [2024-04-06 00:56:00,743: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T00:56:00.823286264Z [2024-04-06 00:56:00,818: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T00:56:00.841932649Z [2024-04-06 00:56:00,841: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-06T00:56:00.845507811Z [2024-04-06 00:56:00,845: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:56:00.871710167Z [2024-04-06 00:56:00,871: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T00:56:00.872693783Z [2024-04-06 00:56:00,872: INFO/ForkPoolWorker-2] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T00:56:00.872763003Z [2024-04-06 00:56:00,872: INFO/ForkPoolWorker-2] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T00:56:00.872829861Z [2024-04-06 00:56:00,872: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-06T00:56:00.873018592Z [2024-04-06 00:56:00,872: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T00:56:00.886266234Z [2024-04-06 00:56:00,882: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T00:56:00.961005495Z [2024-04-06 00:56:00,960: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:56:01.086264191Z [2024-04-06 00:56:01,085: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:56:01.629236632Z [2024-04-06 00:56:01,628: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[ff706138-6189-4e10-897a-912ef8f038e4] succeeded in 1.254095922999113s: None 2024-04-06T00:56:01.881362530Z [2024-04-06 00:56:01,880: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a7b860f0-cfd0-4a5f-a9a3-7bbd294a3915] succeeded in 1.5132972690007591s: None 2024-04-06T00:56:02.209011912Z [2024-04-06 00:56:02,208: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T00:56:02.212085266Z [2024-04-06 00:56:02,211: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:56:02.241314295Z [2024-04-06 00:56:02,241: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T00:56:02.242861110Z [2024-04-06 00:56:02,242: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:56:02.242944690Z [2024-04-06 00:56:02,242: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:56:02.243185526Z [2024-04-06 00:56:02,242: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:56:02.243201229Z [2024-04-06 00:56:02,243: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T00:56:02.243512968Z [2024-04-06 00:56:02,243: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-06T00:56:02.243528159Z [2024-04-06 00:56:02,243: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:56:02.298036214Z [2024-04-06 00:56:02,297: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T00:56:02.301584684Z [2024-04-06 00:56:02,301: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:56:02.325994367Z [2024-04-06 00:56:02,325: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T00:56:02.327520191Z [2024-04-06 00:56:02,327: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:56:02.327535730Z [2024-04-06 00:56:02,327: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:56:02.327791261Z [2024-04-06 00:56:02,327: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:56:02.327891733Z [2024-04-06 00:56:02,327: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T00:56:02.328730344Z [2024-04-06 00:56:02,328: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T00:56:02.328742696Z [2024-04-06 00:56:02,328: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:56:02.346978522Z [2024-04-06 00:56:02,346: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:56:02.422281905Z [2024-04-06 00:56:02,421: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:56:04.258530984Z [2024-04-06 00:56:04,250: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b360563b-44fb-4fe9-a527-f7f612da41ac] succeeded in 3.876734599998599s: None 2024-04-06T00:56:04.263973913Z [2024-04-06 00:56:04,263: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[908143f1-0c60-4b00-840f-9c341a39975f] succeeded in 3.894151447000695s: None 2024-04-06T00:57:00.238996088Z [2024-04-06 00:57:00,238: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[29a34003-f295-4877-a87e-fe2d9d70d292] received 2024-04-06T00:57:00.241277006Z [2024-04-06 00:57:00,240: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5ca7ca39-38a6-49ee-8af2-f0e5a45b72c4] received 2024-04-06T00:57:00.245013313Z [2024-04-06 00:57:00,244: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0502092f-ab32-493b-a32a-f9fbd48165b7] received 2024-04-06T00:57:00.257031956Z [2024-04-06 00:57:00,256: INFO/ForkPoolWorker-16] [5ca7ca39-38a6-49ee-8af2-f0e5a45b72c4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T00:57:00.257313998Z [2024-04-06 00:57:00,256: INFO/ForkPoolWorker-1] [0502092f-ab32-493b-a32a-f9fbd48165b7] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T00:57:00.259866153Z [2024-04-06 00:57:00,259: INFO/ForkPoolWorker-15] [29a34003-f295-4877-a87e-fe2d9d70d292] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T00:57:00.521346338Z [2024-04-06 00:57:00,518: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T00:57:00.568531224Z [2024-04-06 00:57:00,562: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T00:57:00.578098408Z [2024-04-06 00:57:00,573: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T00:57:00.752804376Z [2024-04-06 00:57:00,752: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-06T00:57:00.757242830Z [2024-04-06 00:57:00,756: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:57:00.790311204Z [2024-04-06 00:57:00,790: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T00:57:00.791869614Z [2024-04-06 00:57:00,791: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T00:57:00.792125473Z [2024-04-06 00:57:00,791: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T00:57:00.792327282Z [2024-04-06 00:57:00,792: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-06T00:57:00.792722212Z [2024-04-06 00:57:00,792: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T00:57:00.887350428Z [2024-04-06 00:57:00,887: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:57:01.592296096Z [2024-04-06 00:57:01,591: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0502092f-ab32-493b-a32a-f9fbd48165b7] succeeded in 1.3453859019991796s: None 2024-04-06T00:57:01.741568552Z [2024-04-06 00:57:01,741: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T00:57:01.744670873Z [2024-04-06 00:57:01,744: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:57:01.748411081Z [2024-04-06 00:57:01,747: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T00:57:01.751803035Z [2024-04-06 00:57:01,751: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:57:01.772491098Z [2024-04-06 00:57:01,772: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T00:57:01.772555662Z [2024-04-06 00:57:01,772: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T00:57:01.774159569Z [2024-04-06 00:57:01,773: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:57:01.774176203Z [2024-04-06 00:57:01,774: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:57:01.774338351Z [2024-04-06 00:57:01,774: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:57:01.774371587Z [2024-04-06 00:57:01,774: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T00:57:01.774548305Z [2024-04-06 00:57:01,774: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:57:01.774647250Z [2024-04-06 00:57:01,774: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T00:57:01.774672164Z [2024-04-06 00:57:01,774: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:57:01.774675946Z [2024-04-06 00:57:01,774: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:57:01.774883565Z [2024-04-06 00:57:01,774: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:57:01.775014343Z [2024-04-06 00:57:01,774: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T00:57:01.775300617Z [2024-04-06 00:57:01,775: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T00:57:01.775386605Z [2024-04-06 00:57:01,775: INFO/ForkPoolWorker-15] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:57:01.862403085Z [2024-04-06 00:57:01,861: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:57:01.862672240Z [2024-04-06 00:57:01,862: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:57:03.543465473Z [2024-04-06 00:57:03,542: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[29a34003-f295-4877-a87e-fe2d9d70d292] succeeded in 3.3019180279989087s: None 2024-04-06T00:57:03.777914881Z [2024-04-06 00:57:03,776: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5ca7ca39-38a6-49ee-8af2-f0e5a45b72c4] succeeded in 3.5339668320011697s: None 2024-04-06T00:58:00.248774868Z [2024-04-06 00:58:00,248: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8c9a9d5b-c57e-4518-927c-a5452c45b929] received 2024-04-06T00:58:00.253082538Z [2024-04-06 00:58:00,252: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[08e79fc0-7ed9-45e3-8d60-775d6bd723e9] received 2024-04-06T00:58:00.258021921Z [2024-04-06 00:58:00,257: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[617b4279-3495-426e-a2aa-f56bd3e0d802] received 2024-04-06T00:58:00.260954872Z [2024-04-06 00:58:00,260: INFO/ForkPoolWorker-15] [8c9a9d5b-c57e-4518-927c-a5452c45b929] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T00:58:00.261925736Z [2024-04-06 00:58:00,261: INFO/ForkPoolWorker-16] [08e79fc0-7ed9-45e3-8d60-775d6bd723e9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T00:58:00.271197562Z [2024-04-06 00:58:00,270: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[133d8f8a-ddb4-4565-897b-e1064f6b8108] received 2024-04-06T00:58:00.272065218Z [2024-04-06 00:58:00,271: INFO/ForkPoolWorker-1] [617b4279-3495-426e-a2aa-f56bd3e0d802] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T00:58:00.287875009Z [2024-04-06 00:58:00,286: INFO/ForkPoolWorker-2] [133d8f8a-ddb4-4565-897b-e1064f6b8108] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T00:58:00.556049544Z [2024-04-06 00:58:00,551: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T00:58:00.626715326Z [2024-04-06 00:58:00,622: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T00:58:00.648797846Z [2024-04-06 00:58:00,644: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T00:58:00.763845747Z [2024-04-06 00:58:00,760: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T00:58:00.830334394Z [2024-04-06 00:58:00,830: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:58:00.951814393Z [2024-04-06 00:58:00,951: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-06T00:58:00.956492582Z [2024-04-06 00:58:00,956: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:58:00.996527519Z [2024-04-06 00:58:00,996: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T00:58:00.998004682Z [2024-04-06 00:58:00,997: INFO/ForkPoolWorker-2] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T00:58:00.998244240Z [2024-04-06 00:58:00,998: INFO/ForkPoolWorker-2] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T00:58:00.998448832Z [2024-04-06 00:58:00,998: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-06T00:58:00.999022254Z [2024-04-06 00:58:00,998: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T00:58:01.133113120Z [2024-04-06 00:58:01,132: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:58:01.438901891Z [2024-04-06 00:58:01,438: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8c9a9d5b-c57e-4518-927c-a5452c45b929] succeeded in 1.187885097000617s: None 2024-04-06T00:58:01.773082536Z [2024-04-06 00:58:01,772: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[133d8f8a-ddb4-4565-897b-e1064f6b8108] succeeded in 1.4970222330011893s: None 2024-04-06T00:58:02.006930513Z [2024-04-06 00:58:02,006: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T00:58:02.010560005Z [2024-04-06 00:58:02,009: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:58:02.036868971Z [2024-04-06 00:58:02,036: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T00:58:02.040059054Z [2024-04-06 00:58:02,039: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:58:02.043516442Z [2024-04-06 00:58:02,043: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T00:58:02.046103808Z [2024-04-06 00:58:02,045: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:58:02.046333363Z [2024-04-06 00:58:02,046: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:58:02.046683433Z [2024-04-06 00:58:02,046: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:58:02.046907830Z [2024-04-06 00:58:02,046: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T00:58:02.047630612Z [2024-04-06 00:58:02,047: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T00:58:02.047871752Z [2024-04-06 00:58:02,047: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:58:02.068278210Z [2024-04-06 00:58:02,067: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T00:58:02.069829147Z [2024-04-06 00:58:02,069: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:58:02.069850173Z [2024-04-06 00:58:02,069: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:58:02.069998480Z [2024-04-06 00:58:02,069: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:58:02.070060625Z [2024-04-06 00:58:02,069: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T00:58:02.070310574Z [2024-04-06 00:58:02,070: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T00:58:02.070378554Z [2024-04-06 00:58:02,070: INFO/ForkPoolWorker-1] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:58:02.156667331Z [2024-04-06 00:58:02,156: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:58:02.176429474Z [2024-04-06 00:58:02,175: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:58:03.700650784Z [2024-04-06 00:58:03,699: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[617b4279-3495-426e-a2aa-f56bd3e0d802] succeeded in 3.4384211950000463s: None 2024-04-06T00:58:04.067976061Z [2024-04-06 00:58:04,067: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[08e79fc0-7ed9-45e3-8d60-775d6bd723e9] succeeded in 3.8127738889998s: None 2024-04-06T00:59:01.280522449Z [2024-04-06 00:59:01,279: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[67833752-35f8-4853-bb5b-4ca73dc8abd3] received 2024-04-06T00:59:01.289606380Z [2024-04-06 00:59:01,289: INFO/ForkPoolWorker-15] [67833752-35f8-4853-bb5b-4ca73dc8abd3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T00:59:01.307698817Z [2024-04-06 00:59:01,307: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e989bf2d-37d3-4566-bcb9-f3318317a8b6] received 2024-04-06T00:59:01.313553527Z [2024-04-06 00:59:01,313: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6ba0620c-b409-44f3-b92c-df7bf4ae8a25] received 2024-04-06T00:59:01.323777023Z [2024-04-06 00:59:01,323: INFO/ForkPoolWorker-1] [6ba0620c-b409-44f3-b92c-df7bf4ae8a25] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T00:59:01.328078005Z [2024-04-06 00:59:01,327: INFO/ForkPoolWorker-16] [e989bf2d-37d3-4566-bcb9-f3318317a8b6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T00:59:01.624047320Z [2024-04-06 00:59:01,620: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T00:59:01.656889587Z [2024-04-06 00:59:01,653: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T00:59:01.716576243Z [2024-04-06 00:59:01,713: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T00:59:01.825809185Z [2024-04-06 00:59:01,825: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-06T00:59:01.829817131Z [2024-04-06 00:59:01,829: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:59:01.852144334Z [2024-04-06 00:59:01,851: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T00:59:01.853681867Z [2024-04-06 00:59:01,853: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T00:59:01.853856047Z [2024-04-06 00:59:01,853: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T00:59:01.854046475Z [2024-04-06 00:59:01,853: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-06T00:59:01.854611286Z [2024-04-06 00:59:01,854: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T00:59:01.967724152Z [2024-04-06 00:59:01,967: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:59:02.638055872Z [2024-04-06 00:59:02,637: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6ba0620c-b409-44f3-b92c-df7bf4ae8a25] succeeded in 1.3217512179999176s: None 2024-04-06T00:59:02.832833930Z [2024-04-06 00:59:02,832: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T00:59:02.836199754Z [2024-04-06 00:59:02,835: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:59:02.859483958Z [2024-04-06 00:59:02,859: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T00:59:02.862150363Z [2024-04-06 00:59:02,861: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:59:02.862179270Z [2024-04-06 00:59:02,862: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:59:02.862552444Z [2024-04-06 00:59:02,862: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:59:02.862786028Z [2024-04-06 00:59:02,862: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T00:59:02.863749586Z [2024-04-06 00:59:02,863: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T00:59:02.863982023Z [2024-04-06 00:59:02,863: INFO/ForkPoolWorker-15] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:59:02.976150281Z [2024-04-06 00:59:02,975: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:59:03.116399006Z [2024-04-06 00:59:03,116: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T00:59:03.119698611Z [2024-04-06 00:59:03,119: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T00:59:03.145103246Z [2024-04-06 00:59:03,144: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T00:59:03.146633553Z [2024-04-06 00:59:03,146: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T00:59:03.146675198Z [2024-04-06 00:59:03,146: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T00:59:03.146814770Z [2024-04-06 00:59:03,146: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T00:59:03.146908845Z [2024-04-06 00:59:03,146: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T00:59:03.147196917Z [2024-04-06 00:59:03,147: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T00:59:03.147371859Z [2024-04-06 00:59:03,147: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T00:59:03.232491913Z [2024-04-06 00:59:03,232: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T00:59:04.747779692Z [2024-04-06 00:59:04,747: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[67833752-35f8-4853-bb5b-4ca73dc8abd3] succeeded in 3.4649461479984893s: None 2024-04-06T00:59:05.438897588Z [2024-04-06 00:59:05,438: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e989bf2d-37d3-4566-bcb9-f3318317a8b6] succeeded in 4.126221565000378s: None 2024-04-06T01:00:00.475159873Z [2024-04-06 01:00:00,474: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1865ef58-13a0-409e-b553-21d67bd721aa] received 2024-04-06T01:00:00.478002764Z [2024-04-06 01:00:00,477: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[613d1013-8524-4e9e-9ea5-32c3bcafde39] received 2024-04-06T01:00:00.482670495Z [2024-04-06 01:00:00,482: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1962b6a5-0a81-4790-9638-cd085e24ed06] received 2024-04-06T01:00:00.485595564Z [2024-04-06 01:00:00,485: INFO/ForkPoolWorker-15] [1865ef58-13a0-409e-b553-21d67bd721aa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T01:00:00.486431151Z [2024-04-06 01:00:00,486: INFO/ForkPoolWorker-16] [613d1013-8524-4e9e-9ea5-32c3bcafde39] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:00:00.486775413Z [2024-04-06 01:00:00,486: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[37a1fb0d-40d9-4adb-9b55-899b929004a3] received 2024-04-06T01:00:00.495960987Z [2024-04-06 01:00:00,495: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[07f055cb-400b-4336-bd91-35a65691cdf9] received 2024-04-06T01:00:00.498390456Z [2024-04-06 01:00:00,498: INFO/ForkPoolWorker-1] [1962b6a5-0a81-4790-9638-cd085e24ed06] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T01:00:00.499009136Z [2024-04-06 01:00:00,498: INFO/ForkPoolWorker-2] [37a1fb0d-40d9-4adb-9b55-899b929004a3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:00:00.511030266Z [2024-04-06 01:00:00,510: INFO/ForkPoolWorker-3] [07f055cb-400b-4336-bd91-35a65691cdf9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T00:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T01:00:00.822499935Z [2024-04-06 01:00:00,819: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T01:00:00.864663192Z [2024-04-06 01:00:00,861: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T01:00:00.927274072Z [2024-04-06 01:00:00,920: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:00:00.967874983Z [2024-04-06 01:00:00,964: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T01:00:01.039278888Z [2024-04-06 01:00:01,038: INFO/ForkPoolWorker-3] Getting SDNC list 2024-04-06T01:00:01.043499826Z [2024-04-06 01:00:01,043: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:00:01.072360292Z [2024-04-06 01:00:01,072: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-06T01:00:01.073449690Z [2024-04-06 01:00:01,073: INFO/ForkPoolWorker-3] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T01:00:01.073641256Z [2024-04-06 01:00:01,073: INFO/ForkPoolWorker-3] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T01:00:01.073695530Z [2024-04-06 01:00:01,073: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-04-06T01:00:01.073899665Z [2024-04-06 01:00:01,073: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T01:00:01.116627867Z [2024-04-06 01:00:01,113: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:00:01.247590089Z [2024-04-06 01:00:01,247: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:00:01.315479092Z [2024-04-06 01:00:01,315: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:00:02.024290272Z [2024-04-06 01:00:02,023: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1962b6a5-0a81-4790-9638-cd085e24ed06] succeeded in 1.5366534779986978s: None 2024-04-06T01:00:02.097037466Z [2024-04-06 01:00:02,096: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[07f055cb-400b-4336-bd91-35a65691cdf9] succeeded in 1.5951306940005452s: None 2024-04-06T01:00:02.573137546Z [2024-04-06 01:00:02,572: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-06T01:00:02.576821692Z [2024-04-06 01:00:02,576: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:00:02.600205142Z [2024-04-06 01:00:02,599: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T01:00:02.601673633Z [2024-04-06 01:00:02,601: INFO/ForkPoolWorker-2] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:00:02.601862551Z [2024-04-06 01:00:02,601: INFO/ForkPoolWorker-2] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:00:02.602074456Z [2024-04-06 01:00:02,601: INFO/ForkPoolWorker-2] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:00:02.602207287Z [2024-04-06 01:00:02,602: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-06T01:00:02.602531428Z [2024-04-06 01:00:02,602: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:00:02.602659743Z [2024-04-06 01:00:02,602: INFO/ForkPoolWorker-2] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:00:02.717303048Z [2024-04-06 01:00:02,715: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:00:02.725624197Z [2024-04-06 01:00:02,725: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:00:02.738195128Z [2024-04-06 01:00:02,737: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:00:02.790501086Z [2024-04-06 01:00:02,790: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:00:02.808531424Z [2024-04-06 01:00:02,807: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:00:02.820449369Z [2024-04-06 01:00:02,820: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:00:02.821958432Z [2024-04-06 01:00:02,821: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:00:02.822007461Z [2024-04-06 01:00:02,821: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:00:02.822171883Z [2024-04-06 01:00:02,821: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:00:02.822263915Z [2024-04-06 01:00:02,822: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:00:02.822854607Z [2024-04-06 01:00:02,822: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:00:02.827349831Z [2024-04-06 01:00:02,822: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:00:02.840915614Z [2024-04-06 01:00:02,840: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:00:02.845093793Z [2024-04-06 01:00:02,844: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:00:02.845177126Z [2024-04-06 01:00:02,845: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:00:02.845364726Z [2024-04-06 01:00:02,845: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:00:02.845459792Z [2024-04-06 01:00:02,845: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:00:02.845755087Z [2024-04-06 01:00:02,845: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T01:00:02.845856151Z [2024-04-06 01:00:02,845: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:00:02.911925405Z [2024-04-06 01:00:02,911: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:00:02.962270604Z [2024-04-06 01:00:02,961: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:00:03.633970921Z [2024-04-06 01:00:03,633: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1865ef58-13a0-409e-b553-21d67bd721aa] succeeded in 3.156361471999844s: None 2024-04-06T01:00:03.883120928Z [2024-04-06 01:00:03,882: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8d7bb59b-cedb-4785-ba56-d42b3f3f4135] received 2024-04-06T01:00:03.890961187Z [2024-04-06 01:00:03,890: INFO/ForkPoolWorker-15] [8d7bb59b-cedb-4785-ba56-d42b3f3f4135] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'split_metrics', 'scheduled__2024-04-06T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T01:00:04.210485436Z [2024-04-06 01:00:04,207: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T01:00:04.459469819Z [2024-04-06 01:00:04,457: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[37a1fb0d-40d9-4adb-9b55-899b929004a3] succeeded in 3.965818454998953s: None 2024-04-06T01:00:04.822177019Z [2024-04-06 01:00:04,821: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[613d1013-8524-4e9e-9ea5-32c3bcafde39] succeeded in 4.342418952999651s: None 2024-04-06T01:00:05.369802428Z [2024-04-06 01:00:05,369: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:00:05.372990702Z [2024-04-06 01:00:05,372: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:00:05.395411460Z [2024-04-06 01:00:05,395: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:00:05.396763806Z [2024-04-06 01:00:05,396: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:00:05.396948583Z [2024-04-06 01:00:05,396: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:00:05.397162105Z [2024-04-06 01:00:05,396: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:00:05.397284937Z [2024-04-06 01:00:05,397: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:00:05.397564753Z [2024-04-06 01:00:05,397: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T01:00:05.397751318Z [2024-04-06 01:00:05,397: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:00:05.496161508Z [2024-04-06 01:00:05,495: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:00:06.170979364Z [2024-04-06 01:00:06,170: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8d7bb59b-cedb-4785-ba56-d42b3f3f4135] succeeded in 2.2855136189991754s: None 2024-04-06T01:00:06.173724501Z [2024-04-06 01:00:06,173: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[09d215ff-4516-4e65-8bdd-b7702285fa81] received 2024-04-06T01:00:06.184090379Z [2024-04-06 01:00:06,183: INFO/ForkPoolWorker-15] [09d215ff-4516-4e65-8bdd-b7702285fa81] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'collect_metrics', 'scheduled__2024-04-06T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T01:00:06.523051218Z [2024-04-06 01:00:06,519: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T01:00:07.634953875Z [2024-04-06 01:00:07,634: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:00:07.638284344Z [2024-04-06 01:00:07,637: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:00:07.664337506Z [2024-04-06 01:00:07,663: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:00:07.666470536Z [2024-04-06 01:00:07,666: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:00:07.666481719Z [2024-04-06 01:00:07,666: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:00:07.666625996Z [2024-04-06 01:00:07,666: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:00:07.666634045Z [2024-04-06 01:00:07,666: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:00:07.667038794Z [2024-04-06 01:00:07,666: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T01:00:07.667149181Z [2024-04-06 01:00:07,666: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:00:07.795921455Z [2024-04-06 01:00:07,795: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:00:08.366986594Z [2024-04-06 01:00:08,366: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[09d215ff-4516-4e65-8bdd-b7702285fa81] succeeded in 2.190205220998905s: None 2024-04-06T01:00:08.536262159Z [2024-04-06 01:00:08,535: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1c01116d-05cc-49bb-9205-b0f937381d72] received 2024-04-06T01:00:08.547344968Z [2024-04-06 01:00:08,546: INFO/ForkPoolWorker-15] [1c01116d-05cc-49bb-9205-b0f937381d72] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'send_prometheus', 'scheduled__2024-04-06T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T01:00:08.819721670Z [2024-04-06 01:00:08,816: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T01:00:10.094582464Z [2024-04-06 01:00:10,094: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:00:10.098438519Z [2024-04-06 01:00:10,098: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:00:10.121650296Z [2024-04-06 01:00:10,121: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:00:10.123148336Z [2024-04-06 01:00:10,122: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:00:10.123216516Z [2024-04-06 01:00:10,123: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:00:10.123418665Z [2024-04-06 01:00:10,123: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:00:10.123498589Z [2024-04-06 01:00:10,123: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:00:10.123859188Z [2024-04-06 01:00:10,123: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T01:00:10.123942781Z [2024-04-06 01:00:10,123: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:00:10.253024267Z [2024-04-06 01:00:10,252: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:00:10.893000364Z [2024-04-06 01:00:10,892: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1c01116d-05cc-49bb-9205-b0f937381d72] succeeded in 2.35399216299993s: None 2024-04-06T01:01:00.715443201Z [2024-04-06 01:01:00,714: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ed150bee-74ba-469f-8b7d-5402f3484213] received 2024-04-06T01:01:00.724379016Z [2024-04-06 01:01:00,724: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5b2f360a-442e-4b35-9a4e-f484635df415] received 2024-04-06T01:01:00.733239737Z [2024-04-06 01:01:00,732: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ca760b58-79b5-484c-91f5-8a6890a638d7] received 2024-04-06T01:01:00.733308524Z [2024-04-06 01:01:00,733: INFO/ForkPoolWorker-15] [ed150bee-74ba-469f-8b7d-5402f3484213] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:01:00.744431032Z [2024-04-06 01:01:00,744: INFO/ForkPoolWorker-16] [5b2f360a-442e-4b35-9a4e-f484635df415] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:01:00.749435303Z [2024-04-06 01:01:00,749: INFO/ForkPoolWorker-1] [ca760b58-79b5-484c-91f5-8a6890a638d7] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T01:01:01.021096256Z [2024-04-06 01:01:01,017: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T01:01:01.025168530Z [2024-04-06 01:01:01,021: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:01:01.038902388Z [2024-04-06 01:01:01,035: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:01:01.235617951Z [2024-04-06 01:01:01,235: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-06T01:01:01.239857918Z [2024-04-06 01:01:01,239: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:01:01.283243823Z [2024-04-06 01:01:01,282: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T01:01:01.286136152Z [2024-04-06 01:01:01,285: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T01:01:01.286924777Z [2024-04-06 01:01:01,286: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T01:01:01.287206854Z [2024-04-06 01:01:01,286: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-06T01:01:01.288121921Z [2024-04-06 01:01:01,287: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T01:01:01.442631074Z [2024-04-06 01:01:01,442: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:01:02.050815722Z [2024-04-06 01:01:02,050: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ca760b58-79b5-484c-91f5-8a6890a638d7] succeeded in 1.3139837499984424s: None 2024-04-06T01:01:02.346869724Z [2024-04-06 01:01:02,346: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:01:02.350134816Z [2024-04-06 01:01:02,349: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:01:02.351868549Z [2024-04-06 01:01:02,351: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:01:02.355474003Z [2024-04-06 01:01:02,355: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:01:02.382922951Z [2024-04-06 01:01:02,382: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:01:02.383571534Z [2024-04-06 01:01:02,383: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:01:02.384947115Z [2024-04-06 01:01:02,384: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:01:02.385023353Z [2024-04-06 01:01:02,384: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:01:02.385247623Z [2024-04-06 01:01:02,385: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:01:02.385400315Z [2024-04-06 01:01:02,385: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:01:02.385481062Z [2024-04-06 01:01:02,385: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:01:02.385695415Z [2024-04-06 01:01:02,385: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:01:02.385858454Z [2024-04-06 01:01:02,385: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:01:02.386161861Z [2024-04-06 01:01:02,385: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:01:02.386398704Z [2024-04-06 01:01:02,386: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:01:02.386609809Z [2024-04-06 01:01:02,386: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:01:02.386985078Z [2024-04-06 01:01:02,386: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:01:02.387455605Z [2024-04-06 01:01:02,387: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:01:02.479475156Z [2024-04-06 01:01:02,479: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:01:02.480313494Z [2024-04-06 01:01:02,480: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:01:04.102331124Z [2024-04-06 01:01:04,101: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5b2f360a-442e-4b35-9a4e-f484635df415] succeeded in 3.374260573000356s: None 2024-04-06T01:01:04.487540433Z [2024-04-06 01:01:04,486: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ed150bee-74ba-469f-8b7d-5402f3484213] succeeded in 3.766178690999368s: None 2024-04-06T01:02:00.456832926Z [2024-04-06 01:02:00,456: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bb9f314d-09d7-4f02-a9b4-4833e047bf4c] received 2024-04-06T01:02:00.463601007Z [2024-04-06 01:02:00,460: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cb0ae356-31f7-4110-a88c-fbf38efe95c0] received 2024-04-06T01:02:00.473625895Z [2024-04-06 01:02:00,473: INFO/ForkPoolWorker-16] [cb0ae356-31f7-4110-a88c-fbf38efe95c0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:02:00.474532958Z [2024-04-06 01:02:00,474: INFO/ForkPoolWorker-15] [bb9f314d-09d7-4f02-a9b4-4833e047bf4c] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T01:02:00.474561766Z [2024-04-06 01:02:00,474: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a8218258-bfff-4845-bcc1-0808e90e016a] received 2024-04-06T01:02:00.479840744Z [2024-04-06 01:02:00,479: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[567cda76-e5dc-49f8-ba55-0fb67e82d8c4] received 2024-04-06T01:02:00.487590362Z [2024-04-06 01:02:00,487: INFO/ForkPoolWorker-1] [a8218258-bfff-4845-bcc1-0808e90e016a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:02:00.494071415Z [2024-04-06 01:02:00,493: INFO/ForkPoolWorker-2] [567cda76-e5dc-49f8-ba55-0fb67e82d8c4] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T01:02:00.783039769Z [2024-04-06 01:02:00,779: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T01:02:00.790284097Z [2024-04-06 01:02:00,787: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:02:00.830260501Z [2024-04-06 01:02:00,825: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T01:02:00.851542567Z [2024-04-06 01:02:00,841: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:02:00.997953764Z [2024-04-06 01:02:00,997: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-06T01:02:01.001868358Z [2024-04-06 01:02:01,001: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:02:01.046436327Z [2024-04-06 01:02:01,046: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T01:02:01.051384716Z [2024-04-06 01:02:01,050: INFO/ForkPoolWorker-2] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T01:02:01.051605275Z [2024-04-06 01:02:01,051: INFO/ForkPoolWorker-2] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T01:02:01.051693358Z [2024-04-06 01:02:01,051: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-06T01:02:01.052090352Z [2024-04-06 01:02:01,051: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T01:02:01.134935118Z [2024-04-06 01:02:01,134: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:02:01.163538012Z [2024-04-06 01:02:01,163: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:02:01.668811844Z [2024-04-06 01:02:01,668: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bb9f314d-09d7-4f02-a9b4-4833e047bf4c] succeeded in 1.208763247999741s: None 2024-04-06T01:02:01.741600666Z [2024-04-06 01:02:01,741: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[567cda76-e5dc-49f8-ba55-0fb67e82d8c4] succeeded in 1.2586824480003997s: None 2024-04-06T01:02:02.040292958Z [2024-04-06 01:02:02,039: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T01:02:02.044382030Z [2024-04-06 01:02:02,043: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:02:02.067241316Z [2024-04-06 01:02:02,067: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T01:02:02.068875054Z [2024-04-06 01:02:02,068: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:02:02.069081813Z [2024-04-06 01:02:02,068: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:02:02.069297718Z [2024-04-06 01:02:02,069: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:02:02.069465564Z [2024-04-06 01:02:02,069: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T01:02:02.069774336Z [2024-04-06 01:02:02,069: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:02:02.069991681Z [2024-04-06 01:02:02,069: INFO/ForkPoolWorker-1] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:02:02.169832536Z [2024-04-06 01:02:02,169: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:02:02.299297794Z [2024-04-06 01:02:02,298: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:02:02.303431806Z [2024-04-06 01:02:02,302: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:02:02.327351612Z [2024-04-06 01:02:02,327: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:02:02.328751060Z [2024-04-06 01:02:02,328: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:02:02.328763318Z [2024-04-06 01:02:02,328: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:02:02.328932647Z [2024-04-06 01:02:02,328: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:02:02.328971397Z [2024-04-06 01:02:02,328: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:02:02.329297803Z [2024-04-06 01:02:02,329: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:02:02.329304023Z [2024-04-06 01:02:02,329: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:02:02.429983209Z [2024-04-06 01:02:02,429: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:02:03.878319546Z [2024-04-06 01:02:03,877: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a8218258-bfff-4845-bcc1-0808e90e016a] succeeded in 3.396638633999828s: None 2024-04-06T01:02:04.545158075Z [2024-04-06 01:02:04,544: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[cb0ae356-31f7-4110-a88c-fbf38efe95c0] succeeded in 4.07858800699978s: None 2024-04-06T01:03:01.231475925Z [2024-04-06 01:03:01,231: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e4535406-4a28-4615-b019-3c7f2edb9008] received 2024-04-06T01:03:01.238577787Z [2024-04-06 01:03:01,238: INFO/ForkPoolWorker-15] [e4535406-4a28-4615-b019-3c7f2edb9008] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:03:01.241363065Z [2024-04-06 01:03:01,241: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[77652acb-97ce-4c79-a8e9-1a282f5f0aaa] received 2024-04-06T01:03:01.247400211Z [2024-04-06 01:03:01,247: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fe104de0-221e-40bc-8243-4528b0e3f670] received 2024-04-06T01:03:01.249358491Z [2024-04-06 01:03:01,249: INFO/ForkPoolWorker-16] [77652acb-97ce-4c79-a8e9-1a282f5f0aaa] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T01:03:01.260842015Z [2024-04-06 01:03:01,257: INFO/ForkPoolWorker-1] [fe104de0-221e-40bc-8243-4528b0e3f670] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:03:01.546648000Z [2024-04-06 01:03:01,543: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T01:03:01.581986060Z [2024-04-06 01:03:01,578: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:03:01.627883592Z [2024-04-06 01:03:01,623: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:03:01.706063251Z [2024-04-06 01:03:01,705: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-06T01:03:01.710237927Z [2024-04-06 01:03:01,709: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:03:01.741801610Z [2024-04-06 01:03:01,741: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:03:01.743818107Z [2024-04-06 01:03:01,743: INFO/ForkPoolWorker-16] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T01:03:01.743930977Z [2024-04-06 01:03:01,743: INFO/ForkPoolWorker-16] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T01:03:01.744061078Z [2024-04-06 01:03:01,743: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-06T01:03:01.744710462Z [2024-04-06 01:03:01,744: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T01:03:01.849008432Z [2024-04-06 01:03:01,848: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:03:02.425496884Z [2024-04-06 01:03:02,424: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[77652acb-97ce-4c79-a8e9-1a282f5f0aaa] succeeded in 1.1822224869993079s: None 2024-04-06T01:03:02.848643400Z [2024-04-06 01:03:02,848: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:03:02.851907017Z [2024-04-06 01:03:02,851: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:03:02.870636472Z [2024-04-06 01:03:02,870: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:03:02.872006616Z [2024-04-06 01:03:02,871: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:03:02.872049410Z [2024-04-06 01:03:02,871: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:03:02.872175265Z [2024-04-06 01:03:02,871: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:03:02.872293498Z [2024-04-06 01:03:02,872: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:03:02.872764813Z [2024-04-06 01:03:02,872: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:03:02.872864428Z [2024-04-06 01:03:02,872: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:03:02.890866734Z [2024-04-06 01:03:02,890: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T01:03:02.894111047Z [2024-04-06 01:03:02,893: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:03:02.916198704Z [2024-04-06 01:03:02,915: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T01:03:02.917690272Z [2024-04-06 01:03:02,917: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:03:02.917858567Z [2024-04-06 01:03:02,917: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:03:02.918102501Z [2024-04-06 01:03:02,917: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:03:02.918251434Z [2024-04-06 01:03:02,918: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T01:03:02.918587365Z [2024-04-06 01:03:02,918: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:03:02.918747171Z [2024-04-06 01:03:02,918: INFO/ForkPoolWorker-1] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:03:02.946936768Z [2024-04-06 01:03:02,946: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:03:02.999572000Z [2024-04-06 01:03:02,999: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:03:05.158371176Z [2024-04-06 01:03:05,157: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[fe104de0-221e-40bc-8243-4528b0e3f670] succeeded in 3.9093286560000706s: None 2024-04-06T01:03:05.842051370Z [2024-04-06 01:03:05,841: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e4535406-4a28-4615-b019-3c7f2edb9008] succeeded in 4.6086808809996s: None 2024-04-06T01:04:00.983912875Z [2024-04-06 01:04:00,983: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d284d07d-a0f4-4b5a-95fd-7a9191b13ba5] received 2024-04-06T01:04:00.989707283Z [2024-04-06 01:04:00,988: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[55d3db5b-3e9d-4383-b2bf-f50f09536620] received 2024-04-06T01:04:00.994029322Z [2024-04-06 01:04:00,993: INFO/ForkPoolWorker-15] [d284d07d-a0f4-4b5a-95fd-7a9191b13ba5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:04:01.009317800Z [2024-04-06 01:04:01,008: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[25bfb806-8fc1-448c-b95c-e9fdb1af2cc3] received 2024-04-06T01:04:01.017977143Z [2024-04-06 01:04:01,017: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[008a136d-ca5d-4222-ac3e-3ed2494f085e] received 2024-04-06T01:04:01.023233403Z [2024-04-06 01:04:01,022: INFO/ForkPoolWorker-16] [55d3db5b-3e9d-4383-b2bf-f50f09536620] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T01:04:01.030813238Z [2024-04-06 01:04:01,030: INFO/ForkPoolWorker-2] [008a136d-ca5d-4222-ac3e-3ed2494f085e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:04:01.044170681Z [2024-04-06 01:04:01,043: INFO/ForkPoolWorker-1] [25bfb806-8fc1-448c-b95c-e9fdb1af2cc3] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T01:04:01.416770849Z [2024-04-06 01:04:01,413: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:04:01.488971940Z [2024-04-06 01:04:01,485: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T01:04:01.553918966Z [2024-04-06 01:04:01,550: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:04:01.586546629Z [2024-04-06 01:04:01,583: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T01:04:01.732904279Z [2024-04-06 01:04:01,732: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:04:01.788915802Z [2024-04-06 01:04:01,788: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-06T01:04:01.793294134Z [2024-04-06 01:04:01,792: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:04:01.840805436Z [2024-04-06 01:04:01,840: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T01:04:01.844784742Z [2024-04-06 01:04:01,844: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T01:04:01.845105166Z [2024-04-06 01:04:01,844: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T01:04:01.845344987Z [2024-04-06 01:04:01,845: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-06T01:04:01.846005598Z [2024-04-06 01:04:01,845: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T01:04:01.993606144Z [2024-04-06 01:04:01,993: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:04:02.424584636Z [2024-04-06 01:04:02,424: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[55d3db5b-3e9d-4383-b2bf-f50f09536620] succeeded in 1.4113132709990168s: None 2024-04-06T01:04:02.641741152Z [2024-04-06 01:04:02,641: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[25bfb806-8fc1-448c-b95c-e9fdb1af2cc3] succeeded in 1.6265360079996753s: None 2024-04-06T01:04:02.814668094Z [2024-04-06 01:04:02,814: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:04:02.818129890Z [2024-04-06 01:04:02,817: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:04:02.845116920Z [2024-04-06 01:04:02,844: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:04:02.846716609Z [2024-04-06 01:04:02,846: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:04:02.846964590Z [2024-04-06 01:04:02,846: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:04:02.847219836Z [2024-04-06 01:04:02,847: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:04:02.847465959Z [2024-04-06 01:04:02,847: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:04:02.848120368Z [2024-04-06 01:04:02,847: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:04:02.848318365Z [2024-04-06 01:04:02,848: INFO/ForkPoolWorker-15] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:04:02.957512178Z [2024-04-06 01:04:02,957: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:04:03.021844444Z [2024-04-06 01:04:03,021: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-06T01:04:03.025340172Z [2024-04-06 01:04:03,024: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:04:03.053461773Z [2024-04-06 01:04:03,053: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T01:04:03.054944040Z [2024-04-06 01:04:03,054: INFO/ForkPoolWorker-2] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:04:03.055217628Z [2024-04-06 01:04:03,055: INFO/ForkPoolWorker-2] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:04:03.055465512Z [2024-04-06 01:04:03,055: INFO/ForkPoolWorker-2] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:04:03.055654408Z [2024-04-06 01:04:03,055: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-06T01:04:03.056105973Z [2024-04-06 01:04:03,055: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:04:03.056353852Z [2024-04-06 01:04:03,056: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:04:03.136897027Z [2024-04-06 01:04:03,136: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:04:04.570972382Z [2024-04-06 01:04:04,570: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d284d07d-a0f4-4b5a-95fd-7a9191b13ba5] succeeded in 3.584623182001451s: None 2024-04-06T01:04:05.120516635Z [2024-04-06 01:04:05,119: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[008a136d-ca5d-4222-ac3e-3ed2494f085e] succeeded in 4.098066676000599s: None 2024-04-06T01:05:00.711622226Z [2024-04-06 01:05:00,711: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3f61d688-0faf-4aac-b60b-cf438a424a1e] received 2024-04-06T01:05:00.720778524Z [2024-04-06 01:05:00,720: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c05f1673-0d39-427c-94b3-2aebbc920b31] received 2024-04-06T01:05:00.725350844Z [2024-04-06 01:05:00,725: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e1d613c3-5957-4bd8-9094-f2acf11a117c] received 2024-04-06T01:05:00.730103615Z [2024-04-06 01:05:00,729: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0c53e72c-204d-46c8-90ac-1e2cd6b07737] received 2024-04-06T01:05:00.743946824Z [2024-04-06 01:05:00,743: INFO/ForkPoolWorker-1] [e1d613c3-5957-4bd8-9094-f2acf11a117c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T01:05:00.750984970Z [2024-04-06 01:05:00,747: INFO/ForkPoolWorker-2] [0c53e72c-204d-46c8-90ac-1e2cd6b07737] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:05:00.751068738Z [2024-04-06 01:05:00,748: INFO/ForkPoolWorker-16] [c05f1673-0d39-427c-94b3-2aebbc920b31] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T01:05:00.751513207Z [2024-04-06 01:05:00,751: INFO/ForkPoolWorker-15] [3f61d688-0faf-4aac-b60b-cf438a424a1e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:05:01.077459186Z [2024-04-06 01:05:01,072: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T01:05:01.095234090Z [2024-04-06 01:05:01,088: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:05:01.099227830Z [2024-04-06 01:05:01,096: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T01:05:01.144507220Z [2024-04-06 01:05:01,140: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:05:01.304626547Z [2024-04-06 01:05:01,304: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-06T01:05:01.317680911Z [2024-04-06 01:05:01,317: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:05:01.348018030Z [2024-04-06 01:05:01,347: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:05:01.349543179Z [2024-04-06 01:05:01,349: INFO/ForkPoolWorker-16] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T01:05:01.349610148Z [2024-04-06 01:05:01,349: INFO/ForkPoolWorker-16] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T01:05:01.349681175Z [2024-04-06 01:05:01,349: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-06T01:05:01.350049748Z [2024-04-06 01:05:01,349: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T01:05:01.462924385Z [2024-04-06 01:05:01,462: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:05:02.073094178Z [2024-04-06 01:05:02,072: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c05f1673-0d39-427c-94b3-2aebbc920b31] succeeded in 1.3493844069998886s: None 2024-04-06T01:05:02.583136106Z [2024-04-06 01:05:02,582: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:05:02.586641856Z [2024-04-06 01:05:02,586: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:05:02.591309476Z [2024-04-06 01:05:02,590: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-06T01:05:02.595023408Z [2024-04-06 01:05:02,594: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:05:02.617164975Z [2024-04-06 01:05:02,616: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:05:02.618342373Z [2024-04-06 01:05:02,618: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:05:02.618353601Z [2024-04-06 01:05:02,618: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:05:02.618495406Z [2024-04-06 01:05:02,618: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:05:02.618506912Z [2024-04-06 01:05:02,618: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:05:02.619040277Z [2024-04-06 01:05:02,618: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:05:02.619284974Z [2024-04-06 01:05:02,619: INFO/ForkPoolWorker-15] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:05:02.637985661Z [2024-04-06 01:05:02,637: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T01:05:02.639494058Z [2024-04-06 01:05:02,639: INFO/ForkPoolWorker-2] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:05:02.639520129Z [2024-04-06 01:05:02,639: INFO/ForkPoolWorker-2] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:05:02.639669232Z [2024-04-06 01:05:02,639: INFO/ForkPoolWorker-2] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:05:02.639724964Z [2024-04-06 01:05:02,639: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-06T01:05:02.640130983Z [2024-04-06 01:05:02,639: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:05:02.640194975Z [2024-04-06 01:05:02,640: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:05:02.730143673Z [2024-04-06 01:05:02,729: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:05:02.739745604Z [2024-04-06 01:05:02,739: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T01:05:02.747545569Z [2024-04-06 01:05:02,747: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:05:02.751776809Z [2024-04-06 01:05:02,751: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:05:02.795968241Z [2024-04-06 01:05:02,795: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T01:05:02.798785363Z [2024-04-06 01:05:02,798: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:05:02.798919807Z [2024-04-06 01:05:02,798: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:05:02.799170475Z [2024-04-06 01:05:02,798: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:05:02.799332424Z [2024-04-06 01:05:02,799: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T01:05:02.799701996Z [2024-04-06 01:05:02,799: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T01:05:02.799829930Z [2024-04-06 01:05:02,799: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:05:02.934492324Z [2024-04-06 01:05:02,934: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:05:03.524033909Z [2024-04-06 01:05:03,523: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e1d613c3-5957-4bd8-9094-f2acf11a117c] succeeded in 2.793574549999903s: None 2024-04-06T01:05:03.615472211Z [2024-04-06 01:05:03,614: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2fd181f6-7f2e-4697-9260-06490d1455a0] received 2024-04-06T01:05:03.630330333Z [2024-04-06 01:05:03,629: INFO/ForkPoolWorker-16] [2fd181f6-7f2e-4697-9260-06490d1455a0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'split_metrics', 'scheduled__2024-04-06T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T01:05:03.963061911Z [2024-04-06 01:05:03,960: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T01:05:04.185242466Z [2024-04-06 01:05:04,184: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3f61d688-0faf-4aac-b60b-cf438a424a1e] succeeded in 3.457954637999137s: None 2024-04-06T01:05:05.160068626Z [2024-04-06 01:05:05,159: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:05:05.163415647Z [2024-04-06 01:05:05,162: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:05:05.190207346Z [2024-04-06 01:05:05,189: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:05:05.192511167Z [2024-04-06 01:05:05,191: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:05:05.192810887Z [2024-04-06 01:05:05,192: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:05:05.193072568Z [2024-04-06 01:05:05,192: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:05:05.193135143Z [2024-04-06 01:05:05,193: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:05:05.193893925Z [2024-04-06 01:05:05,193: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T01:05:05.193947367Z [2024-04-06 01:05:05,193: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:05:05.263158540Z [2024-04-06 01:05:05,262: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[0c53e72c-204d-46c8-90ac-1e2cd6b07737] succeeded in 4.530530919000739s: None 2024-04-06T01:05:05.289335675Z [2024-04-06 01:05:05,289: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:05:05.883951234Z [2024-04-06 01:05:05,883: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2fd181f6-7f2e-4697-9260-06490d1455a0] succeeded in 2.2653919139993377s: None 2024-04-06T01:05:06.260037837Z [2024-04-06 01:05:06,259: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[df745e55-072a-49e9-8ab1-e911540b38dc] received 2024-04-06T01:05:06.266612753Z [2024-04-06 01:05:06,266: INFO/ForkPoolWorker-15] [df745e55-072a-49e9-8ab1-e911540b38dc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'collect_metrics', 'scheduled__2024-04-06T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T01:05:06.549929106Z [2024-04-06 01:05:06,546: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T01:05:07.831125763Z [2024-04-06 01:05:07,830: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:05:07.834487425Z [2024-04-06 01:05:07,833: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:05:07.858626759Z [2024-04-06 01:05:07,858: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:05:07.860341730Z [2024-04-06 01:05:07,860: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:05:07.860520721Z [2024-04-06 01:05:07,860: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:05:07.860826774Z [2024-04-06 01:05:07,860: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:05:07.860867424Z [2024-04-06 01:05:07,860: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:05:07.861277835Z [2024-04-06 01:05:07,861: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T01:05:07.861423776Z [2024-04-06 01:05:07,861: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:05:07.954899977Z [2024-04-06 01:05:07,954: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:05:08.518112529Z [2024-04-06 01:05:08,517: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[df745e55-072a-49e9-8ab1-e911540b38dc] succeeded in 2.256565548999788s: None 2024-04-06T01:05:08.583939452Z [2024-04-06 01:05:08,583: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a43dc123-d84c-43f9-9c53-d3b259940701] received 2024-04-06T01:05:08.592027420Z [2024-04-06 01:05:08,591: INFO/ForkPoolWorker-15] [a43dc123-d84c-43f9-9c53-d3b259940701] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'send_prometheus', 'scheduled__2024-04-06T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T01:05:08.938036995Z [2024-04-06 01:05:08,934: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T01:05:10.063589821Z [2024-04-06 01:05:10,057: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:05:10.071367358Z [2024-04-06 01:05:10,066: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:05:10.121777897Z [2024-04-06 01:05:10,121: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:05:10.123315162Z [2024-04-06 01:05:10,122: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:05:10.123625497Z [2024-04-06 01:05:10,123: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:05:10.123781871Z [2024-04-06 01:05:10,123: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:05:10.123860695Z [2024-04-06 01:05:10,123: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:05:10.124183582Z [2024-04-06 01:05:10,124: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T01:05:10.124303949Z [2024-04-06 01:05:10,124: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:05:10.230926866Z [2024-04-06 01:05:10,230: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:05:10.734355624Z [2024-04-06 01:05:10,733: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a43dc123-d84c-43f9-9c53-d3b259940701] succeeded in 2.148821875998692s: None 2024-04-06T01:06:00.966297176Z [2024-04-06 01:06:00,965: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a4a14135-b088-496a-9ac7-1b2978297ec0] received 2024-04-06T01:06:00.970362330Z [2024-04-06 01:06:00,970: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b8ad68c6-dd67-447f-92b3-2fa932f4692f] received 2024-04-06T01:06:00.998266124Z [2024-04-06 01:06:00,997: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[63259a88-311a-4314-85c2-2a3685bd5561] received 2024-04-06T01:06:00.999980908Z [2024-04-06 01:06:00,992: INFO/ForkPoolWorker-15] [a4a14135-b088-496a-9ac7-1b2978297ec0] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T01:06:01.000398313Z [2024-04-06 01:06:01,000: INFO/ForkPoolWorker-16] [b8ad68c6-dd67-447f-92b3-2fa932f4692f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:06:01.015628278Z [2024-04-06 01:06:01,015: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c0fb5e2a-5cdb-41bd-9a3b-6fcf98945b85] received 2024-04-06T01:06:01.048641528Z [2024-04-06 01:06:01,048: INFO/ForkPoolWorker-1] [63259a88-311a-4314-85c2-2a3685bd5561] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:06:01.054225457Z [2024-04-06 01:06:01,053: INFO/ForkPoolWorker-2] [c0fb5e2a-5cdb-41bd-9a3b-6fcf98945b85] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T01:06:01.288713702Z [2024-04-06 01:06:01,285: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:06:01.362786226Z [2024-04-06 01:06:01,359: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T01:06:01.381181425Z [2024-04-06 01:06:01,377: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T01:06:01.425762185Z [2024-04-06 01:06:01,420: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:06:01.649363557Z [2024-04-06 01:06:01,648: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-06T01:06:01.655531240Z [2024-04-06 01:06:01,653: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:06:01.706343100Z [2024-04-06 01:06:01,704: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T01:06:01.706358885Z [2024-04-06 01:06:01,706: INFO/ForkPoolWorker-2] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T01:06:01.706362610Z [2024-04-06 01:06:01,706: INFO/ForkPoolWorker-2] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T01:06:01.706366933Z [2024-04-06 01:06:01,706: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-06T01:06:01.706983758Z [2024-04-06 01:06:01,706: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T01:06:01.730548548Z [2024-04-06 01:06:01,724: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:06:01.804577701Z [2024-04-06 01:06:01,804: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:06:02.448781075Z [2024-04-06 01:06:02,448: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a4a14135-b088-496a-9ac7-1b2978297ec0] succeeded in 1.4762586930010002s: None 2024-04-06T01:06:02.584598996Z [2024-04-06 01:06:02,584: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[c0fb5e2a-5cdb-41bd-9a3b-6fcf98945b85] succeeded in 1.5438555479995557s: None 2024-04-06T01:06:02.698271967Z [2024-04-06 01:06:02,697: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:06:02.701817554Z [2024-04-06 01:06:02,701: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:06:02.727755875Z [2024-04-06 01:06:02,727: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:06:02.729281778Z [2024-04-06 01:06:02,729: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:06:02.729403573Z [2024-04-06 01:06:02,729: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:06:02.729618001Z [2024-04-06 01:06:02,729: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:06:02.729690667Z [2024-04-06 01:06:02,729: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:06:02.730029044Z [2024-04-06 01:06:02,729: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:06:02.730161357Z [2024-04-06 01:06:02,730: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:06:02.819453265Z [2024-04-06 01:06:02,818: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:06:03.009005438Z [2024-04-06 01:06:03,008: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T01:06:03.012536913Z [2024-04-06 01:06:03,011: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:06:03.053008847Z [2024-04-06 01:06:03,052: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T01:06:03.054418153Z [2024-04-06 01:06:03,054: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:06:03.054549009Z [2024-04-06 01:06:03,054: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:06:03.054709024Z [2024-04-06 01:06:03,054: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:06:03.054748611Z [2024-04-06 01:06:03,054: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T01:06:03.055032367Z [2024-04-06 01:06:03,054: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:06:03.055188914Z [2024-04-06 01:06:03,055: INFO/ForkPoolWorker-1] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:06:03.160781595Z [2024-04-06 01:06:03,160: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:06:05.262017190Z [2024-04-06 01:06:05,261: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[63259a88-311a-4314-85c2-2a3685bd5561] succeeded in 4.244181013000343s: None 2024-04-06T01:06:05.596926415Z [2024-04-06 01:06:05,596: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b8ad68c6-dd67-447f-92b3-2fa932f4692f] succeeded in 4.615656718000537s: None 2024-04-06T01:07:01.211607314Z [2024-04-06 01:07:01,211: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[48fb045e-e9a4-45e7-bc61-30b18d54c6ac] received 2024-04-06T01:07:01.222916257Z [2024-04-06 01:07:01,222: INFO/ForkPoolWorker-15] [48fb045e-e9a4-45e7-bc61-30b18d54c6ac] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:07:01.230751446Z [2024-04-06 01:07:01,230: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[249c1933-9abd-4e79-8ea9-87c99fbd3f51] received 2024-04-06T01:07:01.238508199Z [2024-04-06 01:07:01,238: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e94ddd23-266e-441d-acf7-afcc3be68b14] received 2024-04-06T01:07:01.244901175Z [2024-04-06 01:07:01,244: INFO/ForkPoolWorker-16] [249c1933-9abd-4e79-8ea9-87c99fbd3f51] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:07:01.248294081Z [2024-04-06 01:07:01,247: INFO/ForkPoolWorker-1] [e94ddd23-266e-441d-acf7-afcc3be68b14] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T01:07:01.521494191Z [2024-04-06 01:07:01,518: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:07:01.564100154Z [2024-04-06 01:07:01,560: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:07:01.572215975Z [2024-04-06 01:07:01,568: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T01:07:01.766883555Z [2024-04-06 01:07:01,766: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-06T01:07:01.770708562Z [2024-04-06 01:07:01,770: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:07:01.817985673Z [2024-04-06 01:07:01,817: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T01:07:01.820411386Z [2024-04-06 01:07:01,820: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T01:07:01.820536652Z [2024-04-06 01:07:01,820: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T01:07:01.820605591Z [2024-04-06 01:07:01,820: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-06T01:07:01.820859478Z [2024-04-06 01:07:01,820: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T01:07:01.934538600Z [2024-04-06 01:07:01,934: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:07:02.706731120Z [2024-04-06 01:07:02,705: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e94ddd23-266e-441d-acf7-afcc3be68b14] succeeded in 1.4662216950000584s: None 2024-04-06T01:07:02.839214096Z [2024-04-06 01:07:02,838: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:07:02.842404998Z [2024-04-06 01:07:02,841: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:07:02.863196609Z [2024-04-06 01:07:02,862: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:07:02.864640821Z [2024-04-06 01:07:02,864: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:07:02.864889904Z [2024-04-06 01:07:02,864: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:07:02.865014327Z [2024-04-06 01:07:02,864: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:07:02.865083898Z [2024-04-06 01:07:02,864: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:07:02.865534685Z [2024-04-06 01:07:02,865: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:07:02.865942594Z [2024-04-06 01:07:02,865: INFO/ForkPoolWorker-15] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:07:02.874579143Z [2024-04-06 01:07:02,874: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:07:02.878083759Z [2024-04-06 01:07:02,877: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:07:02.907643832Z [2024-04-06 01:07:02,907: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:07:02.909306007Z [2024-04-06 01:07:02,908: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:07:02.909318020Z [2024-04-06 01:07:02,909: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:07:02.909512366Z [2024-04-06 01:07:02,909: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:07:02.909518175Z [2024-04-06 01:07:02,909: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:07:02.910005971Z [2024-04-06 01:07:02,909: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:07:02.910015638Z [2024-04-06 01:07:02,909: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:07:02.975926129Z [2024-04-06 01:07:02,975: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:07:03.010303906Z [2024-04-06 01:07:03,009: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:07:04.701663528Z [2024-04-06 01:07:04,700: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[48fb045e-e9a4-45e7-bc61-30b18d54c6ac] succeeded in 3.484899220000443s: None 2024-04-06T01:07:05.089609449Z [2024-04-06 01:07:05,088: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[249c1933-9abd-4e79-8ea9-87c99fbd3f51] succeeded in 3.8548164809999435s: None 2024-04-06T01:08:00.463062951Z [2024-04-06 01:08:00,461: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[05825bcf-3ba6-4711-91c8-6a00bac25b58] received 2024-04-06T01:08:00.464912495Z [2024-04-06 01:08:00,464: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fd7bbedc-9fb9-47ef-a9fb-76f00dd9607f] received 2024-04-06T01:08:00.473680959Z [2024-04-06 01:08:00,473: INFO/ForkPoolWorker-16] [fd7bbedc-9fb9-47ef-a9fb-76f00dd9607f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:08:00.475077597Z [2024-04-06 01:08:00,474: INFO/ForkPoolWorker-15] [05825bcf-3ba6-4711-91c8-6a00bac25b58] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T01:08:00.476754914Z [2024-04-06 01:08:00,476: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[387e049b-07a1-4321-a114-294ac116a374] received 2024-04-06T01:08:00.479640912Z [2024-04-06 01:08:00,479: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[86573f71-0972-40f9-8536-592ef5af7095] received 2024-04-06T01:08:00.489302121Z [2024-04-06 01:08:00,488: INFO/ForkPoolWorker-1] [387e049b-07a1-4321-a114-294ac116a374] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:08:00.495016067Z [2024-04-06 01:08:00,494: INFO/ForkPoolWorker-2] [86573f71-0972-40f9-8536-592ef5af7095] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T01:08:00.791909906Z [2024-04-06 01:08:00,787: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T01:08:00.800638221Z [2024-04-06 01:08:00,796: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:08:00.824479214Z [2024-04-06 01:08:00,820: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T01:08:00.826523875Z [2024-04-06 01:08:00,822: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:08:00.989903764Z [2024-04-06 01:08:00,989: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-06T01:08:01.001123798Z [2024-04-06 01:08:01,000: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:08:01.057395024Z [2024-04-06 01:08:01,057: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T01:08:01.062595854Z [2024-04-06 01:08:01,062: INFO/ForkPoolWorker-2] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T01:08:01.062759414Z [2024-04-06 01:08:01,062: INFO/ForkPoolWorker-2] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T01:08:01.062887130Z [2024-04-06 01:08:01,062: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-06T01:08:01.063167997Z [2024-04-06 01:08:01,063: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T01:08:01.092267244Z [2024-04-06 01:08:01,091: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:08:01.179402213Z [2024-04-06 01:08:01,179: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:08:01.729411635Z [2024-04-06 01:08:01,729: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[05825bcf-3ba6-4711-91c8-6a00bac25b58] succeeded in 1.263304320998941s: None 2024-04-06T01:08:01.825743725Z [2024-04-06 01:08:01,825: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[86573f71-0972-40f9-8536-592ef5af7095] succeeded in 1.3441570160011906s: None 2024-04-06T01:08:02.157791944Z [2024-04-06 01:08:02,157: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:08:02.161841906Z [2024-04-06 01:08:02,161: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:08:02.197371645Z [2024-04-06 01:08:02,197: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:08:02.198789519Z [2024-04-06 01:08:02,198: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:08:02.198967559Z [2024-04-06 01:08:02,198: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:08:02.199227647Z [2024-04-06 01:08:02,199: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:08:02.199519350Z [2024-04-06 01:08:02,199: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:08:02.199816412Z [2024-04-06 01:08:02,199: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:08:02.199947131Z [2024-04-06 01:08:02,199: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:08:02.288747071Z [2024-04-06 01:08:02,288: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:08:02.316943113Z [2024-04-06 01:08:02,316: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T01:08:02.320074352Z [2024-04-06 01:08:02,319: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:08:02.343074400Z [2024-04-06 01:08:02,342: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T01:08:02.344535954Z [2024-04-06 01:08:02,344: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:08:02.344618604Z [2024-04-06 01:08:02,344: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:08:02.344781962Z [2024-04-06 01:08:02,344: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:08:02.344846081Z [2024-04-06 01:08:02,344: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T01:08:02.345118671Z [2024-04-06 01:08:02,344: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:08:02.345278286Z [2024-04-06 01:08:02,345: INFO/ForkPoolWorker-1] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:08:02.433545014Z [2024-04-06 01:08:02,433: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:08:03.931968163Z [2024-04-06 01:08:03,929: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[387e049b-07a1-4321-a114-294ac116a374] succeeded in 3.4513768809993053s: None 2024-04-06T01:08:04.191389207Z [2024-04-06 01:08:04,190: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[fd7bbedc-9fb9-47ef-a9fb-76f00dd9607f] succeeded in 3.7251139840009273s: None 2024-04-06T01:09:00.528842077Z [2024-04-06 01:09:00,528: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c1249775-82ec-4794-aced-a98f9a500deb] received 2024-04-06T01:09:00.533334309Z [2024-04-06 01:09:00,533: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[301624de-9ee1-422d-b999-1b5bfa9976e8] received 2024-04-06T01:09:00.539747742Z [2024-04-06 01:09:00,539: INFO/ForkPoolWorker-16] [301624de-9ee1-422d-b999-1b5bfa9976e8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:09:00.549021760Z [2024-04-06 01:09:00,548: INFO/ForkPoolWorker-15] [c1249775-82ec-4794-aced-a98f9a500deb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:09:00.559223128Z [2024-04-06 01:09:00,558: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[283e79a6-6736-4327-9b86-6180d5ebc0bf] received 2024-04-06T01:09:00.581871437Z [2024-04-06 01:09:00,581: INFO/ForkPoolWorker-1] [283e79a6-6736-4327-9b86-6180d5ebc0bf] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T01:09:00.822591207Z [2024-04-06 01:09:00,818: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:09:00.914803384Z [2024-04-06 01:09:00,911: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T01:09:00.933484343Z [2024-04-06 01:09:00,920: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:09:01.177443782Z [2024-04-06 01:09:01,176: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-06T01:09:01.185314983Z [2024-04-06 01:09:01,184: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:09:01.232292337Z [2024-04-06 01:09:01,232: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T01:09:01.233434534Z [2024-04-06 01:09:01,233: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T01:09:01.233558720Z [2024-04-06 01:09:01,233: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T01:09:01.233587418Z [2024-04-06 01:09:01,233: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-06T01:09:01.233784647Z [2024-04-06 01:09:01,233: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T01:09:01.374022446Z [2024-04-06 01:09:01,373: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:09:02.190331426Z [2024-04-06 01:09:02,188: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[283e79a6-6736-4327-9b86-6180d5ebc0bf] succeeded in 1.6271980430010444s: None 2024-04-06T01:09:02.345563513Z [2024-04-06 01:09:02,345: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:09:02.350981391Z [2024-04-06 01:09:02,349: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:09:02.409332114Z [2024-04-06 01:09:02,409: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:09:02.414221392Z [2024-04-06 01:09:02,413: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:09:02.417178101Z [2024-04-06 01:09:02,416: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:09:02.417373014Z [2024-04-06 01:09:02,417: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:09:02.417489708Z [2024-04-06 01:09:02,417: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:09:02.417881812Z [2024-04-06 01:09:02,417: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:09:02.418008129Z [2024-04-06 01:09:02,417: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:09:02.533588886Z [2024-04-06 01:09:02,533: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:09:02.646810239Z [2024-04-06 01:09:02,646: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:09:02.650432127Z [2024-04-06 01:09:02,649: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:09:02.677875368Z [2024-04-06 01:09:02,677: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:09:02.683485792Z [2024-04-06 01:09:02,683: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:09:02.683988482Z [2024-04-06 01:09:02,683: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:09:02.685780907Z [2024-04-06 01:09:02,685: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:09:02.685961833Z [2024-04-06 01:09:02,685: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:09:02.686429526Z [2024-04-06 01:09:02,686: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:09:02.686645579Z [2024-04-06 01:09:02,686: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:09:02.792424734Z [2024-04-06 01:09:02,792: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:09:04.524740074Z [2024-04-06 01:09:04,523: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c1249775-82ec-4794-aced-a98f9a500deb] succeeded in 3.991313545000594s: None 2024-04-06T01:09:04.565969175Z [2024-04-06 01:09:04,564: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[301624de-9ee1-422d-b999-1b5bfa9976e8] succeeded in 4.029749854000329s: None 2024-04-06T01:10:01.032123529Z [2024-04-06 01:10:01,031: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c0d2315c-8064-4bcf-af0e-ca838720a92d] received 2024-04-06T01:10:01.033783788Z [2024-04-06 01:10:01,033: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cc889160-b796-4baa-a61f-db4ee689afcf] received 2024-04-06T01:10:01.042793485Z [2024-04-06 01:10:01,042: INFO/ForkPoolWorker-16] [cc889160-b796-4baa-a61f-db4ee689afcf] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T01:10:01.043583628Z [2024-04-06 01:10:01,043: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bb1567e6-38c4-4569-8502-50a6a086db96] received 2024-04-06T01:10:01.044889289Z [2024-04-06 01:10:01,044: INFO/ForkPoolWorker-15] [c0d2315c-8064-4bcf-af0e-ca838720a92d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T01:10:01.056456167Z [2024-04-06 01:10:01,056: INFO/ForkPoolWorker-1] [bb1567e6-38c4-4569-8502-50a6a086db96] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T01:10:01.059991046Z [2024-04-06 01:10:01,059: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4f870189-810f-4684-975c-a52c312cdc28] received 2024-04-06T01:10:01.066824047Z [2024-04-06 01:10:01,066: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e639b4f8-8d5c-4bcd-b08d-7ec1b5641690] received 2024-04-06T01:10:01.068297041Z [2024-04-06 01:10:01,068: INFO/ForkPoolWorker-2] [4f870189-810f-4684-975c-a52c312cdc28] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:10:01.089505664Z [2024-04-06 01:10:01,089: INFO/ForkPoolWorker-3] [e639b4f8-8d5c-4bcd-b08d-7ec1b5641690] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:10:01.425111958Z [2024-04-06 01:10:01,419: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T01:10:01.430396203Z [2024-04-06 01:10:01,427: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T01:10:01.520366956Z [2024-04-06 01:10:01,517: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:10:01.522216840Z [2024-04-06 01:10:01,515: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T01:10:01.550006796Z [2024-04-06 01:10:01,546: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:10:01.718914339Z [2024-04-06 01:10:01,718: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-06T01:10:01.770647324Z [2024-04-06 01:10:01,770: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:10:01.824775863Z [2024-04-06 01:10:01,824: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T01:10:01.832553314Z [2024-04-06 01:10:01,832: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T01:10:01.832815835Z [2024-04-06 01:10:01,832: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T01:10:01.832995566Z [2024-04-06 01:10:01,832: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-06T01:10:01.833370239Z [2024-04-06 01:10:01,833: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T01:10:01.948432523Z [2024-04-06 01:10:01,948: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:10:02.291750020Z [2024-04-06 01:10:02,291: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:10:02.566852107Z [2024-04-06 01:10:02,566: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[bb1567e6-38c4-4569-8502-50a6a086db96] succeeded in 1.5205610230004822s: None 2024-04-06T01:10:02.853385055Z [2024-04-06 01:10:02,852: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[cc889160-b796-4baa-a61f-db4ee689afcf] succeeded in 1.8169257750014367s: None 2024-04-06T01:10:02.878758172Z [2024-04-06 01:10:02,878: INFO/ForkPoolWorker-3] Getting VIM list 2024-04-06T01:10:02.882944474Z [2024-04-06 01:10:02,882: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:10:02.904319950Z [2024-04-06 01:10:02,904: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-06T01:10:02.905782750Z [2024-04-06 01:10:02,905: INFO/ForkPoolWorker-3] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:10:02.905864109Z [2024-04-06 01:10:02,905: INFO/ForkPoolWorker-3] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:10:02.906318760Z [2024-04-06 01:10:02,906: INFO/ForkPoolWorker-3] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:10:02.906414116Z [2024-04-06 01:10:02,906: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-04-06T01:10:02.906738803Z [2024-04-06 01:10:02,906: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:10:02.906949931Z [2024-04-06 01:10:02,906: INFO/ForkPoolWorker-3] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:10:02.999756160Z [2024-04-06 01:10:02,999: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:10:03.002922292Z [2024-04-06 01:10:03,002: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:10:03.024123397Z [2024-04-06 01:10:03,023: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:10:03.034540247Z [2024-04-06 01:10:03,034: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:10:03.041039335Z [2024-04-06 01:10:03,040: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:10:03.041135712Z [2024-04-06 01:10:03,040: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:10:03.041309610Z [2024-04-06 01:10:03,041: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:10:03.043248277Z [2024-04-06 01:10:03,043: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:10:03.050102521Z [2024-04-06 01:10:03,043: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T01:10:03.050219768Z [2024-04-06 01:10:03,050: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:10:03.177161297Z [2024-04-06 01:10:03,176: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:10:03.488669105Z [2024-04-06 01:10:03,488: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-06T01:10:03.492191613Z [2024-04-06 01:10:03,491: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:10:03.509845432Z [2024-04-06 01:10:03,509: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T01:10:03.511452587Z [2024-04-06 01:10:03,511: INFO/ForkPoolWorker-2] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:10:03.511570145Z [2024-04-06 01:10:03,511: INFO/ForkPoolWorker-2] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:10:03.511742431Z [2024-04-06 01:10:03,511: INFO/ForkPoolWorker-2] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:10:03.511846109Z [2024-04-06 01:10:03,511: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-06T01:10:03.512117220Z [2024-04-06 01:10:03,511: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:10:03.512562594Z [2024-04-06 01:10:03,512: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:10:03.614049743Z [2024-04-06 01:10:03,613: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:10:03.918982392Z [2024-04-06 01:10:03,918: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c0d2315c-8064-4bcf-af0e-ca838720a92d] succeeded in 2.883976923998489s: None 2024-04-06T01:10:04.326087952Z [2024-04-06 01:10:04,323: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[46882c6e-d46b-403c-885a-d93bc2fb316d] received 2024-04-06T01:10:04.342157016Z [2024-04-06 01:10:04,341: INFO/ForkPoolWorker-15] [46882c6e-d46b-403c-885a-d93bc2fb316d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'split_metrics', 'scheduled__2024-04-06T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T01:10:04.813712937Z [2024-04-06 01:10:04,810: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T01:10:04.840224231Z [2024-04-06 01:10:04,839: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[e639b4f8-8d5c-4bcd-b08d-7ec1b5641690] succeeded in 3.7701078270001744s: None 2024-04-06T01:10:05.506787283Z [2024-04-06 01:10:05,506: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[4f870189-810f-4684-975c-a52c312cdc28] succeeded in 4.444417159000295s: None 2024-04-06T01:10:05.991988680Z [2024-04-06 01:10:05,991: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:10:05.998412130Z [2024-04-06 01:10:05,996: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:10:06.015089904Z [2024-04-06 01:10:06,014: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:10:06.016486508Z [2024-04-06 01:10:06,015: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:10:06.016499518Z [2024-04-06 01:10:06,016: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:10:06.016503461Z [2024-04-06 01:10:06,016: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:10:06.016653357Z [2024-04-06 01:10:06,016: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:10:06.018890007Z [2024-04-06 01:10:06,017: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T01:10:06.018917390Z [2024-04-06 01:10:06,018: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:10:06.129297808Z [2024-04-06 01:10:06,128: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:10:06.745504934Z [2024-04-06 01:10:06,744: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[46882c6e-d46b-403c-885a-d93bc2fb316d] succeeded in 2.419635247999395s: None 2024-04-06T01:10:06.955857346Z [2024-04-06 01:10:06,955: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[11c7bc4b-7c34-4c97-94c5-4d4a50f3d64f] received 2024-04-06T01:10:06.966585218Z [2024-04-06 01:10:06,966: INFO/ForkPoolWorker-15] [11c7bc4b-7c34-4c97-94c5-4d4a50f3d64f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'collect_metrics', 'scheduled__2024-04-06T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T01:10:07.291947289Z [2024-04-06 01:10:07,288: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T01:10:08.420455468Z [2024-04-06 01:10:08,420: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:10:08.423858626Z [2024-04-06 01:10:08,423: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:10:08.444767244Z [2024-04-06 01:10:08,444: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:10:08.448504666Z [2024-04-06 01:10:08,446: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:10:08.448524685Z [2024-04-06 01:10:08,447: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:10:08.448529517Z [2024-04-06 01:10:08,447: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:10:08.448569264Z [2024-04-06 01:10:08,447: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:10:08.448575447Z [2024-04-06 01:10:08,447: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T01:10:08.448586398Z [2024-04-06 01:10:08,447: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:10:08.550904847Z [2024-04-06 01:10:08,550: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:10:09.121544030Z [2024-04-06 01:10:09,121: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[11c7bc4b-7c34-4c97-94c5-4d4a50f3d64f] succeeded in 2.1621969879997778s: None 2024-04-06T01:10:09.610300245Z [2024-04-06 01:10:09,609: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[44f75273-f913-4526-9ce9-5d3a4f668fbe] received 2024-04-06T01:10:09.620496524Z [2024-04-06 01:10:09,620: INFO/ForkPoolWorker-15] [44f75273-f913-4526-9ce9-5d3a4f668fbe] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'send_prometheus', 'scheduled__2024-04-06T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T01:10:09.879766097Z [2024-04-06 01:10:09,876: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T01:10:11.027781692Z [2024-04-06 01:10:11,027: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:10:11.030750979Z [2024-04-06 01:10:11,030: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:10:11.052582901Z [2024-04-06 01:10:11,052: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:10:11.054028625Z [2024-04-06 01:10:11,053: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:10:11.054166730Z [2024-04-06 01:10:11,053: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:10:11.054210039Z [2024-04-06 01:10:11,053: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:10:11.054228990Z [2024-04-06 01:10:11,054: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:10:11.054552410Z [2024-04-06 01:10:11,054: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T01:10:11.054604218Z [2024-04-06 01:10:11,054: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:10:11.132465376Z [2024-04-06 01:10:11,132: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:10:11.692779030Z [2024-04-06 01:10:11,692: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[44f75273-f913-4526-9ce9-5d3a4f668fbe] succeeded in 2.079918405999706s: None 2024-04-06T01:11:01.372053633Z [2024-04-06 01:11:01,371: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8864863d-5413-44cf-82e2-6c531f83e7e5] received 2024-04-06T01:11:01.374994676Z [2024-04-06 01:11:01,374: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c1e35708-2268-4edc-b775-365484b94239] received 2024-04-06T01:11:01.382250636Z [2024-04-06 01:11:01,381: INFO/ForkPoolWorker-15] [8864863d-5413-44cf-82e2-6c531f83e7e5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:11:01.386386197Z [2024-04-06 01:11:01,386: INFO/ForkPoolWorker-16] [c1e35708-2268-4edc-b775-365484b94239] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:11:01.393897640Z [2024-04-06 01:11:01,393: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[57c8e768-95dd-4e94-926b-338d56858070] received 2024-04-06T01:11:01.406164826Z [2024-04-06 01:11:01,405: INFO/ForkPoolWorker-1] [57c8e768-95dd-4e94-926b-338d56858070] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T01:11:01.671455195Z [2024-04-06 01:11:01,667: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:11:01.689432971Z [2024-04-06 01:11:01,685: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T01:11:01.719872928Z [2024-04-06 01:11:01,715: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:11:01.854239544Z [2024-04-06 01:11:01,853: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-06T01:11:01.858235622Z [2024-04-06 01:11:01,857: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:11:01.902564837Z [2024-04-06 01:11:01,902: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T01:11:01.903918934Z [2024-04-06 01:11:01,903: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T01:11:01.904072145Z [2024-04-06 01:11:01,903: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T01:11:01.904182412Z [2024-04-06 01:11:01,904: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-06T01:11:01.904477220Z [2024-04-06 01:11:01,904: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T01:11:02.037185164Z [2024-04-06 01:11:02,036: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:11:02.719487007Z [2024-04-06 01:11:02,718: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[57c8e768-95dd-4e94-926b-338d56858070] succeeded in 1.3227508199997828s: None 2024-04-06T01:11:02.981321928Z [2024-04-06 01:11:02,980: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:11:02.984742185Z [2024-04-06 01:11:02,984: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:11:03.025316907Z [2024-04-06 01:11:03,025: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:11:03.026662570Z [2024-04-06 01:11:03,026: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:11:03.026772629Z [2024-04-06 01:11:03,026: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:11:03.026930410Z [2024-04-06 01:11:03,026: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:11:03.027042414Z [2024-04-06 01:11:03,026: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:11:03.027346578Z [2024-04-06 01:11:03,027: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:11:03.027414950Z [2024-04-06 01:11:03,027: INFO/ForkPoolWorker-15] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:11:03.103670344Z [2024-04-06 01:11:03,103: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:11:03.108489329Z [2024-04-06 01:11:03,108: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:11:03.111786147Z [2024-04-06 01:11:03,111: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:11:03.135834742Z [2024-04-06 01:11:03,135: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:11:03.137087210Z [2024-04-06 01:11:03,136: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:11:03.137107621Z [2024-04-06 01:11:03,136: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:11:03.137185717Z [2024-04-06 01:11:03,136: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:11:03.137201832Z [2024-04-06 01:11:03,137: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:11:03.137377848Z [2024-04-06 01:11:03,137: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:11:03.137406198Z [2024-04-06 01:11:03,137: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:11:03.249980524Z [2024-04-06 01:11:03,249: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:11:04.810252112Z [2024-04-06 01:11:04,809: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8864863d-5413-44cf-82e2-6c531f83e7e5] succeeded in 3.434106980999786s: None 2024-04-06T01:11:05.290866905Z [2024-04-06 01:11:05,290: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c1e35708-2268-4edc-b775-365484b94239] succeeded in 3.913401244999477s: None 2024-04-06T01:12:00.533656628Z [2024-04-06 01:12:00,533: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3e1cff44-01f9-4ff0-b694-289e9ba0ec12] received 2024-04-06T01:12:00.540885517Z [2024-04-06 01:12:00,540: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0ab1f950-e5cc-483f-9333-882a9aba0fa4] received 2024-04-06T01:12:00.541531992Z [2024-04-06 01:12:00,541: INFO/ForkPoolWorker-15] [3e1cff44-01f9-4ff0-b694-289e9ba0ec12] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T01:12:00.542807642Z [2024-04-06 01:12:00,542: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1415a83a-5b91-4387-873f-740521f5abc2] received 2024-04-06T01:12:00.544454826Z [2024-04-06 01:12:00,544: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b4214f3b-27f2-4662-ad43-6ce3d9de9d6b] received 2024-04-06T01:12:00.556031232Z [2024-04-06 01:12:00,555: INFO/ForkPoolWorker-2] [b4214f3b-27f2-4662-ad43-6ce3d9de9d6b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T01:12:00.564388117Z [2024-04-06 01:12:00,563: INFO/ForkPoolWorker-16] [0ab1f950-e5cc-483f-9333-882a9aba0fa4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:12:00.568246901Z [2024-04-06 01:12:00,567: INFO/ForkPoolWorker-1] [1415a83a-5b91-4387-873f-740521f5abc2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:12:00.879591217Z [2024-04-06 01:12:00,875: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:12:00.913222268Z [2024-04-06 01:12:00,910: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T01:12:00.922601048Z [2024-04-06 01:12:00,918: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:12:00.935994445Z [2024-04-06 01:12:00,932: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T01:12:01.090170217Z [2024-04-06 01:12:01,089: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-06T01:12:01.094345348Z [2024-04-06 01:12:01,093: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:12:01.116935965Z [2024-04-06 01:12:01,116: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T01:12:01.118264800Z [2024-04-06 01:12:01,118: INFO/ForkPoolWorker-2] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T01:12:01.118315324Z [2024-04-06 01:12:01,118: INFO/ForkPoolWorker-2] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T01:12:01.118328601Z [2024-04-06 01:12:01,118: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-06T01:12:01.118611209Z [2024-04-06 01:12:01,118: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T01:12:01.264326274Z [2024-04-06 01:12:01,264: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:12:01.312521914Z [2024-04-06 01:12:01,312: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:12:01.928172530Z [2024-04-06 01:12:01,927: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3e1cff44-01f9-4ff0-b694-289e9ba0ec12] succeeded in 1.3918023180012824s: None 2024-04-06T01:12:02.028477980Z [2024-04-06 01:12:02,028: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b4214f3b-27f2-4662-ad43-6ce3d9de9d6b] succeeded in 1.4805190329989273s: None 2024-04-06T01:12:02.177818654Z [2024-04-06 01:12:02,177: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:12:02.181577334Z [2024-04-06 01:12:02,181: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:12:02.205886063Z [2024-04-06 01:12:02,205: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:12:02.207436779Z [2024-04-06 01:12:02,207: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:12:02.207564497Z [2024-04-06 01:12:02,207: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:12:02.207765580Z [2024-04-06 01:12:02,207: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:12:02.207834618Z [2024-04-06 01:12:02,207: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:12:02.208100423Z [2024-04-06 01:12:02,207: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:12:02.208174899Z [2024-04-06 01:12:02,208: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:12:02.316191941Z [2024-04-06 01:12:02,315: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:12:02.405940277Z [2024-04-06 01:12:02,405: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T01:12:02.410134691Z [2024-04-06 01:12:02,409: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:12:02.437519484Z [2024-04-06 01:12:02,437: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T01:12:02.440404804Z [2024-04-06 01:12:02,440: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:12:02.440532237Z [2024-04-06 01:12:02,440: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:12:02.440903497Z [2024-04-06 01:12:02,440: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:12:02.441086336Z [2024-04-06 01:12:02,440: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T01:12:02.441450385Z [2024-04-06 01:12:02,441: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:12:02.441632793Z [2024-04-06 01:12:02,441: INFO/ForkPoolWorker-1] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:12:02.537831899Z [2024-04-06 01:12:02,537: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:12:04.176823037Z [2024-04-06 01:12:04,176: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1415a83a-5b91-4387-873f-740521f5abc2] succeeded in 3.630795279999802s: None 2024-04-06T01:12:04.290486628Z [2024-04-06 01:12:04,289: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0ab1f950-e5cc-483f-9333-882a9aba0fa4] succeeded in 3.747176588000002s: None 2024-04-06T01:13:01.091914702Z [2024-04-06 01:13:01,091: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1e745982-90cf-4c68-9647-d5d374210d80] received 2024-04-06T01:13:01.102434837Z [2024-04-06 01:13:01,102: INFO/ForkPoolWorker-15] [1e745982-90cf-4c68-9647-d5d374210d80] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:13:01.105327015Z [2024-04-06 01:13:01,105: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6fcd54c8-e1aa-4c40-a208-88f509de07c5] received 2024-04-06T01:13:01.115011236Z [2024-04-06 01:13:01,114: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7ec1a1fc-caa0-4abf-b694-b7878b96a770] received 2024-04-06T01:13:01.115756673Z [2024-04-06 01:13:01,115: INFO/ForkPoolWorker-16] [6fcd54c8-e1aa-4c40-a208-88f509de07c5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:13:01.130973231Z [2024-04-06 01:13:01,130: INFO/ForkPoolWorker-1] [7ec1a1fc-caa0-4abf-b694-b7878b96a770] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T01:13:01.429324727Z [2024-04-06 01:13:01,425: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:13:01.436115985Z [2024-04-06 01:13:01,432: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T01:13:01.467963408Z [2024-04-06 01:13:01,464: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:13:01.610471820Z [2024-04-06 01:13:01,609: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-06T01:13:01.615151943Z [2024-04-06 01:13:01,614: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:13:01.649151422Z [2024-04-06 01:13:01,648: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T01:13:01.650608865Z [2024-04-06 01:13:01,650: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T01:13:01.650792736Z [2024-04-06 01:13:01,650: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T01:13:01.650930204Z [2024-04-06 01:13:01,650: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-06T01:13:01.651468382Z [2024-04-06 01:13:01,651: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T01:13:01.760588631Z [2024-04-06 01:13:01,760: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:13:02.418331277Z [2024-04-06 01:13:02,417: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7ec1a1fc-caa0-4abf-b694-b7878b96a770] succeeded in 1.3012002059986116s: None 2024-04-06T01:13:02.628647541Z [2024-04-06 01:13:02,628: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:13:02.631873359Z [2024-04-06 01:13:02,631: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:13:02.649620199Z [2024-04-06 01:13:02,649: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:13:02.650781780Z [2024-04-06 01:13:02,650: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:13:02.650876957Z [2024-04-06 01:13:02,650: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:13:02.651077168Z [2024-04-06 01:13:02,650: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:13:02.651212309Z [2024-04-06 01:13:02,651: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:13:02.651659666Z [2024-04-06 01:13:02,651: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:13:02.651815048Z [2024-04-06 01:13:02,651: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:13:02.681150119Z [2024-04-06 01:13:02,680: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:13:02.684569908Z [2024-04-06 01:13:02,684: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:13:02.703609410Z [2024-04-06 01:13:02,703: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:13:02.704833571Z [2024-04-06 01:13:02,704: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:13:02.704922036Z [2024-04-06 01:13:02,704: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:13:02.705120413Z [2024-04-06 01:13:02,704: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:13:02.705158511Z [2024-04-06 01:13:02,705: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:13:02.705456786Z [2024-04-06 01:13:02,705: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:13:02.705470110Z [2024-04-06 01:13:02,705: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:13:02.728886761Z [2024-04-06 01:13:02,728: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:13:02.802177546Z [2024-04-06 01:13:02,801: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:13:05.256245852Z [2024-04-06 01:13:05,255: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6fcd54c8-e1aa-4c40-a208-88f509de07c5] succeeded in 4.148876798999481s: None 2024-04-06T01:13:06.131728124Z [2024-04-06 01:13:06,131: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1e745982-90cf-4c68-9647-d5d374210d80] succeeded in 5.037459138000486s: None 2024-04-06T01:14:01.006061818Z [2024-04-06 01:14:01,005: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[50957479-4bf3-4ea0-8c6b-2bd615de2d76] received 2024-04-06T01:14:01.009724994Z [2024-04-06 01:14:01,009: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e30d5685-f83b-495b-a34c-2f54c16073ed] received 2024-04-06T01:14:01.014710011Z [2024-04-06 01:14:01,014: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c5260370-79d8-4ae8-91ae-45e7f5656325] received 2024-04-06T01:14:01.017343685Z [2024-04-06 01:14:01,017: INFO/ForkPoolWorker-16] [e30d5685-f83b-495b-a34c-2f54c16073ed] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:14:01.018156789Z [2024-04-06 01:14:01,017: INFO/ForkPoolWorker-15] [50957479-4bf3-4ea0-8c6b-2bd615de2d76] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T01:14:01.028057177Z [2024-04-06 01:14:01,027: INFO/ForkPoolWorker-1] [c5260370-79d8-4ae8-91ae-45e7f5656325] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:14:01.028949403Z [2024-04-06 01:14:01,028: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5d3b42ec-03b0-4983-a71e-7e575b9cf5e6] received 2024-04-06T01:14:01.038801032Z [2024-04-06 01:14:01,038: INFO/ForkPoolWorker-2] [5d3b42ec-03b0-4983-a71e-7e575b9cf5e6] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T01:14:01.352344082Z [2024-04-06 01:14:01,348: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:14:01.355685699Z [2024-04-06 01:14:01,352: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T01:14:01.364139964Z [2024-04-06 01:14:01,360: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T01:14:01.390147497Z [2024-04-06 01:14:01,386: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:14:01.522561591Z [2024-04-06 01:14:01,522: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-06T01:14:01.526739849Z [2024-04-06 01:14:01,526: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:14:01.556174050Z [2024-04-06 01:14:01,555: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T01:14:01.557286581Z [2024-04-06 01:14:01,557: INFO/ForkPoolWorker-2] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T01:14:01.557306262Z [2024-04-06 01:14:01,557: INFO/ForkPoolWorker-2] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T01:14:01.557380799Z [2024-04-06 01:14:01,557: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-06T01:14:01.557541150Z [2024-04-06 01:14:01,557: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T01:14:01.649092167Z [2024-04-06 01:14:01,648: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:14:01.740149393Z [2024-04-06 01:14:01,739: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:14:02.218041057Z [2024-04-06 01:14:02,217: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[5d3b42ec-03b0-4983-a71e-7e575b9cf5e6] succeeded in 1.18711221599915s: None 2024-04-06T01:14:02.379943905Z [2024-04-06 01:14:02,379: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[50957479-4bf3-4ea0-8c6b-2bd615de2d76] succeeded in 1.3718743879999238s: None 2024-04-06T01:14:02.664146669Z [2024-04-06 01:14:02,663: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T01:14:02.667427320Z [2024-04-06 01:14:02,666: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:14:02.701685964Z [2024-04-06 01:14:02,700: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T01:14:02.703775787Z [2024-04-06 01:14:02,703: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:14:02.703975138Z [2024-04-06 01:14:02,703: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:14:02.704245605Z [2024-04-06 01:14:02,704: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:14:02.704431841Z [2024-04-06 01:14:02,704: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T01:14:02.704863730Z [2024-04-06 01:14:02,704: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:14:02.705044920Z [2024-04-06 01:14:02,704: INFO/ForkPoolWorker-1] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:14:02.773263613Z [2024-04-06 01:14:02,772: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:14:02.776458898Z [2024-04-06 01:14:02,775: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:14:02.798840914Z [2024-04-06 01:14:02,798: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:14:02.800649531Z [2024-04-06 01:14:02,800: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:14:02.800783436Z [2024-04-06 01:14:02,800: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:14:02.800976000Z [2024-04-06 01:14:02,800: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:14:02.801096779Z [2024-04-06 01:14:02,800: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:14:02.801768809Z [2024-04-06 01:14:02,801: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:14:02.801973349Z [2024-04-06 01:14:02,801: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:14:02.802131647Z [2024-04-06 01:14:02,802: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:14:02.905125332Z [2024-04-06 01:14:02,904: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:14:05.173389321Z [2024-04-06 01:14:05,172: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e30d5685-f83b-495b-a34c-2f54c16073ed] succeeded in 4.161330057000669s: None 2024-04-06T01:14:05.304134704Z [2024-04-06 01:14:05,303: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c5260370-79d8-4ae8-91ae-45e7f5656325] succeeded in 4.287132567000299s: None 2024-04-06T01:15:00.570702796Z [2024-04-06 01:15:00,570: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[88aa6edd-1950-4431-9132-b81e6814b2c7] received 2024-04-06T01:15:00.574954115Z [2024-04-06 01:15:00,574: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bf3cdbe6-2d4d-4cd3-b1e4-dbe473c25212] received 2024-04-06T01:15:00.578327414Z [2024-04-06 01:15:00,577: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b42ca214-49ee-4546-806b-f378579caf2c] received 2024-04-06T01:15:00.578962018Z [2024-04-06 01:15:00,578: INFO/ForkPoolWorker-15] [88aa6edd-1950-4431-9132-b81e6814b2c7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T01:15:00.580759854Z [2024-04-06 01:15:00,580: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6722c5d6-b398-4255-b2ef-f4394dc7bdac] received 2024-04-06T01:15:00.585267088Z [2024-04-06 01:15:00,584: INFO/ForkPoolWorker-16] [bf3cdbe6-2d4d-4cd3-b1e4-dbe473c25212] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:15:00.594459822Z [2024-04-06 01:15:00,591: INFO/ForkPoolWorker-2] [6722c5d6-b398-4255-b2ef-f4394dc7bdac] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T01:15:00.596099509Z [2024-04-06 01:15:00,595: INFO/ForkPoolWorker-1] [b42ca214-49ee-4546-806b-f378579caf2c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:15:00.951385084Z [2024-04-06 01:15:00,947: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:15:00.980872231Z [2024-04-06 01:15:00,969: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T01:15:00.994652752Z [2024-04-06 01:15:00,991: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T01:15:01.057554102Z [2024-04-06 01:15:01,054: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:15:01.204237117Z [2024-04-06 01:15:01,201: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-06T01:15:01.211202177Z [2024-04-06 01:15:01,210: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:15:01.245940219Z [2024-04-06 01:15:01,245: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T01:15:01.247738004Z [2024-04-06 01:15:01,247: INFO/ForkPoolWorker-2] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T01:15:01.249533527Z [2024-04-06 01:15:01,247: INFO/ForkPoolWorker-2] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T01:15:01.249708763Z [2024-04-06 01:15:01,249: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-06T01:15:01.250025363Z [2024-04-06 01:15:01,249: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T01:15:01.344378946Z [2024-04-06 01:15:01,344: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:15:02.008097502Z [2024-04-06 01:15:02,007: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[6722c5d6-b398-4255-b2ef-f4394dc7bdac] succeeded in 1.4256725300001563s: None 2024-04-06T01:15:02.319629949Z [2024-04-06 01:15:02,319: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:15:02.324549725Z [2024-04-06 01:15:02,323: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:15:02.345749563Z [2024-04-06 01:15:02,345: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:15:02.347075883Z [2024-04-06 01:15:02,346: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:15:02.347142545Z [2024-04-06 01:15:02,346: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:15:02.347385048Z [2024-04-06 01:15:02,347: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:15:02.347415256Z [2024-04-06 01:15:02,347: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:15:02.347673213Z [2024-04-06 01:15:02,347: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:15:02.347858147Z [2024-04-06 01:15:02,347: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:15:02.411128664Z [2024-04-06 01:15:02,410: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T01:15:02.414365884Z [2024-04-06 01:15:02,413: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:15:02.430548012Z [2024-04-06 01:15:02,430: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:15:02.431739214Z [2024-04-06 01:15:02,431: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:15:02.435908923Z [2024-04-06 01:15:02,435: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T01:15:02.436329523Z [2024-04-06 01:15:02,435: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:15:02.437686375Z [2024-04-06 01:15:02,437: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:15:02.437700012Z [2024-04-06 01:15:02,437: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:15:02.437894081Z [2024-04-06 01:15:02,437: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:15:02.437906032Z [2024-04-06 01:15:02,437: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T01:15:02.438142871Z [2024-04-06 01:15:02,438: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:15:02.438153738Z [2024-04-06 01:15:02,438: INFO/ForkPoolWorker-1] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:15:02.459396292Z [2024-04-06 01:15:02,459: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:15:02.461548749Z [2024-04-06 01:15:02,461: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:15:02.461721959Z [2024-04-06 01:15:02,461: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:15:02.461951584Z [2024-04-06 01:15:02,461: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:15:02.462136829Z [2024-04-06 01:15:02,461: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:15:02.462530995Z [2024-04-06 01:15:02,462: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T01:15:02.463470639Z [2024-04-06 01:15:02,462: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:15:02.551230216Z [2024-04-06 01:15:02,550: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:15:02.577308381Z [2024-04-06 01:15:02,576: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:15:03.176708446Z [2024-04-06 01:15:03,175: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[88aa6edd-1950-4431-9132-b81e6814b2c7] succeeded in 2.6033467230008682s: None 2024-04-06T01:15:03.871367635Z [2024-04-06 01:15:03,871: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[99848db3-d261-4cc7-bfd8-d84086bb1d71] received 2024-04-06T01:15:03.880703776Z [2024-04-06 01:15:03,880: INFO/ForkPoolWorker-15] [99848db3-d261-4cc7-bfd8-d84086bb1d71] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'split_metrics', 'scheduled__2024-04-06T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T01:15:04.113146897Z [2024-04-06 01:15:04,112: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b42ca214-49ee-4546-806b-f378579caf2c] succeeded in 3.5288166720001755s: None 2024-04-06T01:15:04.190742415Z [2024-04-06 01:15:04,187: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T01:15:04.587343367Z [2024-04-06 01:15:04,586: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[bf3cdbe6-2d4d-4cd3-b1e4-dbe473c25212] succeeded in 4.0103711820011085s: None 2024-04-06T01:15:05.394031362Z [2024-04-06 01:15:05,393: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:15:05.397309948Z [2024-04-06 01:15:05,396: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:15:05.417584374Z [2024-04-06 01:15:05,417: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:15:05.419173702Z [2024-04-06 01:15:05,418: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:15:05.419405553Z [2024-04-06 01:15:05,419: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:15:05.419653670Z [2024-04-06 01:15:05,419: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:15:05.419804644Z [2024-04-06 01:15:05,419: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:15:05.420158767Z [2024-04-06 01:15:05,420: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T01:15:05.420300503Z [2024-04-06 01:15:05,420: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:15:05.519381402Z [2024-04-06 01:15:05,518: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:15:06.177729074Z [2024-04-06 01:15:06,177: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[99848db3-d261-4cc7-bfd8-d84086bb1d71] succeeded in 2.302669048000098s: None 2024-04-06T01:15:06.312385394Z [2024-04-06 01:15:06,312: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8a2722b5-915c-4d17-91fe-84930b2c7781] received 2024-04-06T01:15:06.318045865Z [2024-04-06 01:15:06,317: INFO/ForkPoolWorker-15] [8a2722b5-915c-4d17-91fe-84930b2c7781] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'collect_metrics', 'scheduled__2024-04-06T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T01:15:06.597369841Z [2024-04-06 01:15:06,594: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T01:15:07.702077675Z [2024-04-06 01:15:07,701: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:15:07.705104926Z [2024-04-06 01:15:07,704: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:15:07.725858742Z [2024-04-06 01:15:07,725: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:15:07.727431698Z [2024-04-06 01:15:07,727: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:15:07.727463670Z [2024-04-06 01:15:07,727: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:15:07.727547850Z [2024-04-06 01:15:07,727: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:15:07.727625650Z [2024-04-06 01:15:07,727: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:15:07.728227270Z [2024-04-06 01:15:07,728: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T01:15:07.728359578Z [2024-04-06 01:15:07,728: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:15:07.821148769Z [2024-04-06 01:15:07,820: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:15:08.362071220Z [2024-04-06 01:15:08,361: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8a2722b5-915c-4d17-91fe-84930b2c7781] succeeded in 2.0481480929993268s: None 2024-04-06T01:15:08.931067642Z [2024-04-06 01:15:08,930: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[32cbf9e3-50f7-4479-8a48-429800e2d378] received 2024-04-06T01:15:08.940350472Z [2024-04-06 01:15:08,939: INFO/ForkPoolWorker-15] [32cbf9e3-50f7-4479-8a48-429800e2d378] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'send_prometheus', 'scheduled__2024-04-06T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T01:15:09.200425591Z [2024-04-06 01:15:09,196: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T01:15:10.422023963Z [2024-04-06 01:15:10,421: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:15:10.425321462Z [2024-04-06 01:15:10,424: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:15:10.452072931Z [2024-04-06 01:15:10,451: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:15:10.453490282Z [2024-04-06 01:15:10,453: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:15:10.453653435Z [2024-04-06 01:15:10,453: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:15:10.453904850Z [2024-04-06 01:15:10,453: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:15:10.454075608Z [2024-04-06 01:15:10,453: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:15:10.454418932Z [2024-04-06 01:15:10,454: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T01:15:10.454451586Z [2024-04-06 01:15:10,454: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:15:10.546571750Z [2024-04-06 01:15:10,546: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:15:11.138601514Z [2024-04-06 01:15:11,138: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[32cbf9e3-50f7-4479-8a48-429800e2d378] succeeded in 2.2055471790008596s: None 2024-04-06T01:15:38.318848212Z [2024-04-06 01:15:38,318: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[78ef18ff-0393-41ef-a113-15697cf76b79] received 2024-04-06T01:15:38.328640992Z [2024-04-06 01:15:38,328: INFO/ForkPoolWorker-15] [78ef18ff-0393-41ef-a113-15697cf76b79] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240406011537_587977', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-04-06T01:15:38.574473131Z [2024-04-06 01:15:38,571: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_down.py 2024-04-06T01:15:38.889912913Z [2024-04-06 01:15:38,889: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:15:39.511851442Z [2024-04-06 01:15:39,511: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[78ef18ff-0393-41ef-a113-15697cf76b79] succeeded in 1.1897269769997365s: None 2024-04-06T01:16:01.070194620Z [2024-04-06 01:16:01,069: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ba68a094-baf3-41d3-8f15-f8f5cc1d9e5d] received 2024-04-06T01:16:01.074846325Z [2024-04-06 01:16:01,074: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[43805807-7c64-42a2-a726-3cfe5d9c3e98] received 2024-04-06T01:16:01.077854869Z [2024-04-06 01:16:01,077: INFO/ForkPoolWorker-15] [ba68a094-baf3-41d3-8f15-f8f5cc1d9e5d] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T01:16:01.085782225Z [2024-04-06 01:16:01,085: INFO/ForkPoolWorker-16] [43805807-7c64-42a2-a726-3cfe5d9c3e98] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:16:01.092998352Z [2024-04-06 01:16:01,092: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[07bc2ea9-5227-415f-8f7e-545045c47612] received 2024-04-06T01:16:01.114682694Z [2024-04-06 01:16:01,114: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[704db473-3a94-4d55-b60c-039892cec78e] received 2024-04-06T01:16:01.116135782Z [2024-04-06 01:16:01,115: INFO/ForkPoolWorker-1] [07bc2ea9-5227-415f-8f7e-545045c47612] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:16:01.132049327Z [2024-04-06 01:16:01,131: INFO/ForkPoolWorker-2] [704db473-3a94-4d55-b60c-039892cec78e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T01:16:01.372330677Z [2024-04-06 01:16:01,369: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:16:01.450553218Z [2024-04-06 01:16:01,447: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T01:16:01.503239626Z [2024-04-06 01:16:01,493: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:16:01.582251852Z [2024-04-06 01:16:01,578: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T01:16:01.712927896Z [2024-04-06 01:16:01,712: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:16:01.807371967Z [2024-04-06 01:16:01,806: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-06T01:16:01.831642322Z [2024-04-06 01:16:01,822: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:16:01.869262514Z [2024-04-06 01:16:01,868: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T01:16:01.870415822Z [2024-04-06 01:16:01,870: INFO/ForkPoolWorker-2] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T01:16:01.870618297Z [2024-04-06 01:16:01,870: INFO/ForkPoolWorker-2] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T01:16:01.870685052Z [2024-04-06 01:16:01,870: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-06T01:16:01.871025041Z [2024-04-06 01:16:01,870: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T01:16:01.979843563Z [2024-04-06 01:16:01,979: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:16:02.518102550Z [2024-04-06 01:16:02,517: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ba68a094-baf3-41d3-8f15-f8f5cc1d9e5d] succeeded in 1.4464368979988649s: None 2024-04-06T01:16:02.640145526Z [2024-04-06 01:16:02,639: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[704db473-3a94-4d55-b60c-039892cec78e] succeeded in 1.518920070000604s: None 2024-04-06T01:16:02.939514551Z [2024-04-06 01:16:02,939: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:16:02.943107325Z [2024-04-06 01:16:02,942: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:16:02.971134138Z [2024-04-06 01:16:02,970: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:16:02.973106429Z [2024-04-06 01:16:02,972: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:16:02.974440492Z [2024-04-06 01:16:02,973: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:16:02.974453101Z [2024-04-06 01:16:02,974: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:16:02.975652544Z [2024-04-06 01:16:02,974: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:16:02.976113636Z [2024-04-06 01:16:02,975: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:16:02.976339360Z [2024-04-06 01:16:02,976: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:16:02.996909678Z [2024-04-06 01:16:02,996: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T01:16:03.000037842Z [2024-04-06 01:16:02,999: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:16:03.037113449Z [2024-04-06 01:16:03,036: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T01:16:03.038659458Z [2024-04-06 01:16:03,038: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:16:03.038675587Z [2024-04-06 01:16:03,038: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:16:03.038784076Z [2024-04-06 01:16:03,038: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:16:03.038793592Z [2024-04-06 01:16:03,038: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T01:16:03.039054549Z [2024-04-06 01:16:03,038: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:16:03.039092044Z [2024-04-06 01:16:03,039: INFO/ForkPoolWorker-1] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:16:03.073522879Z [2024-04-06 01:16:03,073: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:16:03.139314370Z [2024-04-06 01:16:03,138: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:16:06.513443787Z [2024-04-06 01:16:06,512: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[07bc2ea9-5227-415f-8f7e-545045c47612] succeeded in 5.411841897999693s: None 2024-04-06T01:16:06.664295884Z [2024-04-06 01:16:06,663: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[43805807-7c64-42a2-a726-3cfe5d9c3e98] succeeded in 5.585963822000849s: None 2024-04-06T01:17:00.406091855Z [2024-04-06 01:17:00,405: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[95c73dd6-ae9c-4bae-920a-8866f057464f] received 2024-04-06T01:17:00.416060861Z [2024-04-06 01:17:00,415: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fe71d9e2-da47-4437-bfc1-14f4ef843cfd] received 2024-04-06T01:17:00.418969913Z [2024-04-06 01:17:00,418: INFO/ForkPoolWorker-15] [95c73dd6-ae9c-4bae-920a-8866f057464f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:17:00.435817863Z [2024-04-06 01:17:00,435: INFO/ForkPoolWorker-16] [fe71d9e2-da47-4437-bfc1-14f4ef843cfd] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T01:17:00.441703532Z [2024-04-06 01:17:00,441: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ea8abfcd-3287-42bb-b7ff-b5da8e62fdcb] received 2024-04-06T01:17:00.448226391Z [2024-04-06 01:17:00,447: INFO/ForkPoolWorker-1] [ea8abfcd-3287-42bb-b7ff-b5da8e62fdcb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:17:00.724635868Z [2024-04-06 01:17:00,721: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:17:00.765092663Z [2024-04-06 01:17:00,761: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T01:17:00.765145100Z [2024-04-06 01:17:00,761: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:17:00.941861066Z [2024-04-06 01:17:00,941: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-06T01:17:00.945930684Z [2024-04-06 01:17:00,945: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:17:00.992990512Z [2024-04-06 01:17:00,992: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:17:00.996005514Z [2024-04-06 01:17:00,995: INFO/ForkPoolWorker-16] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T01:17:00.996318608Z [2024-04-06 01:17:00,996: INFO/ForkPoolWorker-16] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T01:17:00.996492742Z [2024-04-06 01:17:00,996: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-06T01:17:00.996827318Z [2024-04-06 01:17:00,996: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T01:17:01.117499807Z [2024-04-06 01:17:01,117: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:17:01.694982151Z [2024-04-06 01:17:01,694: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[fe71d9e2-da47-4437-bfc1-14f4ef843cfd] succeeded in 1.2679399829994509s: None 2024-04-06T01:17:01.903081224Z [2024-04-06 01:17:01,901: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T01:17:01.906079211Z [2024-04-06 01:17:01,905: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:17:01.939416179Z [2024-04-06 01:17:01,939: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T01:17:01.940965830Z [2024-04-06 01:17:01,940: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:17:01.940983496Z [2024-04-06 01:17:01,940: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:17:01.941073778Z [2024-04-06 01:17:01,940: INFO/ForkPoolWorker-1] Read VIM b8f207dc-e9d9-41ff-a9ad-ff74d6b81ce9 (basic01_132153) 2024-04-06T01:17:01.941270883Z [2024-04-06 01:17:01,941: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'b8f207dc-e9d9-41ff-a9ad-ff74d6b81ce9', 'name': 'basic01_132153', 'vim_type': 'openstack'}] 2024-04-06T01:17:01.941299388Z [2024-04-06 01:17:01,941: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T01:17:01.941638390Z [2024-04-06 01:17:01,941: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:17:01.941646111Z [2024-04-06 01:17:01,941: INFO/ForkPoolWorker-1] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:17:01.947737949Z [2024-04-06 01:17:01,947: INFO/ForkPoolWorker-1] Creating DAG vim_status_b8f207dc-e9d9-41ff-a9ad-ff74d6b81ce9 2024-04-06T01:17:01.954966194Z [2024-04-06 01:17:01,954: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:17:01.958277462Z [2024-04-06 01:17:01,957: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:17:01.984263197Z [2024-04-06 01:17:01,984: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:17:01.985685902Z [2024-04-06 01:17:01,985: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:17:01.985718464Z [2024-04-06 01:17:01,985: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:17:01.985722526Z [2024-04-06 01:17:01,985: INFO/ForkPoolWorker-15] Read VIM b8f207dc-e9d9-41ff-a9ad-ff74d6b81ce9 (basic01_132153) 2024-04-06T01:17:01.985857645Z [2024-04-06 01:17:01,985: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'b8f207dc-e9d9-41ff-a9ad-ff74d6b81ce9', 'name': 'basic01_132153', 'vim_type': 'openstack'}] 2024-04-06T01:17:01.985890009Z [2024-04-06 01:17:01,985: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:17:01.986103752Z [2024-04-06 01:17:01,986: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:17:01.986139886Z [2024-04-06 01:17:01,986: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:17:01.991077630Z [2024-04-06 01:17:01,990: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_b8f207dc-e9d9-41ff-a9ad-ff74d6b81ce9 2024-04-06T01:17:02.064684578Z [2024-04-06 01:17:02,064: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:17:02.106155730Z [2024-04-06 01:17:02,105: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:17:03.804234214Z [2024-04-06 01:17:03,803: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ea8abfcd-3287-42bb-b7ff-b5da8e62fdcb] succeeded in 3.360993614000108s: None 2024-04-06T01:17:04.312578478Z [2024-04-06 01:17:04,312: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[95c73dd6-ae9c-4bae-920a-8866f057464f] succeeded in 3.899838909999744s: None 2024-04-06T01:17:26.217027716Z [2024-04-06 01:17:26,216: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ccc5edfb-9b4e-4b7e-87ac-de3930e7698c] received 2024-04-06T01:17:26.227757430Z [2024-04-06 01:17:26,227: INFO/ForkPoolWorker-15] [ccc5edfb-9b4e-4b7e-87ac-de3930e7698c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_b8f207dc-e9d9-41ff-a9ad-ff74d6b81ce9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:17:26.527746662Z [2024-04-06 01:17:26,524: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:17:27.613868684Z [2024-04-06 01:17:27,613: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:17:27.617096056Z [2024-04-06 01:17:27,616: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:17:27.637834001Z [2024-04-06 01:17:27,637: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:17:27.639077849Z [2024-04-06 01:17:27,638: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:17:27.639179901Z [2024-04-06 01:17:27,639: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:17:27.639371323Z [2024-04-06 01:17:27,639: INFO/ForkPoolWorker-15] Read VIM b8f207dc-e9d9-41ff-a9ad-ff74d6b81ce9 (basic01_132153) 2024-04-06T01:17:27.639543914Z [2024-04-06 01:17:27,639: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'b8f207dc-e9d9-41ff-a9ad-ff74d6b81ce9', 'name': 'basic01_132153', 'vim_type': 'openstack'}] 2024-04-06T01:17:27.639600369Z [2024-04-06 01:17:27,639: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:17:27.639859580Z [2024-04-06 01:17:27,639: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:17:27.639928737Z [2024-04-06 01:17:27,639: INFO/ForkPoolWorker-15] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:17:27.644524749Z [2024-04-06 01:17:27,644: INFO/ForkPoolWorker-15] Creating DAG vim_status_b8f207dc-e9d9-41ff-a9ad-ff74d6b81ce9 2024-04-06T01:17:27.717366615Z [2024-04-06 01:17:27,717: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:17:28.555595512Z [2024-04-06 01:17:28,555: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[22eef7ec-a888-4792-9645-3d82df343926] received 2024-04-06T01:17:28.569022978Z [2024-04-06 01:17:28,568: INFO/ForkPoolWorker-16] [22eef7ec-a888-4792-9645-3d82df343926] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_b8f207dc-e9d9-41ff-a9ad-ff74d6b81ce9', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T01:17:28.839406515Z [2024-04-06 01:17:28,836: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T01:17:29.248701096Z [2024-04-06 01:17:29,248: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ccc5edfb-9b4e-4b7e-87ac-de3930e7698c] succeeded in 3.0299502680009027s: None 2024-04-06T01:17:29.936027576Z [2024-04-06 01:17:29,935: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:17:29.940238131Z [2024-04-06 01:17:29,938: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:17:29.963501780Z [2024-04-06 01:17:29,963: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:17:29.965582568Z [2024-04-06 01:17:29,965: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:17:29.965705418Z [2024-04-06 01:17:29,965: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:17:29.965810105Z [2024-04-06 01:17:29,965: INFO/ForkPoolWorker-16] Read VIM b8f207dc-e9d9-41ff-a9ad-ff74d6b81ce9 (basic01_132153) 2024-04-06T01:17:29.966012040Z [2024-04-06 01:17:29,965: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'b8f207dc-e9d9-41ff-a9ad-ff74d6b81ce9', 'name': 'basic01_132153', 'vim_type': 'openstack'}] 2024-04-06T01:17:29.966110460Z [2024-04-06 01:17:29,966: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:17:29.966413419Z [2024-04-06 01:17:29,966: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T01:17:29.966504267Z [2024-04-06 01:17:29,966: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:17:29.973716800Z [2024-04-06 01:17:29,973: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_b8f207dc-e9d9-41ff-a9ad-ff74d6b81ce9 2024-04-06T01:17:30.142082652Z [2024-04-06 01:17:30,141: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:17:30.236178984Z [2024-04-06 01:17:30,235: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0da54482-23f8-4cf2-8abe-27566c0c017b] received 2024-04-06T01:17:30.262890905Z [2024-04-06 01:17:30,262: INFO/ForkPoolWorker-15] [0da54482-23f8-4cf2-8abe-27566c0c017b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_b8f207dc-e9d9-41ff-a9ad-ff74d6b81ce9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:17:30.568377176Z [2024-04-06 01:17:30,563: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:17:30.756360257Z [2024-04-06 01:17:30,755: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[22eef7ec-a888-4792-9645-3d82df343926] succeeded in 2.199012348000906s: None 2024-04-06T01:17:30.858088261Z [2024-04-06 01:17:30,857: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0765621e-5c6b-488c-926b-fba2d904fb96] received 2024-04-06T01:17:30.879517112Z [2024-04-06 01:17:30,879: INFO/ForkPoolWorker-16] [0765621e-5c6b-488c-926b-fba2d904fb96] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_b8f207dc-e9d9-41ff-a9ad-ff74d6b81ce9', 'split_metrics', 'scheduled__2024-04-06T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T01:17:31.201566567Z [2024-04-06 01:17:31,198: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T01:17:31.648034261Z [2024-04-06 01:17:31,647: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:17:31.651205338Z [2024-04-06 01:17:31,650: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:17:31.684302962Z [2024-04-06 01:17:31,684: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:17:31.686427907Z [2024-04-06 01:17:31,686: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:17:31.686492467Z [2024-04-06 01:17:31,686: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:17:31.686662398Z [2024-04-06 01:17:31,686: INFO/ForkPoolWorker-15] Read VIM b8f207dc-e9d9-41ff-a9ad-ff74d6b81ce9 (basic01_132153) 2024-04-06T01:17:31.686999408Z [2024-04-06 01:17:31,686: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'b8f207dc-e9d9-41ff-a9ad-ff74d6b81ce9', 'name': 'basic01_132153', 'vim_type': 'openstack'}] 2024-04-06T01:17:31.687184924Z [2024-04-06 01:17:31,687: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:17:31.687613757Z [2024-04-06 01:17:31,687: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:17:31.687773422Z [2024-04-06 01:17:31,687: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:17:31.694769616Z [2024-04-06 01:17:31,694: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_b8f207dc-e9d9-41ff-a9ad-ff74d6b81ce9 2024-04-06T01:17:31.784630344Z [2024-04-06 01:17:31,784: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:17:32.326797520Z [2024-04-06 01:17:32,326: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:17:32.331010078Z [2024-04-06 01:17:32,330: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:17:32.356164913Z [2024-04-06 01:17:32,355: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:17:32.358996776Z [2024-04-06 01:17:32,358: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:17:32.359114902Z [2024-04-06 01:17:32,358: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:17:32.359301185Z [2024-04-06 01:17:32,359: INFO/ForkPoolWorker-16] Read VIM b8f207dc-e9d9-41ff-a9ad-ff74d6b81ce9 (basic01_132153) 2024-04-06T01:17:32.359711863Z [2024-04-06 01:17:32,359: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'b8f207dc-e9d9-41ff-a9ad-ff74d6b81ce9', 'name': 'basic01_132153', 'vim_type': 'openstack'}] 2024-04-06T01:17:32.359836681Z [2024-04-06 01:17:32,359: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:17:32.360267754Z [2024-04-06 01:17:32,360: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T01:17:32.360401078Z [2024-04-06 01:17:32,360: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:17:32.370770103Z [2024-04-06 01:17:32,370: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_b8f207dc-e9d9-41ff-a9ad-ff74d6b81ce9 2024-04-06T01:17:32.444430177Z [2024-04-06 01:17:32,444: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:17:33.161325972Z [2024-04-06 01:17:33,159: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0765621e-5c6b-488c-926b-fba2d904fb96] succeeded in 2.2974743980012136s: None 2024-04-06T01:17:33.642861199Z [2024-04-06 01:17:33,641: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0da54482-23f8-4cf2-8abe-27566c0c017b] succeeded in 3.401357631999417s: None 2024-04-06T01:17:34.053109036Z [2024-04-06 01:17:34,052: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c6b4418b-7003-4d74-b7bf-793b16d75839] received 2024-04-06T01:17:34.064640010Z [2024-04-06 01:17:34,064: INFO/ForkPoolWorker-15] [c6b4418b-7003-4d74-b7bf-793b16d75839] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_b8f207dc-e9d9-41ff-a9ad-ff74d6b81ce9', 'collect_metrics', 'scheduled__2024-04-06T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T01:17:34.381960349Z [2024-04-06 01:17:34,378: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T01:17:35.555616132Z [2024-04-06 01:17:35,555: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:17:35.558451964Z [2024-04-06 01:17:35,558: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:17:35.580503220Z [2024-04-06 01:17:35,580: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:17:35.581985299Z [2024-04-06 01:17:35,581: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:17:35.581998180Z [2024-04-06 01:17:35,581: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:17:35.582111636Z [2024-04-06 01:17:35,581: INFO/ForkPoolWorker-15] Read VIM b8f207dc-e9d9-41ff-a9ad-ff74d6b81ce9 (basic01_132153) 2024-04-06T01:17:35.582266473Z [2024-04-06 01:17:35,582: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'b8f207dc-e9d9-41ff-a9ad-ff74d6b81ce9', 'name': 'basic01_132153', 'vim_type': 'openstack'}] 2024-04-06T01:17:35.582304066Z [2024-04-06 01:17:35,582: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:17:35.582570533Z [2024-04-06 01:17:35,582: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T01:17:35.582603725Z [2024-04-06 01:17:35,582: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:17:35.588198219Z [2024-04-06 01:17:35,587: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_b8f207dc-e9d9-41ff-a9ad-ff74d6b81ce9 2024-04-06T01:17:35.671293680Z [2024-04-06 01:17:35,670: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:17:36.252605568Z [2024-04-06 01:17:36,251: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c6b4418b-7003-4d74-b7bf-793b16d75839] succeeded in 2.197211556000184s: None 2024-04-06T01:17:36.473754056Z [2024-04-06 01:17:36,473: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6e064154-6cb3-4d98-8974-017ac8d28729] received 2024-04-06T01:17:36.483521786Z [2024-04-06 01:17:36,483: INFO/ForkPoolWorker-15] [6e064154-6cb3-4d98-8974-017ac8d28729] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_b8f207dc-e9d9-41ff-a9ad-ff74d6b81ce9', 'send_prometheus', 'scheduled__2024-04-06T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T01:17:36.735441148Z [2024-04-06 01:17:36,732: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T01:17:37.814412797Z [2024-04-06 01:17:37,814: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:17:37.817493750Z [2024-04-06 01:17:37,817: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:17:37.837500665Z [2024-04-06 01:17:37,837: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:17:37.838662400Z [2024-04-06 01:17:37,838: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:17:37.838800297Z [2024-04-06 01:17:37,838: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:17:37.838942328Z [2024-04-06 01:17:37,838: INFO/ForkPoolWorker-15] Read VIM b8f207dc-e9d9-41ff-a9ad-ff74d6b81ce9 (basic01_132153) 2024-04-06T01:17:37.839160359Z [2024-04-06 01:17:37,838: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'b8f207dc-e9d9-41ff-a9ad-ff74d6b81ce9', 'name': 'basic01_132153', 'vim_type': 'openstack'}] 2024-04-06T01:17:37.839360001Z [2024-04-06 01:17:37,839: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:17:37.839696256Z [2024-04-06 01:17:37,839: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T01:17:37.839851118Z [2024-04-06 01:17:37,839: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:17:37.845351894Z [2024-04-06 01:17:37,845: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_b8f207dc-e9d9-41ff-a9ad-ff74d6b81ce9 2024-04-06T01:17:37.920085488Z [2024-04-06 01:17:37,919: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:17:38.526178439Z [2024-04-06 01:17:38,525: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6e064154-6cb3-4d98-8974-017ac8d28729] succeeded in 2.049137680998683s: None 2024-04-06T01:17:38.876533313Z [2024-04-06 01:17:38,876: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2014024e-5430-45b3-81b4-fcc570c9aaaf] received 2024-04-06T01:17:38.888983533Z [2024-04-06 01:17:38,888: INFO/ForkPoolWorker-15] [2014024e-5430-45b3-81b4-fcc570c9aaaf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240406011737_088188', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-04-06T01:17:39.174529758Z [2024-04-06 01:17:39,170: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_down.py 2024-04-06T01:17:39.488033894Z [2024-04-06 01:17:39,487: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:17:40.037911417Z [2024-04-06 01:17:40,033: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2014024e-5430-45b3-81b4-fcc570c9aaaf] succeeded in 1.154290858999957s: None 2024-04-06T01:18:01.070337325Z [2024-04-06 01:18:01,069: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8df17637-ec2c-4874-92e7-84fb3d6dd772] received 2024-04-06T01:18:01.074839279Z [2024-04-06 01:18:01,074: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b0b8b693-a1c6-4c26-b3c2-ffd961d0f5b1] received 2024-04-06T01:18:01.077599393Z [2024-04-06 01:18:01,077: INFO/ForkPoolWorker-15] [8df17637-ec2c-4874-92e7-84fb3d6dd772] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_b8f207dc-e9d9-41ff-a9ad-ff74d6b81ce9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:18:01.077618587Z [2024-04-06 01:18:01,077: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7a5ebb3e-0d2a-41e5-90b8-1d3d949359f3] received 2024-04-06T01:18:01.080950680Z [2024-04-06 01:18:01,080: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[372b1723-7a5c-44f6-ad67-fe457e0b6453] received 2024-04-06T01:18:01.082950614Z [2024-04-06 01:18:01,082: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[65e2cb34-9adb-4f53-9b28-8d0cc78bc6a2] received 2024-04-06T01:18:01.086419040Z [2024-04-06 01:18:01,086: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fe49f3f0-9aef-42fc-adcc-3b1e4fa3fc17] received 2024-04-06T01:18:01.094390584Z [2024-04-06 01:18:01,094: INFO/ForkPoolWorker-1] [7a5ebb3e-0d2a-41e5-90b8-1d3d949359f3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_b8f207dc-e9d9-41ff-a9ad-ff74d6b81ce9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:18:01.097822729Z [2024-04-06 01:18:01,097: INFO/ForkPoolWorker-4] [fe49f3f0-9aef-42fc-adcc-3b1e4fa3fc17] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:18:01.112181107Z [2024-04-06 01:18:01,111: INFO/ForkPoolWorker-3] [65e2cb34-9adb-4f53-9b28-8d0cc78bc6a2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T01:18:01.112592886Z [2024-04-06 01:18:01,112: INFO/ForkPoolWorker-16] [b0b8b693-a1c6-4c26-b3c2-ffd961d0f5b1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:18:01.113876448Z [2024-04-06 01:18:01,113: INFO/ForkPoolWorker-2] [372b1723-7a5c-44f6-ad67-fe457e0b6453] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T01:18:01.524838745Z [2024-04-06 01:18:01,521: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:18:01.538276554Z [2024-04-06 01:18:01,534: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:18:01.722995811Z [2024-04-06 01:18:01,719: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T01:18:01.797183822Z [2024-04-06 01:18:01,793: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:18:01.831336367Z [2024-04-06 01:18:01,827: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T01:18:01.855891285Z [2024-04-06 01:18:01,852: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:18:02.035515725Z [2024-04-06 01:18:02,035: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:18:02.289217590Z [2024-04-06 01:18:02,288: INFO/ForkPoolWorker-3] Getting SDNC list 2024-04-06T01:18:02.293451555Z [2024-04-06 01:18:02,292: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:18:02.332265328Z [2024-04-06 01:18:02,332: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-06T01:18:02.333460234Z [2024-04-06 01:18:02,333: INFO/ForkPoolWorker-3] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T01:18:02.333667825Z [2024-04-06 01:18:02,333: INFO/ForkPoolWorker-3] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T01:18:02.333730944Z [2024-04-06 01:18:02,333: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-04-06T01:18:02.334026622Z [2024-04-06 01:18:02,333: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T01:18:02.478553970Z [2024-04-06 01:18:02,478: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:18:02.812579230Z [2024-04-06 01:18:02,812: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[372b1723-7a5c-44f6-ad67-fe457e0b6453] succeeded in 1.7265735800010589s: None 2024-04-06T01:18:03.358228153Z [2024-04-06 01:18:03,357: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[65e2cb34-9adb-4f53-9b28-8d0cc78bc6a2] succeeded in 2.2694797290005226s: None 2024-04-06T01:18:03.460214697Z [2024-04-06 01:18:03,459: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:18:03.467066609Z [2024-04-06 01:18:03,466: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:18:03.467743334Z [2024-04-06 01:18:03,467: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:18:03.471131034Z [2024-04-06 01:18:03,470: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:18:03.496040166Z [2024-04-06 01:18:03,495: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:18:03.497732697Z [2024-04-06 01:18:03,497: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:18:03.498208757Z [2024-04-06 01:18:03,497: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:18:03.498534013Z [2024-04-06 01:18:03,498: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:18:03.498791512Z [2024-04-06 01:18:03,498: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:18:03.499220562Z [2024-04-06 01:18:03,498: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:18:03.499591483Z [2024-04-06 01:18:03,499: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:18:03.500169337Z [2024-04-06 01:18:03,499: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:18:03.502662571Z [2024-04-06 01:18:03,502: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:18:03.502719049Z [2024-04-06 01:18:03,502: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:18:03.502929926Z [2024-04-06 01:18:03,502: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:18:03.503027934Z [2024-04-06 01:18:03,502: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:18:03.503484502Z [2024-04-06 01:18:03,503: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:18:03.503538131Z [2024-04-06 01:18:03,503: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:18:03.507370833Z [2024-04-06 01:18:03,507: WARNING/ForkPoolWorker-15] Dag 'vm_status_vim_b8f207dc-e9d9-41ff-a9ad-ff74d6b81ce9' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:18:03.508160379Z [2024-04-06 01:18:03,507: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:18:03.511158092Z [2024-04-06 01:18:03,510: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:18:03.518333750Z [2024-04-06 01:18:03,517: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:18:03.549466727Z [2024-04-06 01:18:03,549: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:18:03.551901542Z [2024-04-06 01:18:03,551: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:18:03.551956981Z [2024-04-06 01:18:03,551: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:18:03.552162288Z [2024-04-06 01:18:03,551: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:18:03.552326695Z [2024-04-06 01:18:03,552: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:18:03.552672035Z [2024-04-06 01:18:03,552: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:18:03.552748508Z [2024-04-06 01:18:03,552: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:18:03.556315568Z [2024-04-06 01:18:03,555: ERROR/ForkPoolWorker-15] [8df17637-ec2c-4874-92e7-84fb3d6dd772] Failed to execute task Dag 'vm_status_vim_b8f207dc-e9d9-41ff-a9ad-ff74d6b81ce9' could not be found; either it does not exist or it failed to parse.. 2024-04-06T01:18:03.556336910Z Traceback (most recent call last): 2024-04-06T01:18:03.556341300Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-06T01:18:03.556345515Z args.func(args) 2024-04-06T01:18:03.556349460Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-06T01:18:03.556353879Z return func(*args, **kwargs) 2024-04-06T01:18:03.556357820Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-06T01:18:03.556361261Z return f(*args, **kwargs) 2024-04-06T01:18:03.556364773Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-06T01:18:03.556368409Z dag = get_dag(args.subdir, args.dag_id) 2024-04-06T01:18:03.556371948Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-06T01:18:03.556376068Z raise AirflowException( 2024-04-06T01:18:03.556380616Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_b8f207dc-e9d9-41ff-a9ad-ff74d6b81ce9' could not be found; either it does not exist or it failed to parse. 2024-04-06T01:18:03.621768015Z [2024-04-06 01:18:03,621: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:18:03.633560110Z [2024-04-06 01:18:03,632: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8df17637-ec2c-4874-92e7-84fb3d6dd772] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 8df17637-ec2c-4874-92e7-84fb3d6dd772') 2024-04-06T01:18:03.633581146Z Traceback (most recent call last): 2024-04-06T01:18:03.633589060Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-06T01:18:03.633622552Z R = retval = fun(*args, **kwargs) 2024-04-06T01:18:03.633629244Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-06T01:18:03.633635267Z return self.run(*args, **kwargs) 2024-04-06T01:18:03.633642256Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-06T01:18:03.633648985Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-06T01:18:03.633655078Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-06T01:18:03.633668744Z raise AirflowException(msg) 2024-04-06T01:18:03.633675968Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 8df17637-ec2c-4874-92e7-84fb3d6dd772 2024-04-06T01:18:03.848258709Z [2024-04-06 01:18:03,847: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T01:18:03.852185017Z [2024-04-06 01:18:03,851: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:18:03.894708967Z [2024-04-06 01:18:03,894: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T01:18:03.898529966Z [2024-04-06 01:18:03,898: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:18:03.898914604Z [2024-04-06 01:18:03,898: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:18:03.899185397Z [2024-04-06 01:18:03,898: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:18:03.899407825Z [2024-04-06 01:18:03,899: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T01:18:03.899791188Z [2024-04-06 01:18:03,899: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:18:03.900096070Z [2024-04-06 01:18:03,899: INFO/ForkPoolWorker-1] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:18:03.909968465Z [2024-04-06 01:18:03,909: WARNING/ForkPoolWorker-1] Dag 'vim_status_b8f207dc-e9d9-41ff-a9ad-ff74d6b81ce9' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:18:03.911544542Z [2024-04-06 01:18:03,910: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:18:03.914234347Z [2024-04-06 01:18:03,913: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T01:18:03.923001772Z [2024-04-06 01:18:03,922: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:18:03.941311286Z [2024-04-06 01:18:03,941: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T01:18:03.943032197Z [2024-04-06 01:18:03,942: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:18:03.943050465Z [2024-04-06 01:18:03,942: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:18:03.943162839Z [2024-04-06 01:18:03,943: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:18:03.943193521Z [2024-04-06 01:18:03,943: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T01:18:03.944130928Z [2024-04-06 01:18:03,943: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:18:03.944148574Z [2024-04-06 01:18:03,944: INFO/ForkPoolWorker-1] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:18:03.950621334Z [2024-04-06 01:18:03,950: ERROR/ForkPoolWorker-1] [7a5ebb3e-0d2a-41e5-90b8-1d3d949359f3] Failed to execute task Dag 'vim_status_b8f207dc-e9d9-41ff-a9ad-ff74d6b81ce9' could not be found; either it does not exist or it failed to parse.. 2024-04-06T01:18:03.950631322Z Traceback (most recent call last): 2024-04-06T01:18:03.950651448Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-06T01:18:03.950655262Z args.func(args) 2024-04-06T01:18:03.950658875Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-06T01:18:03.950662484Z return func(*args, **kwargs) 2024-04-06T01:18:03.950665543Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-06T01:18:03.950668572Z return f(*args, **kwargs) 2024-04-06T01:18:03.950696379Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-06T01:18:03.950699873Z dag = get_dag(args.subdir, args.dag_id) 2024-04-06T01:18:03.950703375Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-06T01:18:03.950706480Z raise AirflowException( 2024-04-06T01:18:03.950710370Z airflow.exceptions.AirflowException: Dag 'vim_status_b8f207dc-e9d9-41ff-a9ad-ff74d6b81ce9' could not be found; either it does not exist or it failed to parse. 2024-04-06T01:18:03.954482652Z [2024-04-06 01:18:03,952: INFO/ForkPoolWorker-4] Getting VIM list 2024-04-06T01:18:03.958279975Z [2024-04-06 01:18:03,956: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:18:03.983760003Z [2024-04-06 01:18:03,983: INFO/ForkPoolWorker-4] Connected to database osm version 1.2 2024-04-06T01:18:03.984972979Z [2024-04-06 01:18:03,984: INFO/ForkPoolWorker-4] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:18:03.985171272Z [2024-04-06 01:18:03,984: INFO/ForkPoolWorker-4] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:18:03.985348943Z [2024-04-06 01:18:03,985: INFO/ForkPoolWorker-4] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:18:03.985418642Z [2024-04-06 01:18:03,985: INFO/ForkPoolWorker-4] Getting VIM list OK 2024-04-06T01:18:03.985747214Z [2024-04-06 01:18:03,985: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:18:03.985900138Z [2024-04-06 01:18:03,985: INFO/ForkPoolWorker-4] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:18:03.994161866Z [2024-04-06 01:18:03,993: ERROR/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7a5ebb3e-0d2a-41e5-90b8-1d3d949359f3] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 7a5ebb3e-0d2a-41e5-90b8-1d3d949359f3') 2024-04-06T01:18:03.994184070Z Traceback (most recent call last): 2024-04-06T01:18:03.994189635Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-06T01:18:03.994193596Z R = retval = fun(*args, **kwargs) 2024-04-06T01:18:03.994197331Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-06T01:18:03.994201263Z return self.run(*args, **kwargs) 2024-04-06T01:18:03.994205877Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-06T01:18:03.994210303Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-06T01:18:03.994214643Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-06T01:18:03.994232321Z raise AirflowException(msg) 2024-04-06T01:18:03.994237221Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 7a5ebb3e-0d2a-41e5-90b8-1d3d949359f3 2024-04-06T01:18:04.085455419Z [2024-04-06 01:18:04,085: INFO/ForkPoolWorker-4] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:18:05.309684681Z [2024-04-06 01:18:05,309: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b0b8b693-a1c6-4c26-b3c2-ffd961d0f5b1] succeeded in 4.2282426439996925s: None 2024-04-06T01:18:06.714500883Z [2024-04-06 01:18:06,714: INFO/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[fe49f3f0-9aef-42fc-adcc-3b1e4fa3fc17] succeeded in 5.625944557001276s: None 2024-04-06T01:18:15.181145655Z [2024-04-06 01:18:15,180: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e4f0e65e-de53-4cb4-935a-a68e6c08b4d1] received 2024-04-06T01:18:15.184955941Z [2024-04-06 01:18:15,184: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9a109d22-0be2-4854-a4a0-2c73f3cf3a71] received 2024-04-06T01:18:15.191630980Z [2024-04-06 01:18:15,191: INFO/ForkPoolWorker-15] [e4f0e65e-de53-4cb4-935a-a68e6c08b4d1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_b8f207dc-e9d9-41ff-a9ad-ff74d6b81ce9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:18:15.195490989Z [2024-04-06 01:18:15,194: INFO/ForkPoolWorker-16] [9a109d22-0be2-4854-a4a0-2c73f3cf3a71] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_b8f207dc-e9d9-41ff-a9ad-ff74d6b81ce9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:18:15.457381693Z [2024-04-06 01:18:15,454: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:18:15.467304838Z [2024-04-06 01:18:15,464: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:18:16.578285942Z [2024-04-06 01:18:16,577: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:18:16.582048588Z [2024-04-06 01:18:16,581: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:18:16.585349615Z [2024-04-06 01:18:16,585: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:18:16.588606296Z [2024-04-06 01:18:16,588: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:18:16.616101835Z [2024-04-06 01:18:16,615: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:18:16.616831467Z [2024-04-06 01:18:16,616: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:18:16.618123118Z [2024-04-06 01:18:16,617: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:18:16.618140186Z [2024-04-06 01:18:16,618: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:18:16.618284341Z [2024-04-06 01:18:16,618: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:18:16.618328192Z [2024-04-06 01:18:16,618: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:18:16.618388872Z [2024-04-06 01:18:16,618: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:18:16.618507315Z [2024-04-06 01:18:16,618: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:18:16.618557964Z [2024-04-06 01:18:16,618: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:18:16.618623966Z [2024-04-06 01:18:16,618: INFO/ForkPoolWorker-15] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:18:16.618728577Z [2024-04-06 01:18:16,618: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:18:16.618833033Z [2024-04-06 01:18:16,618: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:18:16.619082380Z [2024-04-06 01:18:16,618: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:18:16.619194006Z [2024-04-06 01:18:16,619: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:18:16.626159476Z [2024-04-06 01:18:16,625: WARNING/ForkPoolWorker-15] Dag 'vim_status_b8f207dc-e9d9-41ff-a9ad-ff74d6b81ce9' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:18:16.626389533Z [2024-04-06 01:18:16,626: WARNING/ForkPoolWorker-16] Dag 'vm_status_vim_b8f207dc-e9d9-41ff-a9ad-ff74d6b81ce9' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:18:16.626945962Z [2024-04-06 01:18:16,626: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:18:16.627620625Z [2024-04-06 01:18:16,626: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:18:16.627800237Z [2024-04-06 01:18:16,627: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:18:16.628546571Z [2024-04-06 01:18:16,628: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:18:16.630350507Z [2024-04-06 01:18:16,630: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:18:16.631429801Z [2024-04-06 01:18:16,631: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:18:16.645401050Z [2024-04-06 01:18:16,645: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:18:16.647820916Z [2024-04-06 01:18:16,647: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:18:16.648611794Z [2024-04-06 01:18:16,648: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:18:16.648819206Z [2024-04-06 01:18:16,648: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:18:16.648907847Z [2024-04-06 01:18:16,648: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:18:16.648959373Z [2024-04-06 01:18:16,648: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:18:16.649074210Z [2024-04-06 01:18:16,648: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:18:16.649103274Z [2024-04-06 01:18:16,649: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:18:16.649199182Z [2024-04-06 01:18:16,648: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:18:16.649305757Z [2024-04-06 01:18:16,649: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:18:16.649342421Z [2024-04-06 01:18:16,649: INFO/ForkPoolWorker-15] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:18:16.649422030Z [2024-04-06 01:18:16,649: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:18:16.649722936Z [2024-04-06 01:18:16,649: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:18:16.649865377Z [2024-04-06 01:18:16,649: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:18:16.653467245Z [2024-04-06 01:18:16,652: ERROR/ForkPoolWorker-15] [e4f0e65e-de53-4cb4-935a-a68e6c08b4d1] Failed to execute task Dag 'vim_status_b8f207dc-e9d9-41ff-a9ad-ff74d6b81ce9' could not be found; either it does not exist or it failed to parse.. 2024-04-06T01:18:16.653481985Z Traceback (most recent call last): 2024-04-06T01:18:16.653486664Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-06T01:18:16.653491091Z args.func(args) 2024-04-06T01:18:16.653495566Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-06T01:18:16.653500008Z return func(*args, **kwargs) 2024-04-06T01:18:16.653503770Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-06T01:18:16.653507654Z return f(*args, **kwargs) 2024-04-06T01:18:16.653511409Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-06T01:18:16.653515143Z dag = get_dag(args.subdir, args.dag_id) 2024-04-06T01:18:16.653518894Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-06T01:18:16.653522657Z raise AirflowException( 2024-04-06T01:18:16.653527122Z airflow.exceptions.AirflowException: Dag 'vim_status_b8f207dc-e9d9-41ff-a9ad-ff74d6b81ce9' could not be found; either it does not exist or it failed to parse. 2024-04-06T01:18:16.654251360Z [2024-04-06 01:18:16,653: ERROR/ForkPoolWorker-16] [9a109d22-0be2-4854-a4a0-2c73f3cf3a71] Failed to execute task Dag 'vm_status_vim_b8f207dc-e9d9-41ff-a9ad-ff74d6b81ce9' could not be found; either it does not exist or it failed to parse.. 2024-04-06T01:18:16.654263895Z Traceback (most recent call last): 2024-04-06T01:18:16.654268788Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-06T01:18:16.654290493Z args.func(args) 2024-04-06T01:18:16.654295197Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-06T01:18:16.654299701Z return func(*args, **kwargs) 2024-04-06T01:18:16.654303768Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-06T01:18:16.654307568Z return f(*args, **kwargs) 2024-04-06T01:18:16.654311261Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-06T01:18:16.654315039Z dag = get_dag(args.subdir, args.dag_id) 2024-04-06T01:18:16.654318866Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-06T01:18:16.654322538Z raise AirflowException( 2024-04-06T01:18:16.654327033Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_b8f207dc-e9d9-41ff-a9ad-ff74d6b81ce9' could not be found; either it does not exist or it failed to parse. 2024-04-06T01:18:16.684300074Z [2024-04-06 01:18:16,683: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e4f0e65e-de53-4cb4-935a-a68e6c08b4d1] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id e4f0e65e-de53-4cb4-935a-a68e6c08b4d1') 2024-04-06T01:18:16.684325256Z Traceback (most recent call last): 2024-04-06T01:18:16.684331098Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-06T01:18:16.684335700Z R = retval = fun(*args, **kwargs) 2024-04-06T01:18:16.684340310Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-06T01:18:16.684345164Z return self.run(*args, **kwargs) 2024-04-06T01:18:16.684351634Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-06T01:18:16.684357829Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-06T01:18:16.684363932Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-06T01:18:16.684369523Z raise AirflowException(msg) 2024-04-06T01:18:16.684375237Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id e4f0e65e-de53-4cb4-935a-a68e6c08b4d1 2024-04-06T01:18:16.700341018Z [2024-04-06 01:18:16,699: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9a109d22-0be2-4854-a4a0-2c73f3cf3a71] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 9a109d22-0be2-4854-a4a0-2c73f3cf3a71') 2024-04-06T01:18:16.700362254Z Traceback (most recent call last): 2024-04-06T01:18:16.700366794Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-06T01:18:16.700370432Z R = retval = fun(*args, **kwargs) 2024-04-06T01:18:16.700374396Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-06T01:18:16.700378512Z return self.run(*args, **kwargs) 2024-04-06T01:18:16.700383100Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-06T01:18:16.700387184Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-06T01:18:16.700390726Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-06T01:18:16.700395014Z raise AirflowException(msg) 2024-04-06T01:18:16.700416523Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 9a109d22-0be2-4854-a4a0-2c73f3cf3a71 2024-04-06T01:19:01.051100555Z [2024-04-06 01:19:01,050: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1f5a65f6-8309-4f61-a10d-d1ed281a03cd] received 2024-04-06T01:19:01.052833897Z [2024-04-06 01:19:01,052: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[90e3073a-7d86-4f81-9cb5-e33de739d9f6] received 2024-04-06T01:19:01.057505692Z [2024-04-06 01:19:01,057: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fd3b7c7e-dae0-4a01-b012-537cefc3612a] received 2024-04-06T01:19:01.065744823Z [2024-04-06 01:19:01,065: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[76ec488b-cd91-494e-b7b3-feb19c27514a] received 2024-04-06T01:19:01.071688124Z [2024-04-06 01:19:01,071: INFO/ForkPoolWorker-16] [90e3073a-7d86-4f81-9cb5-e33de739d9f6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_b8f207dc-e9d9-41ff-a9ad-ff74d6b81ce9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:19:01.073575095Z [2024-04-06 01:19:01,073: INFO/ForkPoolWorker-1] [fd3b7c7e-dae0-4a01-b012-537cefc3612a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_b8f207dc-e9d9-41ff-a9ad-ff74d6b81ce9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:19:01.074068763Z [2024-04-06 01:19:01,073: INFO/ForkPoolWorker-15] [1f5a65f6-8309-4f61-a10d-d1ed281a03cd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:19:01.085075804Z [2024-04-06 01:19:01,084: INFO/ForkPoolWorker-2] [76ec488b-cd91-494e-b7b3-feb19c27514a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T01:19:01.416654165Z [2024-04-06 01:19:01,412: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:19:01.417878164Z [2024-04-06 01:19:01,413: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:19:01.461395101Z [2024-04-06 01:19:01,458: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:19:01.472008521Z [2024-04-06 01:19:01,471: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[38c5e4a0-12f1-4f78-8d3d-5e76d67442e0] received 2024-04-06T01:19:01.487330563Z [2024-04-06 01:19:01,487: INFO/ForkPoolWorker-3] [38c5e4a0-12f1-4f78-8d3d-5e76d67442e0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:19:01.541612122Z [2024-04-06 01:19:01,538: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T01:19:01.745022645Z [2024-04-06 01:19:01,744: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-06T01:19:01.751894858Z [2024-04-06 01:19:01,751: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:19:01.780303546Z [2024-04-06 01:19:01,780: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T01:19:01.781341718Z [2024-04-06 01:19:01,781: INFO/ForkPoolWorker-2] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T01:19:01.781459612Z [2024-04-06 01:19:01,781: INFO/ForkPoolWorker-2] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T01:19:01.781556923Z [2024-04-06 01:19:01,781: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-06T01:19:01.781795551Z [2024-04-06 01:19:01,781: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T01:19:01.872029205Z [2024-04-06 01:19:01,871: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:19:01.958652888Z [2024-04-06 01:19:01,955: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:19:02.550819033Z [2024-04-06 01:19:02,550: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[76ec488b-cd91-494e-b7b3-feb19c27514a] succeeded in 1.4818521520010108s: None 2024-04-06T01:19:03.162335468Z [2024-04-06 01:19:03,161: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T01:19:03.165686776Z [2024-04-06 01:19:03,165: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:19:03.225433664Z [2024-04-06 01:19:03,225: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T01:19:03.227158096Z [2024-04-06 01:19:03,226: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:19:03.227244184Z [2024-04-06 01:19:03,227: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:19:03.227460867Z [2024-04-06 01:19:03,227: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:19:03.227505816Z [2024-04-06 01:19:03,227: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T01:19:03.227806231Z [2024-04-06 01:19:03,227: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:19:03.227814731Z [2024-04-06 01:19:03,227: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:19:03.235934354Z [2024-04-06 01:19:03,235: WARNING/ForkPoolWorker-1] Dag 'vm_status_vim_b8f207dc-e9d9-41ff-a9ad-ff74d6b81ce9' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:19:03.236776309Z [2024-04-06 01:19:03,236: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:19:03.237723610Z [2024-04-06 01:19:03,237: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T01:19:03.240964076Z [2024-04-06 01:19:03,240: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:19:03.283778091Z [2024-04-06 01:19:03,283: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T01:19:03.293656800Z [2024-04-06 01:19:03,293: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:19:03.293677515Z [2024-04-06 01:19:03,293: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:19:03.293849763Z [2024-04-06 01:19:03,293: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:19:03.293956480Z [2024-04-06 01:19:03,293: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T01:19:03.294389260Z [2024-04-06 01:19:03,294: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:19:03.294398809Z [2024-04-06 01:19:03,294: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:19:03.299852837Z [2024-04-06 01:19:03,299: ERROR/ForkPoolWorker-1] [fd3b7c7e-dae0-4a01-b012-537cefc3612a] Failed to execute task Dag 'vm_status_vim_b8f207dc-e9d9-41ff-a9ad-ff74d6b81ce9' could not be found; either it does not exist or it failed to parse.. 2024-04-06T01:19:03.299874526Z Traceback (most recent call last): 2024-04-06T01:19:03.299879892Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-06T01:19:03.299885034Z args.func(args) 2024-04-06T01:19:03.299890558Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-06T01:19:03.299895755Z return func(*args, **kwargs) 2024-04-06T01:19:03.299900279Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-06T01:19:03.299905011Z return f(*args, **kwargs) 2024-04-06T01:19:03.299909555Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-06T01:19:03.299914188Z dag = get_dag(args.subdir, args.dag_id) 2024-04-06T01:19:03.299918621Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-06T01:19:03.299923133Z raise AirflowException( 2024-04-06T01:19:03.299927801Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_b8f207dc-e9d9-41ff-a9ad-ff74d6b81ce9' could not be found; either it does not exist or it failed to parse. 2024-04-06T01:19:03.383073345Z [2024-04-06 01:19:03,382: ERROR/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[fd3b7c7e-dae0-4a01-b012-537cefc3612a] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id fd3b7c7e-dae0-4a01-b012-537cefc3612a') 2024-04-06T01:19:03.383098794Z Traceback (most recent call last): 2024-04-06T01:19:03.383102864Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-06T01:19:03.383105852Z R = retval = fun(*args, **kwargs) 2024-04-06T01:19:03.383108971Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-06T01:19:03.383112331Z return self.run(*args, **kwargs) 2024-04-06T01:19:03.383115729Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-06T01:19:03.383119194Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-06T01:19:03.383135863Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-06T01:19:03.383139490Z raise AirflowException(msg) 2024-04-06T01:19:03.383143127Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id fd3b7c7e-dae0-4a01-b012-537cefc3612a 2024-04-06T01:19:03.536586644Z [2024-04-06 01:19:03,536: INFO/ForkPoolWorker-3] Getting VIM list 2024-04-06T01:19:03.539832558Z [2024-04-06 01:19:03,539: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:19:03.576414111Z [2024-04-06 01:19:03,576: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-06T01:19:03.577850159Z [2024-04-06 01:19:03,577: INFO/ForkPoolWorker-3] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:19:03.577871427Z [2024-04-06 01:19:03,577: INFO/ForkPoolWorker-3] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:19:03.578052426Z [2024-04-06 01:19:03,577: INFO/ForkPoolWorker-3] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:19:03.578088292Z [2024-04-06 01:19:03,577: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-04-06T01:19:03.578350894Z [2024-04-06 01:19:03,578: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:19:03.578386541Z [2024-04-06 01:19:03,578: INFO/ForkPoolWorker-3] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:19:03.613543695Z [2024-04-06 01:19:03,613: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:19:03.616721199Z [2024-04-06 01:19:03,616: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:19:03.631384060Z [2024-04-06 01:19:03,630: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:19:03.637154776Z [2024-04-06 01:19:03,635: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:19:03.653078815Z [2024-04-06 01:19:03,652: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:19:03.656252781Z [2024-04-06 01:19:03,656: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:19:03.656274989Z [2024-04-06 01:19:03,656: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:19:03.656351356Z [2024-04-06 01:19:03,656: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:19:03.656357189Z [2024-04-06 01:19:03,656: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:19:03.657358017Z [2024-04-06 01:19:03,656: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:19:03.657405174Z [2024-04-06 01:19:03,657: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:19:03.668244561Z [2024-04-06 01:19:03,668: WARNING/ForkPoolWorker-16] Dag 'vim_status_b8f207dc-e9d9-41ff-a9ad-ff74d6b81ce9' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:19:03.669119514Z [2024-04-06 01:19:03,668: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:19:03.670768409Z [2024-04-06 01:19:03,670: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:19:03.673203356Z [2024-04-06 01:19:03,672: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:19:03.674057952Z [2024-04-06 01:19:03,673: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:19:03.675928063Z [2024-04-06 01:19:03,675: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:19:03.677877340Z [2024-04-06 01:19:03,677: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:19:03.678101585Z [2024-04-06 01:19:03,677: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:19:03.681108035Z [2024-04-06 01:19:03,679: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:19:03.681120715Z [2024-04-06 01:19:03,680: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:19:03.683146588Z [2024-04-06 01:19:03,681: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:19:03.710255943Z [2024-04-06 01:19:03,710: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:19:03.751914161Z [2024-04-06 01:19:03,744: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:19:03.753885838Z [2024-04-06 01:19:03,753: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:19:03.753985292Z [2024-04-06 01:19:03,753: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:19:03.754519007Z [2024-04-06 01:19:03,753: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:19:03.754647410Z [2024-04-06 01:19:03,754: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:19:03.754944540Z [2024-04-06 01:19:03,754: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:19:03.755024739Z [2024-04-06 01:19:03,754: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:19:03.760020733Z [2024-04-06 01:19:03,758: ERROR/ForkPoolWorker-16] [90e3073a-7d86-4f81-9cb5-e33de739d9f6] Failed to execute task Dag 'vim_status_b8f207dc-e9d9-41ff-a9ad-ff74d6b81ce9' could not be found; either it does not exist or it failed to parse.. 2024-04-06T01:19:03.760035242Z Traceback (most recent call last): 2024-04-06T01:19:03.760039660Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-06T01:19:03.760065349Z args.func(args) 2024-04-06T01:19:03.760069134Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-06T01:19:03.760072737Z return func(*args, **kwargs) 2024-04-06T01:19:03.760076116Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-06T01:19:03.760079088Z return f(*args, **kwargs) 2024-04-06T01:19:03.760082138Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-06T01:19:03.760085181Z dag = get_dag(args.subdir, args.dag_id) 2024-04-06T01:19:03.760088173Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-06T01:19:03.760091192Z raise AirflowException( 2024-04-06T01:19:03.760094904Z airflow.exceptions.AirflowException: Dag 'vim_status_b8f207dc-e9d9-41ff-a9ad-ff74d6b81ce9' could not be found; either it does not exist or it failed to parse. 2024-04-06T01:19:03.804490906Z [2024-04-06 01:19:03,803: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[90e3073a-7d86-4f81-9cb5-e33de739d9f6] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 90e3073a-7d86-4f81-9cb5-e33de739d9f6') 2024-04-06T01:19:03.804528367Z Traceback (most recent call last): 2024-04-06T01:19:03.804534298Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-06T01:19:03.804537881Z R = retval = fun(*args, **kwargs) 2024-04-06T01:19:03.804541484Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-06T01:19:03.804544963Z return self.run(*args, **kwargs) 2024-04-06T01:19:03.804549223Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-06T01:19:03.804553053Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-06T01:19:03.804556264Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-06T01:19:03.804560176Z raise AirflowException(msg) 2024-04-06T01:19:03.804564403Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 90e3073a-7d86-4f81-9cb5-e33de739d9f6 2024-04-06T01:19:03.828652799Z [2024-04-06 01:19:03,828: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:19:05.559099985Z [2024-04-06 01:19:05,558: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[38c5e4a0-12f1-4f78-8d3d-5e76d67442e0] succeeded in 4.085323186998721s: None 2024-04-06T01:19:05.691337032Z [2024-04-06 01:19:05,690: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1f5a65f6-8309-4f61-a10d-d1ed281a03cd] succeeded in 4.638089517999106s: None 2024-04-06T01:20:01.084818266Z [2024-04-06 01:20:01,084: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[796955a2-cc9e-422f-b4a3-f46a568daaae] received 2024-04-06T01:20:01.090649565Z [2024-04-06 01:20:01,090: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c8971728-381d-40b8-b6cc-e155efb519ae] received 2024-04-06T01:20:01.094971941Z [2024-04-06 01:20:01,094: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b1a42c70-e31f-49d6-8294-cf10fae15a11] received 2024-04-06T01:20:01.100427675Z [2024-04-06 01:20:01,099: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3f820cd6-a635-4929-a0df-039f455a9e73] received 2024-04-06T01:20:01.104562895Z [2024-04-06 01:20:01,104: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9ed7e848-ec5b-43c3-9f8d-459d342d1a14] received 2024-04-06T01:20:01.105039054Z [2024-04-06 01:20:01,104: INFO/ForkPoolWorker-15] [796955a2-cc9e-422f-b4a3-f46a568daaae] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T01:20:01.108715885Z [2024-04-06 01:20:01,108: INFO/ForkPoolWorker-16] [c8971728-381d-40b8-b6cc-e155efb519ae] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T01:20:01.120108194Z [2024-04-06 01:20:01,119: INFO/ForkPoolWorker-3] [9ed7e848-ec5b-43c3-9f8d-459d342d1a14] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T01:20:01.120309982Z [2024-04-06 01:20:01,119: INFO/ForkPoolWorker-1] [b1a42c70-e31f-49d6-8294-cf10fae15a11] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:20:01.123554142Z [2024-04-06 01:20:01,123: INFO/ForkPoolWorker-2] [3f820cd6-a635-4929-a0df-039f455a9e73] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:20:01.423416785Z [2024-04-06 01:20:01,419: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:20:01.508108364Z [2024-04-06 01:20:01,501: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T01:20:01.595906011Z [2024-04-06 01:20:01,590: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T01:20:01.664931142Z [2024-04-06 01:20:01,659: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:20:01.675229200Z [2024-04-06 01:20:01,665: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T01:20:01.762604743Z [2024-04-06 01:20:01,762: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:20:01.954838772Z [2024-04-06 01:20:01,954: INFO/ForkPoolWorker-3] Getting SDNC list 2024-04-06T01:20:01.964589512Z [2024-04-06 01:20:01,964: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:20:02.024981804Z [2024-04-06 01:20:02,024: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-06T01:20:02.025985944Z [2024-04-06 01:20:02,025: INFO/ForkPoolWorker-3] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T01:20:02.026063934Z [2024-04-06 01:20:02,025: INFO/ForkPoolWorker-3] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T01:20:02.026111645Z [2024-04-06 01:20:02,026: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-04-06T01:20:02.026337406Z [2024-04-06 01:20:02,026: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T01:20:02.160605165Z [2024-04-06 01:20:02,160: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:20:02.504398503Z [2024-04-06 01:20:02,504: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c8971728-381d-40b8-b6cc-e155efb519ae] succeeded in 1.411682383999505s: None 2024-04-06T01:20:02.829730110Z [2024-04-06 01:20:02,829: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[9ed7e848-ec5b-43c3-9f8d-459d342d1a14] succeeded in 1.7195791430003737s: None 2024-04-06T01:20:02.997005805Z [2024-04-06 01:20:02,996: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T01:20:03.003242613Z [2024-04-06 01:20:03,002: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:20:03.004976934Z [2024-04-06 01:20:03,004: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:20:03.008117346Z [2024-04-06 01:20:03,007: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:20:03.024385645Z [2024-04-06 01:20:03,024: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T01:20:03.026562374Z [2024-04-06 01:20:03,026: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:20:03.026695661Z [2024-04-06 01:20:03,026: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:20:03.026853265Z [2024-04-06 01:20:03,026: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:20:03.026913058Z [2024-04-06 01:20:03,026: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:20:03.027037797Z [2024-04-06 01:20:03,026: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T01:20:03.027432868Z [2024-04-06 01:20:03,027: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:20:03.027576095Z [2024-04-06 01:20:03,027: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:20:03.028230326Z [2024-04-06 01:20:03,028: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:20:03.028361150Z [2024-04-06 01:20:03,028: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:20:03.028527062Z [2024-04-06 01:20:03,028: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:20:03.028660810Z [2024-04-06 01:20:03,028: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:20:03.029624208Z [2024-04-06 01:20:03,029: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T01:20:03.029759953Z [2024-04-06 01:20:03,029: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:20:03.116249304Z [2024-04-06 01:20:03,115: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:20:03.119978362Z [2024-04-06 01:20:03,119: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:20:03.275854119Z [2024-04-06 01:20:03,275: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-06T01:20:03.279006111Z [2024-04-06 01:20:03,278: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:20:03.320652550Z [2024-04-06 01:20:03,320: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T01:20:03.322434352Z [2024-04-06 01:20:03,322: INFO/ForkPoolWorker-2] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:20:03.322473644Z [2024-04-06 01:20:03,322: INFO/ForkPoolWorker-2] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:20:03.322631135Z [2024-04-06 01:20:03,322: INFO/ForkPoolWorker-2] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:20:03.322680370Z [2024-04-06 01:20:03,322: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-06T01:20:03.322930826Z [2024-04-06 01:20:03,322: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:20:03.322985251Z [2024-04-06 01:20:03,322: INFO/ForkPoolWorker-2] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:20:03.423398150Z [2024-04-06 01:20:03,423: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:20:03.785882235Z [2024-04-06 01:20:03,785: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[796955a2-cc9e-422f-b4a3-f46a568daaae] succeeded in 2.689460200999747s: None 2024-04-06T01:20:03.912462786Z [2024-04-06 01:20:03,912: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[119e33d2-5363-44f6-b0b1-ce017b3ee9fd] received 2024-04-06T01:20:03.929311584Z [2024-04-06 01:20:03,929: INFO/ForkPoolWorker-15] [119e33d2-5363-44f6-b0b1-ce017b3ee9fd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'split_metrics', 'scheduled__2024-04-06T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T01:20:04.352674715Z [2024-04-06 01:20:04,349: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T01:20:05.298609314Z [2024-04-06 01:20:05,298: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[3f820cd6-a635-4929-a0df-039f455a9e73] succeeded in 4.192836624999472s: None 2024-04-06T01:20:05.304130271Z [2024-04-06 01:20:05,303: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b1a42c70-e31f-49d6-8294-cf10fae15a11] succeeded in 4.2070916979992035s: None 2024-04-06T01:20:05.501127958Z [2024-04-06 01:20:05,500: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:20:05.504372537Z [2024-04-06 01:20:05,503: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:20:05.526640241Z [2024-04-06 01:20:05,526: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:20:05.529877760Z [2024-04-06 01:20:05,529: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:20:05.529912405Z [2024-04-06 01:20:05,529: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:20:05.529952469Z [2024-04-06 01:20:05,529: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:20:05.530024008Z [2024-04-06 01:20:05,529: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:20:05.530481213Z [2024-04-06 01:20:05,530: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T01:20:05.530676685Z [2024-04-06 01:20:05,530: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:20:05.631540287Z [2024-04-06 01:20:05,631: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:20:06.318665145Z [2024-04-06 01:20:06,315: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[119e33d2-5363-44f6-b0b1-ce017b3ee9fd] succeeded in 2.4019577729995945s: None 2024-04-06T01:20:06.357841451Z [2024-04-06 01:20:06,357: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[88bc0edf-c312-47c5-9492-cc018dbf6687] received 2024-04-06T01:20:06.365744347Z [2024-04-06 01:20:06,365: INFO/ForkPoolWorker-15] [88bc0edf-c312-47c5-9492-cc018dbf6687] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'collect_metrics', 'scheduled__2024-04-06T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T01:20:06.640885459Z [2024-04-06 01:20:06,637: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T01:20:07.838216028Z [2024-04-06 01:20:07,837: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:20:07.841298199Z [2024-04-06 01:20:07,840: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:20:07.858688807Z [2024-04-06 01:20:07,858: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:20:07.859966475Z [2024-04-06 01:20:07,859: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:20:07.860080737Z [2024-04-06 01:20:07,859: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:20:07.860183327Z [2024-04-06 01:20:07,860: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:20:07.860312298Z [2024-04-06 01:20:07,860: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:20:07.860524188Z [2024-04-06 01:20:07,860: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T01:20:07.860640642Z [2024-04-06 01:20:07,860: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:20:07.947303665Z [2024-04-06 01:20:07,946: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:20:08.447932517Z [2024-04-06 01:20:08,447: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[88bc0edf-c312-47c5-9492-cc018dbf6687] succeeded in 2.0881138450004073s: None 2024-04-06T01:20:08.681568189Z [2024-04-06 01:20:08,681: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6342be51-aa53-4728-8c29-72644efe99cb] received 2024-04-06T01:20:08.695041463Z [2024-04-06 01:20:08,694: INFO/ForkPoolWorker-15] [6342be51-aa53-4728-8c29-72644efe99cb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'send_prometheus', 'scheduled__2024-04-06T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T01:20:08.971407904Z [2024-04-06 01:20:08,968: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T01:20:10.214943404Z [2024-04-06 01:20:10,214: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:20:10.218856437Z [2024-04-06 01:20:10,218: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:20:10.257693791Z [2024-04-06 01:20:10,257: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:20:10.259120253Z [2024-04-06 01:20:10,258: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:20:10.259237010Z [2024-04-06 01:20:10,259: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:20:10.259487616Z [2024-04-06 01:20:10,259: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:20:10.259588905Z [2024-04-06 01:20:10,259: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:20:10.260004657Z [2024-04-06 01:20:10,259: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T01:20:10.260125149Z [2024-04-06 01:20:10,259: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:20:10.345217024Z [2024-04-06 01:20:10,344: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:20:11.009338280Z [2024-04-06 01:20:11,008: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6342be51-aa53-4728-8c29-72644efe99cb] succeeded in 2.3233575920003204s: None 2024-04-06T01:21:01.225072894Z [2024-04-06 01:21:01,222: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[efb4106f-466d-4efd-ab61-aff7529c7f22] received 2024-04-06T01:21:01.232442404Z [2024-04-06 01:21:01,232: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[034b9f9e-e15b-446f-abb8-db3d8737bcd0] received 2024-04-06T01:21:01.235001831Z [2024-04-06 01:21:01,234: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6b554f00-9de4-48dc-9d2d-32b21a75a647] received 2024-04-06T01:21:01.235049301Z [2024-04-06 01:21:01,234: INFO/ForkPoolWorker-15] [efb4106f-466d-4efd-ab61-aff7529c7f22] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:21:01.241755031Z [2024-04-06 01:21:01,241: INFO/ForkPoolWorker-1] [6b554f00-9de4-48dc-9d2d-32b21a75a647] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T01:21:01.242646451Z [2024-04-06 01:21:01,242: INFO/ForkPoolWorker-16] [034b9f9e-e15b-446f-abb8-db3d8737bcd0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:21:01.513441376Z [2024-04-06 01:21:01,510: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T01:21:01.578328324Z [2024-04-06 01:21:01,575: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:21:01.590656936Z [2024-04-06 01:21:01,586: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:21:01.690479818Z [2024-04-06 01:21:01,689: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-06T01:21:01.695105854Z [2024-04-06 01:21:01,694: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:21:01.767225655Z [2024-04-06 01:21:01,766: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T01:21:01.770987103Z [2024-04-06 01:21:01,770: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T01:21:01.771152296Z [2024-04-06 01:21:01,770: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T01:21:01.771329706Z [2024-04-06 01:21:01,771: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-06T01:21:01.771681372Z [2024-04-06 01:21:01,771: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T01:21:01.867658921Z [2024-04-06 01:21:01,867: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:21:02.491768994Z [2024-04-06 01:21:02,491: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6b554f00-9de4-48dc-9d2d-32b21a75a647] succeeded in 1.2550662670000747s: None 2024-04-06T01:21:02.816503950Z [2024-04-06 01:21:02,816: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:21:02.819711501Z [2024-04-06 01:21:02,819: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:21:02.849208289Z [2024-04-06 01:21:02,848: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:21:02.850737549Z [2024-04-06 01:21:02,850: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:21:02.850757500Z [2024-04-06 01:21:02,850: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:21:02.850940569Z [2024-04-06 01:21:02,850: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:21:02.850985540Z [2024-04-06 01:21:02,850: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:21:02.851175213Z [2024-04-06 01:21:02,851: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:21:02.851214066Z [2024-04-06 01:21:02,851: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:21:02.923846770Z [2024-04-06 01:21:02,923: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:21:02.927467357Z [2024-04-06 01:21:02,927: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:21:02.949551746Z [2024-04-06 01:21:02,949: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:21:02.954092277Z [2024-04-06 01:21:02,953: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:21:02.954261524Z [2024-04-06 01:21:02,954: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:21:02.954525388Z [2024-04-06 01:21:02,954: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:21:02.954677853Z [2024-04-06 01:21:02,954: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:21:02.955082214Z [2024-04-06 01:21:02,954: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:21:02.955359218Z [2024-04-06 01:21:02,955: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:21:02.969166608Z [2024-04-06 01:21:02,968: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:21:03.052297899Z [2024-04-06 01:21:03,051: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:21:05.017496001Z [2024-04-06 01:21:05,017: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[034b9f9e-e15b-446f-abb8-db3d8737bcd0] succeeded in 3.780862995999996s: None 2024-04-06T01:21:05.395356574Z [2024-04-06 01:21:05,394: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[efb4106f-466d-4efd-ab61-aff7529c7f22] succeeded in 4.166968464000092s: None 2024-04-06T01:22:00.296768841Z [2024-04-06 01:22:00,296: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b47fcaf6-65e1-4f20-b2e5-3b2ff4f7d63d] received 2024-04-06T01:22:00.300231286Z [2024-04-06 01:22:00,299: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[51916351-8d2a-49f2-82aa-6e338aab8e9a] received 2024-04-06T01:22:00.305496139Z [2024-04-06 01:22:00,305: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1dfcc3e6-a555-45c7-87e1-eacb3fa23f9c] received 2024-04-06T01:22:00.314115568Z [2024-04-06 01:22:00,313: INFO/ForkPoolWorker-15] [b47fcaf6-65e1-4f20-b2e5-3b2ff4f7d63d] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T01:22:00.315687524Z [2024-04-06 01:22:00,315: INFO/ForkPoolWorker-16] [51916351-8d2a-49f2-82aa-6e338aab8e9a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:22:00.319755301Z [2024-04-06 01:22:00,319: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b4bb45fa-eaad-4cf2-8e1c-52b8f8213236] received 2024-04-06T01:22:00.324369884Z [2024-04-06 01:22:00,321: INFO/ForkPoolWorker-1] [1dfcc3e6-a555-45c7-87e1-eacb3fa23f9c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:22:00.331275498Z [2024-04-06 01:22:00,330: INFO/ForkPoolWorker-2] [b4bb45fa-eaad-4cf2-8e1c-52b8f8213236] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T01:22:00.645212928Z [2024-04-06 01:22:00,633: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:22:00.650795279Z [2024-04-06 01:22:00,647: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T01:22:00.701905298Z [2024-04-06 01:22:00,698: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:22:00.756569922Z [2024-04-06 01:22:00,752: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T01:22:00.894304437Z [2024-04-06 01:22:00,894: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:22:01.061396522Z [2024-04-06 01:22:01,060: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-06T01:22:01.068921233Z [2024-04-06 01:22:01,068: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:22:01.114193492Z [2024-04-06 01:22:01,113: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T01:22:01.116215831Z [2024-04-06 01:22:01,115: INFO/ForkPoolWorker-2] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T01:22:01.116913160Z [2024-04-06 01:22:01,116: INFO/ForkPoolWorker-2] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T01:22:01.117300457Z [2024-04-06 01:22:01,117: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-06T01:22:01.117598270Z [2024-04-06 01:22:01,117: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T01:22:01.202975456Z [2024-04-06 01:22:01,202: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:22:01.548637753Z [2024-04-06 01:22:01,548: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b47fcaf6-65e1-4f20-b2e5-3b2ff4f7d63d] succeeded in 1.2499065490010253s: None 2024-04-06T01:22:01.852532245Z [2024-04-06 01:22:01,851: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b4bb45fa-eaad-4cf2-8e1c-52b8f8213236] succeeded in 1.5278177420004795s: None 2024-04-06T01:22:01.964147177Z [2024-04-06 01:22:01,963: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:22:01.967605237Z [2024-04-06 01:22:01,967: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:22:02.000318972Z [2024-04-06 01:22:02,000: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:22:02.007660098Z [2024-04-06 01:22:02,007: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:22:02.007708003Z [2024-04-06 01:22:02,007: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:22:02.007854393Z [2024-04-06 01:22:02,007: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:22:02.007918882Z [2024-04-06 01:22:02,007: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:22:02.008317656Z [2024-04-06 01:22:02,008: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:22:02.008344432Z [2024-04-06 01:22:02,008: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:22:02.010806006Z [2024-04-06 01:22:02,010: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T01:22:02.014525461Z [2024-04-06 01:22:02,013: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:22:02.045349671Z [2024-04-06 01:22:02,045: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T01:22:02.048689035Z [2024-04-06 01:22:02,048: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:22:02.048706922Z [2024-04-06 01:22:02,048: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:22:02.048796807Z [2024-04-06 01:22:02,048: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:22:02.048818850Z [2024-04-06 01:22:02,048: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T01:22:02.049104138Z [2024-04-06 01:22:02,048: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:22:02.049109265Z [2024-04-06 01:22:02,049: INFO/ForkPoolWorker-1] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:22:02.110697378Z [2024-04-06 01:22:02,110: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:22:02.144123764Z [2024-04-06 01:22:02,143: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:22:03.719302584Z [2024-04-06 01:22:03,717: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1dfcc3e6-a555-45c7-87e1-eacb3fa23f9c] succeeded in 3.4091017119990283s: None 2024-04-06T01:22:03.927169250Z [2024-04-06 01:22:03,926: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[51916351-8d2a-49f2-82aa-6e338aab8e9a] succeeded in 3.6234456910005974s: None 2024-04-06T01:23:01.218371306Z [2024-04-06 01:23:01,217: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[57231842-0dd1-4514-999f-67341e6a0011] received 2024-04-06T01:23:01.222696553Z [2024-04-06 01:23:01,222: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[22d295e1-5be6-4370-9ca1-9b864de1a580] received 2024-04-06T01:23:01.225771191Z [2024-04-06 01:23:01,225: INFO/ForkPoolWorker-15] [57231842-0dd1-4514-999f-67341e6a0011] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:23:01.229800037Z [2024-04-06 01:23:01,229: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f7d0c5ca-c349-467c-b4d3-5bd0e8c272c6] received 2024-04-06T01:23:01.230724938Z [2024-04-06 01:23:01,230: INFO/ForkPoolWorker-16] [22d295e1-5be6-4370-9ca1-9b864de1a580] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:23:01.242637927Z [2024-04-06 01:23:01,242: INFO/ForkPoolWorker-1] [f7d0c5ca-c349-467c-b4d3-5bd0e8c272c6] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T01:23:01.540056607Z [2024-04-06 01:23:01,537: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:23:01.548131369Z [2024-04-06 01:23:01,530: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:23:01.556428673Z [2024-04-06 01:23:01,552: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T01:23:01.748407839Z [2024-04-06 01:23:01,747: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-06T01:23:01.752395579Z [2024-04-06 01:23:01,751: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:23:01.788291520Z [2024-04-06 01:23:01,788: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T01:23:01.792155911Z [2024-04-06 01:23:01,791: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T01:23:01.792459346Z [2024-04-06 01:23:01,792: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T01:23:01.792616224Z [2024-04-06 01:23:01,792: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-06T01:23:01.792903126Z [2024-04-06 01:23:01,792: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T01:23:01.908408664Z [2024-04-06 01:23:01,908: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:23:02.554014555Z [2024-04-06 01:23:02,553: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f7d0c5ca-c349-467c-b4d3-5bd0e8c272c6] succeeded in 1.3221961550007109s: None 2024-04-06T01:23:02.807941818Z [2024-04-06 01:23:02,807: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:23:02.811112155Z [2024-04-06 01:23:02,810: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:23:02.838618999Z [2024-04-06 01:23:02,838: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:23:02.840704454Z [2024-04-06 01:23:02,840: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:23:02.841782521Z [2024-04-06 01:23:02,841: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:23:02.842480761Z [2024-04-06 01:23:02,842: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:23:02.842662021Z [2024-04-06 01:23:02,842: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:23:02.842960032Z [2024-04-06 01:23:02,842: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:23:02.843191944Z [2024-04-06 01:23:02,842: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:23:02.843939839Z [2024-04-06 01:23:02,843: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:23:02.844130883Z [2024-04-06 01:23:02,843: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:23:02.870402365Z [2024-04-06 01:23:02,870: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:23:02.872258684Z [2024-04-06 01:23:02,871: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:23:02.872309127Z [2024-04-06 01:23:02,872: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:23:02.872598105Z [2024-04-06 01:23:02,872: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:23:02.872758767Z [2024-04-06 01:23:02,872: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:23:02.873152349Z [2024-04-06 01:23:02,872: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:23:02.873438182Z [2024-04-06 01:23:02,873: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:23:02.979508265Z [2024-04-06 01:23:02,979: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:23:02.997475192Z [2024-04-06 01:23:02,997: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:23:04.615701185Z [2024-04-06 01:23:04,614: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[22d295e1-5be6-4370-9ca1-9b864de1a580] succeeded in 3.3909309810005652s: None 2024-04-06T01:23:05.232673424Z [2024-04-06 01:23:05,231: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[57231842-0dd1-4514-999f-67341e6a0011] succeeded in 4.011482082998555s: None 2024-04-06T01:24:01.243955948Z [2024-04-06 01:24:01,243: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6daecedf-b216-476c-a8cc-cdb68e6d986a] received 2024-04-06T01:24:01.248297494Z [2024-04-06 01:24:01,247: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[660731b0-b5b1-4bd3-808c-7e266993667a] received 2024-04-06T01:24:01.251637610Z [2024-04-06 01:24:01,251: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e876a16d-457b-455b-a590-0b87cdf76bba] received 2024-04-06T01:24:01.259075249Z [2024-04-06 01:24:01,258: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2ece9601-a2ff-46c9-b221-02fb0368a01e] received 2024-04-06T01:24:01.262716125Z [2024-04-06 01:24:01,262: INFO/ForkPoolWorker-15] [6daecedf-b216-476c-a8cc-cdb68e6d986a] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T01:24:01.274813094Z [2024-04-06 01:24:01,274: INFO/ForkPoolWorker-1] [e876a16d-457b-455b-a590-0b87cdf76bba] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:24:01.277974041Z [2024-04-06 01:24:01,277: INFO/ForkPoolWorker-16] [660731b0-b5b1-4bd3-808c-7e266993667a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:24:01.296499388Z [2024-04-06 01:24:01,296: INFO/ForkPoolWorker-2] [2ece9601-a2ff-46c9-b221-02fb0368a01e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T01:24:01.566549839Z [2024-04-06 01:24:01,561: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:24:01.642405799Z [2024-04-06 01:24:01,637: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T01:24:01.688634373Z [2024-04-06 01:24:01,685: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T01:24:01.714355190Z [2024-04-06 01:24:01,711: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:24:01.836791000Z [2024-04-06 01:24:01,836: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-06T01:24:01.840713257Z [2024-04-06 01:24:01,840: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:24:01.870145970Z [2024-04-06 01:24:01,869: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T01:24:01.872262337Z [2024-04-06 01:24:01,871: INFO/ForkPoolWorker-2] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T01:24:01.872559166Z [2024-04-06 01:24:01,872: INFO/ForkPoolWorker-2] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T01:24:01.872746379Z [2024-04-06 01:24:01,872: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-06T01:24:01.873099279Z [2024-04-06 01:24:01,872: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T01:24:01.969842101Z [2024-04-06 01:24:01,969: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:24:02.032612358Z [2024-04-06 01:24:02,032: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:24:02.570967145Z [2024-04-06 01:24:02,570: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[2ece9601-a2ff-46c9-b221-02fb0368a01e] succeeded in 1.2924231690012675s: None 2024-04-06T01:24:02.719603354Z [2024-04-06 01:24:02,717: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6daecedf-b216-476c-a8cc-cdb68e6d986a] succeeded in 1.466589962999933s: None 2024-04-06T01:24:02.763432207Z [2024-04-06 01:24:02,763: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T01:24:02.766542373Z [2024-04-06 01:24:02,766: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:24:02.788688691Z [2024-04-06 01:24:02,788: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T01:24:02.790157947Z [2024-04-06 01:24:02,789: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:24:02.790172982Z [2024-04-06 01:24:02,790: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:24:02.790357542Z [2024-04-06 01:24:02,790: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:24:02.790398276Z [2024-04-06 01:24:02,790: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T01:24:02.790665827Z [2024-04-06 01:24:02,790: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:24:02.790704652Z [2024-04-06 01:24:02,790: INFO/ForkPoolWorker-1] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:24:02.923595410Z [2024-04-06 01:24:02,923: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:24:03.052173702Z [2024-04-06 01:24:03,051: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:24:03.055662733Z [2024-04-06 01:24:03,055: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:24:03.090355805Z [2024-04-06 01:24:03,090: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:24:03.092517521Z [2024-04-06 01:24:03,092: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:24:03.092835572Z [2024-04-06 01:24:03,092: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:24:03.093251594Z [2024-04-06 01:24:03,092: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:24:03.093536775Z [2024-04-06 01:24:03,093: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:24:03.094045844Z [2024-04-06 01:24:03,093: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:24:03.094308715Z [2024-04-06 01:24:03,094: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:24:03.173360175Z [2024-04-06 01:24:03,173: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:24:04.944087031Z [2024-04-06 01:24:04,943: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e876a16d-457b-455b-a590-0b87cdf76bba] succeeded in 3.683306266000727s: None 2024-04-06T01:24:05.872924728Z [2024-04-06 01:24:05,871: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[660731b0-b5b1-4bd3-808c-7e266993667a] succeeded in 4.621324350000577s: None 2024-04-06T01:25:01.203752909Z [2024-04-06 01:25:01,200: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[30daf678-deb0-46ae-8d1f-64ee3d0785c2] received 2024-04-06T01:25:01.206321178Z [2024-04-06 01:25:01,206: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[84b834a3-5258-4469-89fd-9a7e2c528a06] received 2024-04-06T01:25:01.208963503Z [2024-04-06 01:25:01,208: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4b984d93-3fc1-4d7f-8d07-b3753a894f6a] received 2024-04-06T01:25:01.212412295Z [2024-04-06 01:25:01,212: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b659d495-4c90-419e-8771-c02129474cc7] received 2024-04-06T01:25:01.219441285Z [2024-04-06 01:25:01,219: INFO/ForkPoolWorker-16] [84b834a3-5258-4469-89fd-9a7e2c528a06] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:25:01.223350796Z [2024-04-06 01:25:01,222: INFO/ForkPoolWorker-2] [b659d495-4c90-419e-8771-c02129474cc7] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T01:25:01.268310291Z [2024-04-06 01:25:01,267: INFO/ForkPoolWorker-1] [4b984d93-3fc1-4d7f-8d07-b3753a894f6a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:25:01.276081148Z [2024-04-06 01:25:01,275: INFO/ForkPoolWorker-15] [30daf678-deb0-46ae-8d1f-64ee3d0785c2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T01:25:01.581277479Z [2024-04-06 01:25:01,576: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:25:01.779147624Z [2024-04-06 01:25:01,775: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:25:01.819572186Z [2024-04-06 01:25:01,816: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T01:25:01.965818163Z [2024-04-06 01:25:01,960: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T01:25:02.373600445Z [2024-04-06 01:25:02,373: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-06T01:25:02.378529198Z [2024-04-06 01:25:02,378: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:25:02.444185128Z [2024-04-06 01:25:02,443: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T01:25:02.452208568Z [2024-04-06 01:25:02,451: INFO/ForkPoolWorker-2] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T01:25:02.452287503Z [2024-04-06 01:25:02,452: INFO/ForkPoolWorker-2] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T01:25:02.452350894Z [2024-04-06 01:25:02,452: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-06T01:25:02.452620093Z [2024-04-06 01:25:02,452: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T01:25:02.691366888Z [2024-04-06 01:25:02,691: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:25:03.823269456Z [2024-04-06 01:25:03,822: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b659d495-4c90-419e-8771-c02129474cc7] succeeded in 2.6089453579988913s: None 2024-04-06T01:25:04.307902552Z [2024-04-06 01:25:04,307: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T01:25:04.326630343Z [2024-04-06 01:25:04,325: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:25:04.419460395Z [2024-04-06 01:25:04,419: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:25:04.423988647Z [2024-04-06 01:25:04,423: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T01:25:04.425777801Z [2024-04-06 01:25:04,425: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:25:04.428336911Z [2024-04-06 01:25:04,428: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:25:04.428455717Z [2024-04-06 01:25:04,428: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:25:04.428649809Z [2024-04-06 01:25:04,428: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:25:04.431332484Z [2024-04-06 01:25:04,428: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T01:25:04.431348027Z [2024-04-06 01:25:04,428: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:25:04.431351330Z [2024-04-06 01:25:04,428: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:25:04.523841402Z [2024-04-06 01:25:04,522: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:25:04.551327942Z [2024-04-06 01:25:04,544: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:25:04.583366389Z [2024-04-06 01:25:04,582: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:25:04.586460134Z [2024-04-06 01:25:04,584: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:25:04.586472490Z [2024-04-06 01:25:04,584: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:25:04.586477635Z [2024-04-06 01:25:04,585: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:25:04.586482759Z [2024-04-06 01:25:04,585: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:25:04.586486199Z [2024-04-06 01:25:04,585: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T01:25:04.586489617Z [2024-04-06 01:25:04,585: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:25:04.614335941Z [2024-04-06 01:25:04,614: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:25:04.616410669Z [2024-04-06 01:25:04,616: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:25:04.616755568Z [2024-04-06 01:25:04,616: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:25:04.616904130Z [2024-04-06 01:25:04,616: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:25:04.618991169Z [2024-04-06 01:25:04,616: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:25:04.619420758Z [2024-04-06 01:25:04,619: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:25:04.619540796Z [2024-04-06 01:25:04,619: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:25:04.634400230Z [2024-04-06 01:25:04,634: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:25:04.735492937Z [2024-04-06 01:25:04,735: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:25:04.787631185Z [2024-04-06 01:25:04,787: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:25:05.461507327Z [2024-04-06 01:25:05,460: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[30daf678-deb0-46ae-8d1f-64ee3d0785c2] succeeded in 4.237088548999964s: None 2024-04-06T01:25:05.691739286Z [2024-04-06 01:25:05,691: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b360f0b3-02ba-4074-8213-726517095b82] received 2024-04-06T01:25:05.700551797Z [2024-04-06 01:25:05,700: INFO/ForkPoolWorker-15] [b360f0b3-02ba-4074-8213-726517095b82] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'split_metrics', 'scheduled__2024-04-06T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T01:25:06.121179589Z [2024-04-06 01:25:06,118: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T01:25:06.704232855Z [2024-04-06 01:25:06,703: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[84b834a3-5258-4469-89fd-9a7e2c528a06] succeeded in 5.495196677999047s: None 2024-04-06T01:25:07.294802126Z [2024-04-06 01:25:07,294: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:25:07.298071601Z [2024-04-06 01:25:07,297: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:25:07.324820899Z [2024-04-06 01:25:07,324: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:25:07.326205322Z [2024-04-06 01:25:07,326: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:25:07.326312072Z [2024-04-06 01:25:07,326: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:25:07.326471008Z [2024-04-06 01:25:07,326: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:25:07.326573241Z [2024-04-06 01:25:07,326: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:25:07.326844295Z [2024-04-06 01:25:07,326: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T01:25:07.327380908Z [2024-04-06 01:25:07,326: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:25:07.407465120Z [2024-04-06 01:25:07,407: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:25:07.870178236Z [2024-04-06 01:25:07,869: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4b984d93-3fc1-4d7f-8d07-b3753a894f6a] succeeded in 6.657558187000177s: None 2024-04-06T01:25:08.087683509Z [2024-04-06 01:25:08,087: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b360f0b3-02ba-4074-8213-726517095b82] succeeded in 2.3935942070002056s: None 2024-04-06T01:25:08.188412856Z [2024-04-06 01:25:08,188: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dc868984-e0d4-4da6-8739-23dd4f682567] received 2024-04-06T01:25:08.201610666Z [2024-04-06 01:25:08,200: INFO/ForkPoolWorker-15] [dc868984-e0d4-4da6-8739-23dd4f682567] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'collect_metrics', 'scheduled__2024-04-06T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T01:25:08.529058977Z [2024-04-06 01:25:08,511: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T01:25:09.852678014Z [2024-04-06 01:25:09,852: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:25:09.856674551Z [2024-04-06 01:25:09,856: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:25:09.877584028Z [2024-04-06 01:25:09,877: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:25:09.878998042Z [2024-04-06 01:25:09,878: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:25:09.879010214Z [2024-04-06 01:25:09,878: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:25:09.879228774Z [2024-04-06 01:25:09,879: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:25:09.879423880Z [2024-04-06 01:25:09,879: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:25:09.879645841Z [2024-04-06 01:25:09,879: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T01:25:09.879732845Z [2024-04-06 01:25:09,879: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:25:09.994909053Z [2024-04-06 01:25:09,994: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:25:10.614493979Z [2024-04-06 01:25:10,613: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[dc868984-e0d4-4da6-8739-23dd4f682567] succeeded in 2.4215801139998803s: None 2024-04-06T01:25:11.357263793Z [2024-04-06 01:25:11,356: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9832f1ef-03dd-412d-b3cb-c345fd837556] received 2024-04-06T01:25:11.369206945Z [2024-04-06 01:25:11,368: INFO/ForkPoolWorker-15] [9832f1ef-03dd-412d-b3cb-c345fd837556] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'send_prometheus', 'scheduled__2024-04-06T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T01:25:11.732357019Z [2024-04-06 01:25:11,728: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T01:25:13.100552682Z [2024-04-06 01:25:13,100: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:25:13.103866332Z [2024-04-06 01:25:13,103: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:25:13.124660209Z [2024-04-06 01:25:13,124: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:25:13.128753573Z [2024-04-06 01:25:13,128: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:25:13.128821886Z [2024-04-06 01:25:13,128: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:25:13.129020346Z [2024-04-06 01:25:13,128: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:25:13.129100489Z [2024-04-06 01:25:13,128: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:25:13.129738134Z [2024-04-06 01:25:13,129: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T01:25:13.129800384Z [2024-04-06 01:25:13,129: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:25:13.235784475Z [2024-04-06 01:25:13,234: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:25:13.884706596Z [2024-04-06 01:25:13,883: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9832f1ef-03dd-412d-b3cb-c345fd837556] succeeded in 2.5209611570007837s: None 2024-04-06T01:26:01.372877602Z [2024-04-06 01:26:01,372: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e5f1026d-21c4-4069-9682-39641e48ffc6] received 2024-04-06T01:26:01.380287993Z [2024-04-06 01:26:01,380: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8db13e51-d34b-416f-be0f-e33cc759672a] received 2024-04-06T01:26:01.382370886Z [2024-04-06 01:26:01,382: INFO/ForkPoolWorker-15] [e5f1026d-21c4-4069-9682-39641e48ffc6] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T01:26:01.394814577Z [2024-04-06 01:26:01,394: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4a89176d-6797-4b7d-b389-890f5506a8ec] received 2024-04-06T01:26:01.398426380Z [2024-04-06 01:26:01,398: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b13e65c5-ec88-406c-a464-b7dae4ad46fd] received 2024-04-06T01:26:01.409044044Z [2024-04-06 01:26:01,408: INFO/ForkPoolWorker-1] [4a89176d-6797-4b7d-b389-890f5506a8ec] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:26:01.413186160Z [2024-04-06 01:26:01,412: INFO/ForkPoolWorker-16] [8db13e51-d34b-416f-be0f-e33cc759672a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:26:01.416774274Z [2024-04-06 01:26:01,416: INFO/ForkPoolWorker-2] [b13e65c5-ec88-406c-a464-b7dae4ad46fd] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T01:26:01.757678572Z [2024-04-06 01:26:01,754: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T01:26:01.768502690Z [2024-04-06 01:26:01,764: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:26:01.799913780Z [2024-04-06 01:26:01,796: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T01:26:01.838573892Z [2024-04-06 01:26:01,834: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:26:02.043588205Z [2024-04-06 01:26:02,042: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-06T01:26:02.050284525Z [2024-04-06 01:26:02,049: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:26:02.086649561Z [2024-04-06 01:26:02,086: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:26:02.123146121Z [2024-04-06 01:26:02,122: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T01:26:02.126132681Z [2024-04-06 01:26:02,125: INFO/ForkPoolWorker-2] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T01:26:02.126440924Z [2024-04-06 01:26:02,126: INFO/ForkPoolWorker-2] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T01:26:02.126578934Z [2024-04-06 01:26:02,126: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-06T01:26:02.126882444Z [2024-04-06 01:26:02,126: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T01:26:02.282982391Z [2024-04-06 01:26:02,282: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:26:03.024587819Z [2024-04-06 01:26:03,024: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e5f1026d-21c4-4069-9682-39641e48ffc6] succeeded in 1.6497826570011966s: None 2024-04-06T01:26:03.042208599Z [2024-04-06 01:26:03,041: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b13e65c5-ec88-406c-a464-b7dae4ad46fd] succeeded in 1.6380655200009642s: None 2024-04-06T01:26:03.413808905Z [2024-04-06 01:26:03,413: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T01:26:03.417620911Z [2024-04-06 01:26:03,417: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:26:03.439695025Z [2024-04-06 01:26:03,439: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T01:26:03.440897098Z [2024-04-06 01:26:03,440: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:26:03.440917697Z [2024-04-06 01:26:03,440: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:26:03.441016056Z [2024-04-06 01:26:03,440: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:26:03.441056165Z [2024-04-06 01:26:03,440: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T01:26:03.441259075Z [2024-04-06 01:26:03,441: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:26:03.441291302Z [2024-04-06 01:26:03,441: INFO/ForkPoolWorker-1] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:26:03.445011379Z [2024-04-06 01:26:03,444: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:26:03.448596529Z [2024-04-06 01:26:03,448: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:26:03.475622637Z [2024-04-06 01:26:03,475: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:26:03.476900565Z [2024-04-06 01:26:03,476: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:26:03.476913281Z [2024-04-06 01:26:03,476: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:26:03.477054959Z [2024-04-06 01:26:03,476: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:26:03.477062568Z [2024-04-06 01:26:03,476: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:26:03.477270692Z [2024-04-06 01:26:03,477: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:26:03.477305481Z [2024-04-06 01:26:03,477: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:26:03.518685830Z [2024-04-06 01:26:03,518: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:26:03.556084014Z [2024-04-06 01:26:03,555: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:26:05.575169288Z [2024-04-06 01:26:05,574: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4a89176d-6797-4b7d-b389-890f5506a8ec] succeeded in 4.177510210000037s: None 2024-04-06T01:26:06.249019318Z [2024-04-06 01:26:06,248: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8db13e51-d34b-416f-be0f-e33cc759672a] succeeded in 4.856042108000111s: None 2024-04-06T01:27:00.527818034Z [2024-04-06 01:27:00,527: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d70bfbe2-703b-4d6a-bfe5-e7247c8a1442] received 2024-04-06T01:27:00.534978457Z [2024-04-06 01:27:00,534: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[90c0e8c9-1a09-4058-8c21-cd2671e88f01] received 2024-04-06T01:27:00.541711387Z [2024-04-06 01:27:00,541: INFO/ForkPoolWorker-15] [d70bfbe2-703b-4d6a-bfe5-e7247c8a1442] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:27:00.546702900Z [2024-04-06 01:27:00,546: INFO/ForkPoolWorker-16] [90c0e8c9-1a09-4058-8c21-cd2671e88f01] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:27:00.564208828Z [2024-04-06 01:27:00,563: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[76cc5510-8137-45c8-86ad-dc4db9788664] received 2024-04-06T01:27:00.581982841Z [2024-04-06 01:27:00,581: INFO/ForkPoolWorker-1] [76cc5510-8137-45c8-86ad-dc4db9788664] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T01:27:00.882308734Z [2024-04-06 01:27:00,872: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:27:01.030593488Z [2024-04-06 01:27:01,017: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:27:01.109874575Z [2024-04-06 01:27:01,106: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T01:27:01.286128587Z [2024-04-06 01:27:01,285: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-06T01:27:01.290646499Z [2024-04-06 01:27:01,290: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:27:01.327776680Z [2024-04-06 01:27:01,327: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T01:27:01.332850644Z [2024-04-06 01:27:01,332: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T01:27:01.333036605Z [2024-04-06 01:27:01,332: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T01:27:01.333151742Z [2024-04-06 01:27:01,333: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-06T01:27:01.333479924Z [2024-04-06 01:27:01,333: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T01:27:01.421683463Z [2024-04-06 01:27:01,421: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:27:02.217607365Z [2024-04-06 01:27:02,216: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[76cc5510-8137-45c8-86ad-dc4db9788664] succeeded in 1.650068905999433s: None 2024-04-06T01:27:02.442693933Z [2024-04-06 01:27:02,442: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:27:02.446364050Z [2024-04-06 01:27:02,445: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:27:02.485772164Z [2024-04-06 01:27:02,485: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:27:02.486954094Z [2024-04-06 01:27:02,486: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:27:02.486973775Z [2024-04-06 01:27:02,486: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:27:02.487137658Z [2024-04-06 01:27:02,486: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:27:02.487203077Z [2024-04-06 01:27:02,487: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:27:02.487522851Z [2024-04-06 01:27:02,487: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:27:02.487567424Z [2024-04-06 01:27:02,487: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:27:02.585442047Z [2024-04-06 01:27:02,585: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:27:02.633665754Z [2024-04-06 01:27:02,633: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:27:02.637188825Z [2024-04-06 01:27:02,636: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:27:02.665116864Z [2024-04-06 01:27:02,664: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:27:02.666675230Z [2024-04-06 01:27:02,666: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:27:02.666847011Z [2024-04-06 01:27:02,666: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:27:02.667061398Z [2024-04-06 01:27:02,666: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:27:02.667201746Z [2024-04-06 01:27:02,667: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:27:02.667613064Z [2024-04-06 01:27:02,667: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:27:02.667762456Z [2024-04-06 01:27:02,667: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:27:02.775153623Z [2024-04-06 01:27:02,774: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:27:04.826365704Z [2024-04-06 01:27:04,825: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[90c0e8c9-1a09-4058-8c21-cd2671e88f01] succeeded in 4.28792354899997s: None 2024-04-06T01:27:05.782578593Z [2024-04-06 01:27:05,782: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d70bfbe2-703b-4d6a-bfe5-e7247c8a1442] succeeded in 5.2511300999995s: None 2024-04-06T01:28:00.591211922Z [2024-04-06 01:28:00,590: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2160b925-b719-4eda-b616-93842ff85f4e] received 2024-04-06T01:28:00.594968415Z [2024-04-06 01:28:00,594: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[77befc4b-a331-4314-b93c-2829e818dea8] received 2024-04-06T01:28:00.606533734Z [2024-04-06 01:28:00,606: INFO/ForkPoolWorker-16] [77befc4b-a331-4314-b93c-2829e818dea8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:28:00.606714793Z [2024-04-06 01:28:00,606: INFO/ForkPoolWorker-15] [2160b925-b719-4eda-b616-93842ff85f4e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T01:28:00.619812147Z [2024-04-06 01:28:00,619: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a55d7ba2-ae65-4df6-a7a0-535900be253f] received 2024-04-06T01:28:00.623321219Z [2024-04-06 01:28:00,623: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[28ec36f4-7f9f-49ba-9059-49521b88e678] received 2024-04-06T01:28:00.634957556Z [2024-04-06 01:28:00,634: INFO/ForkPoolWorker-1] [a55d7ba2-ae65-4df6-a7a0-535900be253f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:28:00.635023856Z [2024-04-06 01:28:00,634: INFO/ForkPoolWorker-2] [28ec36f4-7f9f-49ba-9059-49521b88e678] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T01:28:00.963489409Z [2024-04-06 01:28:00,960: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:28:00.971404506Z [2024-04-06 01:28:00,967: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T01:28:01.012819099Z [2024-04-06 01:28:01,009: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T01:28:01.144108098Z [2024-04-06 01:28:01,140: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:28:01.185140664Z [2024-04-06 01:28:01,184: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-06T01:28:01.189477500Z [2024-04-06 01:28:01,188: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:28:01.226728979Z [2024-04-06 01:28:01,226: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T01:28:01.231281451Z [2024-04-06 01:28:01,230: INFO/ForkPoolWorker-2] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T01:28:01.231688462Z [2024-04-06 01:28:01,231: INFO/ForkPoolWorker-2] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T01:28:01.231799302Z [2024-04-06 01:28:01,231: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-06T01:28:01.232230764Z [2024-04-06 01:28:01,232: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T01:28:01.290722323Z [2024-04-06 01:28:01,290: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:28:01.378143440Z [2024-04-06 01:28:01,377: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:28:02.072419567Z [2024-04-06 01:28:02,071: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2160b925-b719-4eda-b616-93842ff85f4e] succeeded in 1.4774544479987526s: None 2024-04-06T01:28:02.112287783Z [2024-04-06 01:28:02,111: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[28ec36f4-7f9f-49ba-9059-49521b88e678] succeeded in 1.4864561419999518s: None 2024-04-06T01:28:02.576325257Z [2024-04-06 01:28:02,575: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:28:02.579860420Z [2024-04-06 01:28:02,579: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:28:02.606240137Z [2024-04-06 01:28:02,606: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:28:02.607600553Z [2024-04-06 01:28:02,607: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:28:02.607616409Z [2024-04-06 01:28:02,607: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:28:02.607868127Z [2024-04-06 01:28:02,607: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:28:02.607927420Z [2024-04-06 01:28:02,607: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:28:02.608291555Z [2024-04-06 01:28:02,608: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:28:02.608328383Z [2024-04-06 01:28:02,608: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:28:02.707172296Z [2024-04-06 01:28:02,706: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:28:02.733095752Z [2024-04-06 01:28:02,732: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T01:28:02.736578398Z [2024-04-06 01:28:02,736: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:28:02.774588202Z [2024-04-06 01:28:02,774: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T01:28:02.778717510Z [2024-04-06 01:28:02,778: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:28:02.781302270Z [2024-04-06 01:28:02,778: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:28:02.781470620Z [2024-04-06 01:28:02,781: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:28:02.781545887Z [2024-04-06 01:28:02,781: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T01:28:02.781901871Z [2024-04-06 01:28:02,781: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:28:02.781934443Z [2024-04-06 01:28:02,781: INFO/ForkPoolWorker-1] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:28:02.900533494Z [2024-04-06 01:28:02,900: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:28:04.606209775Z [2024-04-06 01:28:04,605: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a55d7ba2-ae65-4df6-a7a0-535900be253f] succeeded in 3.9825661089998903s: None 2024-04-06T01:28:04.857418759Z [2024-04-06 01:28:04,856: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[77befc4b-a331-4314-b93c-2829e818dea8] succeeded in 4.259724149998874s: None 2024-04-06T01:29:00.614980349Z [2024-04-06 01:29:00,614: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f638d5da-0eb1-4ba5-b4a3-b341eb1f2485] received 2024-04-06T01:29:00.623925411Z [2024-04-06 01:29:00,623: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[19ab119e-f787-4e2e-9110-e41ff5cc869b] received 2024-04-06T01:29:00.627199864Z [2024-04-06 01:29:00,626: INFO/ForkPoolWorker-15] [f638d5da-0eb1-4ba5-b4a3-b341eb1f2485] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:29:00.639382026Z [2024-04-06 01:29:00,638: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dd3e26dd-cab1-49ab-a490-28868c4327c9] received 2024-04-06T01:29:00.640270203Z [2024-04-06 01:29:00,639: INFO/ForkPoolWorker-16] [19ab119e-f787-4e2e-9110-e41ff5cc869b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:29:00.655579179Z [2024-04-06 01:29:00,655: INFO/ForkPoolWorker-1] [dd3e26dd-cab1-49ab-a490-28868c4327c9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T01:29:00.920222440Z [2024-04-06 01:29:00,915: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:29:00.948868718Z [2024-04-06 01:29:00,944: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T01:29:00.997272364Z [2024-04-06 01:29:00,993: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:29:01.165141591Z [2024-04-06 01:29:01,164: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-06T01:29:01.169779082Z [2024-04-06 01:29:01,169: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:29:01.207900400Z [2024-04-06 01:29:01,207: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T01:29:01.209084129Z [2024-04-06 01:29:01,208: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T01:29:01.209225437Z [2024-04-06 01:29:01,209: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T01:29:01.209298306Z [2024-04-06 01:29:01,209: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-06T01:29:01.209577132Z [2024-04-06 01:29:01,209: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T01:29:01.354097335Z [2024-04-06 01:29:01,353: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:29:02.021004625Z [2024-04-06 01:29:02,020: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[dd3e26dd-cab1-49ab-a490-28868c4327c9] succeeded in 1.3758653910008434s: None 2024-04-06T01:29:02.210840416Z [2024-04-06 01:29:02,210: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:29:02.214281018Z [2024-04-06 01:29:02,213: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:29:02.243910880Z [2024-04-06 01:29:02,243: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:29:02.245447255Z [2024-04-06 01:29:02,245: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:29:02.245496364Z [2024-04-06 01:29:02,245: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:29:02.245605900Z [2024-04-06 01:29:02,245: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:29:02.245624238Z [2024-04-06 01:29:02,245: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:29:02.246062488Z [2024-04-06 01:29:02,245: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:29:02.246072192Z [2024-04-06 01:29:02,245: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:29:02.277098984Z [2024-04-06 01:29:02,276: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:29:02.280573081Z [2024-04-06 01:29:02,279: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:29:02.308226657Z [2024-04-06 01:29:02,307: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:29:02.311323768Z [2024-04-06 01:29:02,310: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:29:02.311528199Z [2024-04-06 01:29:02,311: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:29:02.311792378Z [2024-04-06 01:29:02,311: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:29:02.311808415Z [2024-04-06 01:29:02,311: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:29:02.312225800Z [2024-04-06 01:29:02,312: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:29:02.312238946Z [2024-04-06 01:29:02,312: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:29:02.338554170Z [2024-04-06 01:29:02,338: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:29:02.412759281Z [2024-04-06 01:29:02,412: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:29:03.978658022Z [2024-04-06 01:29:03,978: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[19ab119e-f787-4e2e-9110-e41ff5cc869b] succeeded in 3.35047841999949s: None 2024-04-06T01:29:04.154003820Z [2024-04-06 01:29:04,153: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f638d5da-0eb1-4ba5-b4a3-b341eb1f2485] succeeded in 3.5342137980005646s: None 2024-04-06T01:30:00.756379680Z [2024-04-06 01:30:00,756: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c3d29ee7-8d34-4097-8baf-7d59a1aec132] received 2024-04-06T01:30:00.764804763Z [2024-04-06 01:30:00,764: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6a4d9a89-cab5-46a5-a40b-c36158d3fccf] received 2024-04-06T01:30:00.771931496Z [2024-04-06 01:30:00,771: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[255bb404-9abd-4eb9-97f6-30b35b89b745] received 2024-04-06T01:30:00.775363491Z [2024-04-06 01:30:00,775: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8b9e55c3-97ac-453b-b822-3a629553170a] received 2024-04-06T01:30:00.785951411Z [2024-04-06 01:30:00,785: INFO/ForkPoolWorker-16] [6a4d9a89-cab5-46a5-a40b-c36158d3fccf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:30:00.801482862Z [2024-04-06 01:30:00,801: INFO/ForkPoolWorker-15] [c3d29ee7-8d34-4097-8baf-7d59a1aec132] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:30:00.804047109Z [2024-04-06 01:30:00,803: INFO/ForkPoolWorker-1] [255bb404-9abd-4eb9-97f6-30b35b89b745] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T01:30:00.805408135Z [2024-04-06 01:30:00,805: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[974a75a4-c662-40ca-8f78-b7dde1cc8725] received 2024-04-06T01:30:00.808863830Z [2024-04-06 01:30:00,808: INFO/ForkPoolWorker-2] [8b9e55c3-97ac-453b-b822-3a629553170a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T01:30:00.824580618Z [2024-04-06 01:30:00,824: INFO/ForkPoolWorker-3] [974a75a4-c662-40ca-8f78-b7dde1cc8725] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T01:30:01.242541451Z [2024-04-06 01:30:01,238: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:30:01.466475536Z [2024-04-06 01:30:01,461: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T01:30:01.617083062Z [2024-04-06 01:30:01,604: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T01:30:01.806263727Z [2024-04-06 01:30:01,802: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:30:02.020532202Z [2024-04-06 01:30:01,996: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T01:30:02.065684968Z [2024-04-06 01:30:02,065: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-06T01:30:02.069821661Z [2024-04-06 01:30:02,069: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:30:02.103104950Z [2024-04-06 01:30:02,102: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T01:30:02.104294377Z [2024-04-06 01:30:02,104: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T01:30:02.104401764Z [2024-04-06 01:30:02,104: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T01:30:02.104523627Z [2024-04-06 01:30:02,104: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-06T01:30:02.104820783Z [2024-04-06 01:30:02,104: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T01:30:02.205395835Z [2024-04-06 01:30:02,205: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:30:02.473420645Z [2024-04-06 01:30:02,473: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:30:03.311183384Z [2024-04-06 01:30:03,310: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[255bb404-9abd-4eb9-97f6-30b35b89b745] succeeded in 2.5366991930004588s: None 2024-04-06T01:30:03.510994806Z [2024-04-06 01:30:03,507: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[974a75a4-c662-40ca-8f78-b7dde1cc8725] succeeded in 2.6936462260000553s: None 2024-04-06T01:30:03.904745445Z [2024-04-06 01:30:03,904: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-06T01:30:03.910832088Z [2024-04-06 01:30:03,910: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:30:03.916172836Z [2024-04-06 01:30:03,915: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:30:03.920189454Z [2024-04-06 01:30:03,919: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:30:03.963608761Z [2024-04-06 01:30:03,963: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T01:30:03.970056681Z [2024-04-06 01:30:03,968: INFO/ForkPoolWorker-2] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:30:03.970754387Z [2024-04-06 01:30:03,970: INFO/ForkPoolWorker-2] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:30:03.970972352Z [2024-04-06 01:30:03,970: INFO/ForkPoolWorker-2] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:30:03.971039080Z [2024-04-06 01:30:03,970: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-06T01:30:03.972462999Z [2024-04-06 01:30:03,972: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T01:30:03.972523848Z [2024-04-06 01:30:03,972: INFO/ForkPoolWorker-2] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:30:03.985765983Z [2024-04-06 01:30:03,984: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:30:03.992608031Z [2024-04-06 01:30:03,992: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:30:03.992652025Z [2024-04-06 01:30:03,992: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:30:03.992844790Z [2024-04-06 01:30:03,992: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:30:03.992903252Z [2024-04-06 01:30:03,992: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:30:03.993184760Z [2024-04-06 01:30:03,993: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:30:03.993249850Z [2024-04-06 01:30:03,993: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:30:04.161923953Z [2024-04-06 01:30:04,161: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:30:04.165407282Z [2024-04-06 01:30:04,164: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:30:04.172941681Z [2024-04-06 01:30:04,172: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:30:04.182029034Z [2024-04-06 01:30:04,181: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:30:04.185294757Z [2024-04-06 01:30:04,185: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:30:04.186755172Z [2024-04-06 01:30:04,186: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:30:04.186861641Z [2024-04-06 01:30:04,186: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:30:04.187051789Z [2024-04-06 01:30:04,186: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:30:04.187226034Z [2024-04-06 01:30:04,187: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:30:04.188215375Z [2024-04-06 01:30:04,188: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:30:04.188360417Z [2024-04-06 01:30:04,188: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:30:04.390310826Z [2024-04-06 01:30:04,389: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:30:05.359635785Z [2024-04-06 01:30:05,359: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[8b9e55c3-97ac-453b-b822-3a629553170a] succeeded in 4.579507352000292s: None 2024-04-06T01:30:05.742043499Z [2024-04-06 01:30:05,741: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d9a2c8f7-bd5b-41f0-9ea3-66bdccd109d1] received 2024-04-06T01:30:05.752150743Z [2024-04-06 01:30:05,751: INFO/ForkPoolWorker-1] [d9a2c8f7-bd5b-41f0-9ea3-66bdccd109d1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'split_metrics', 'scheduled__2024-04-06T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T01:30:06.096176206Z [2024-04-06 01:30:06,092: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T01:30:06.648282520Z [2024-04-06 01:30:06,647: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6a4d9a89-cab5-46a5-a40b-c36158d3fccf] succeeded in 5.8812151580004866s: None 2024-04-06T01:30:07.150995323Z [2024-04-06 01:30:07,150: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c3d29ee7-8d34-4097-8baf-7d59a1aec132] succeeded in 6.385713812000176s: None 2024-04-06T01:30:07.702734474Z [2024-04-06 01:30:07,702: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T01:30:07.706219556Z [2024-04-06 01:30:07,705: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:30:07.727534400Z [2024-04-06 01:30:07,727: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T01:30:07.728935994Z [2024-04-06 01:30:07,728: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:30:07.729056076Z [2024-04-06 01:30:07,728: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:30:07.729257446Z [2024-04-06 01:30:07,729: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:30:07.729446341Z [2024-04-06 01:30:07,729: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T01:30:07.729795874Z [2024-04-06 01:30:07,729: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T01:30:07.729985182Z [2024-04-06 01:30:07,729: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:30:07.811089460Z [2024-04-06 01:30:07,810: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:30:08.537162304Z [2024-04-06 01:30:08,536: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d9a2c8f7-bd5b-41f0-9ea3-66bdccd109d1] succeeded in 2.7928441960011696s: None 2024-04-06T01:30:08.665791571Z [2024-04-06 01:30:08,665: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[06052b0a-8208-49b7-9171-46312ff719ef] received 2024-04-06T01:30:08.672815714Z [2024-04-06 01:30:08,672: INFO/ForkPoolWorker-15] [06052b0a-8208-49b7-9171-46312ff719ef] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'collect_metrics', 'scheduled__2024-04-06T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T01:30:09.100339269Z [2024-04-06 01:30:09,096: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T01:30:10.334456064Z [2024-04-06 01:30:10,334: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:30:10.337794161Z [2024-04-06 01:30:10,337: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:30:10.362271957Z [2024-04-06 01:30:10,362: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:30:10.363847634Z [2024-04-06 01:30:10,363: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:30:10.363902472Z [2024-04-06 01:30:10,363: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:30:10.363998141Z [2024-04-06 01:30:10,363: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:30:10.364039094Z [2024-04-06 01:30:10,363: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:30:10.364518300Z [2024-04-06 01:30:10,364: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T01:30:10.364583715Z [2024-04-06 01:30:10,364: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:30:10.463868111Z [2024-04-06 01:30:10,463: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:30:11.163622233Z [2024-04-06 01:30:11,163: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[06052b0a-8208-49b7-9171-46312ff719ef] succeeded in 2.49634621199948s: None 2024-04-06T01:30:11.936076356Z [2024-04-06 01:30:11,935: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[665fe84c-3d9a-4a18-be5b-6a6a331d8248] received 2024-04-06T01:30:11.944461565Z [2024-04-06 01:30:11,943: INFO/ForkPoolWorker-15] [665fe84c-3d9a-4a18-be5b-6a6a331d8248] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'send_prometheus', 'scheduled__2024-04-06T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T01:30:12.228202169Z [2024-04-06 01:30:12,224: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T01:30:13.461869140Z [2024-04-06 01:30:13,461: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:30:13.468688879Z [2024-04-06 01:30:13,468: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:30:13.526515248Z [2024-04-06 01:30:13,526: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:30:13.528337030Z [2024-04-06 01:30:13,528: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:30:13.528596042Z [2024-04-06 01:30:13,528: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:30:13.529102931Z [2024-04-06 01:30:13,528: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:30:13.529333983Z [2024-04-06 01:30:13,529: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:30:13.529743989Z [2024-04-06 01:30:13,529: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T01:30:13.529935058Z [2024-04-06 01:30:13,529: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:30:13.624163487Z [2024-04-06 01:30:13,623: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:30:14.190761644Z [2024-04-06 01:30:14,190: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[665fe84c-3d9a-4a18-be5b-6a6a331d8248] succeeded in 2.252512019000278s: None 2024-04-06T01:31:00.202836316Z [2024-04-06 01:31:00,202: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f63c99ce-a3eb-4197-a889-ba79c3e9a2c6] received 2024-04-06T01:31:00.208278518Z [2024-04-06 01:31:00,208: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5be806d5-83ad-4c9d-9ac6-081a0d4fb014] received 2024-04-06T01:31:00.210424476Z [2024-04-06 01:31:00,210: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1a4ff082-09e2-4510-9594-2448d54295b6] received 2024-04-06T01:31:00.219829061Z [2024-04-06 01:31:00,219: INFO/ForkPoolWorker-16] [5be806d5-83ad-4c9d-9ac6-081a0d4fb014] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:31:00.219993359Z [2024-04-06 01:31:00,218: INFO/ForkPoolWorker-1] [1a4ff082-09e2-4510-9594-2448d54295b6] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T01:31:00.220024166Z [2024-04-06 01:31:00,219: INFO/ForkPoolWorker-15] [f63c99ce-a3eb-4197-a889-ba79c3e9a2c6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:31:00.496447453Z [2024-04-06 01:31:00,493: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:31:00.497167992Z [2024-04-06 01:31:00,494: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:31:00.523199827Z [2024-04-06 01:31:00,519: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T01:31:00.695963577Z [2024-04-06 01:31:00,695: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-06T01:31:00.702124796Z [2024-04-06 01:31:00,701: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:31:00.730243526Z [2024-04-06 01:31:00,730: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T01:31:00.731474811Z [2024-04-06 01:31:00,731: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T01:31:00.731719436Z [2024-04-06 01:31:00,731: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T01:31:00.731881462Z [2024-04-06 01:31:00,731: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-06T01:31:00.732136001Z [2024-04-06 01:31:00,732: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T01:31:00.826379836Z [2024-04-06 01:31:00,826: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:31:01.397503304Z [2024-04-06 01:31:01,397: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1a4ff082-09e2-4510-9594-2448d54295b6] succeeded in 1.1853535919999558s: None 2024-04-06T01:31:01.608099211Z [2024-04-06 01:31:01,607: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:31:01.611466906Z [2024-04-06 01:31:01,610: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:31:01.631332263Z [2024-04-06 01:31:01,631: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:31:01.632792108Z [2024-04-06 01:31:01,632: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:31:01.632952308Z [2024-04-06 01:31:01,632: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:31:01.633208740Z [2024-04-06 01:31:01,632: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:31:01.633358734Z [2024-04-06 01:31:01,633: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:31:01.633886431Z [2024-04-06 01:31:01,633: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:31:01.634055049Z [2024-04-06 01:31:01,633: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:31:01.687303782Z [2024-04-06 01:31:01,686: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:31:01.690831408Z [2024-04-06 01:31:01,690: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:31:01.710110085Z [2024-04-06 01:31:01,709: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:31:01.711543312Z [2024-04-06 01:31:01,711: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:31:01.711566277Z [2024-04-06 01:31:01,711: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:31:01.711735942Z [2024-04-06 01:31:01,711: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:31:01.711790649Z [2024-04-06 01:31:01,711: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:31:01.712078995Z [2024-04-06 01:31:01,711: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:31:01.712105350Z [2024-04-06 01:31:01,712: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:31:01.738985618Z [2024-04-06 01:31:01,738: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:31:01.800868325Z [2024-04-06 01:31:01,800: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:31:03.366937650Z [2024-04-06 01:31:03,366: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5be806d5-83ad-4c9d-9ac6-081a0d4fb014] succeeded in 3.1570920679987466s: None 2024-04-06T01:31:03.550770969Z [2024-04-06 01:31:03,550: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f63c99ce-a3eb-4197-a889-ba79c3e9a2c6] succeeded in 3.3407309750000422s: None 2024-04-06T01:32:00.602616233Z [2024-04-06 01:32:00,602: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1425dd8c-fc9c-46a1-a835-bae11f8b384b] received 2024-04-06T01:32:00.604981118Z [2024-04-06 01:32:00,604: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f639c86e-73f0-4b56-a708-f28e9bccc7dd] received 2024-04-06T01:32:00.618667674Z [2024-04-06 01:32:00,618: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f291b38b-402c-4f4c-9251-c3eb14146ad7] received 2024-04-06T01:32:00.619686457Z [2024-04-06 01:32:00,619: INFO/ForkPoolWorker-15] [1425dd8c-fc9c-46a1-a835-bae11f8b384b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T01:32:00.620245920Z [2024-04-06 01:32:00,619: INFO/ForkPoolWorker-16] [f639c86e-73f0-4b56-a708-f28e9bccc7dd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:32:00.635813379Z [2024-04-06 01:32:00,635: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[73dbb2f6-2cd7-46a6-9761-1fc813f10091] received 2024-04-06T01:32:00.649686931Z [2024-04-06 01:32:00,646: INFO/ForkPoolWorker-1] [f291b38b-402c-4f4c-9251-c3eb14146ad7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:32:00.659171164Z [2024-04-06 01:32:00,658: INFO/ForkPoolWorker-2] [73dbb2f6-2cd7-46a6-9761-1fc813f10091] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T01:32:00.939659176Z [2024-04-06 01:32:00,936: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:32:01.047419675Z [2024-04-06 01:32:01,044: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T01:32:01.048663614Z [2024-04-06 01:32:01,045: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T01:32:01.085242094Z [2024-04-06 01:32:01,080: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:32:01.217140960Z [2024-04-06 01:32:01,216: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-06T01:32:01.223484023Z [2024-04-06 01:32:01,222: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:32:01.271569232Z [2024-04-06 01:32:01,271: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T01:32:01.275920962Z [2024-04-06 01:32:01,275: INFO/ForkPoolWorker-2] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T01:32:01.276242297Z [2024-04-06 01:32:01,275: INFO/ForkPoolWorker-2] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T01:32:01.276371297Z [2024-04-06 01:32:01,276: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-06T01:32:01.276658063Z [2024-04-06 01:32:01,276: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T01:32:01.397627285Z [2024-04-06 01:32:01,397: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:32:01.435842700Z [2024-04-06 01:32:01,435: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:32:02.003829757Z [2024-04-06 01:32:02,003: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1425dd8c-fc9c-46a1-a835-bae11f8b384b] succeeded in 1.397370480999598s: None 2024-04-06T01:32:02.083326339Z [2024-04-06 01:32:02,082: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[73dbb2f6-2cd7-46a6-9761-1fc813f10091] succeeded in 1.4417289129996789s: None 2024-04-06T01:32:02.379854193Z [2024-04-06 01:32:02,379: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T01:32:02.379902861Z [2024-04-06 01:32:02,379: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:32:02.382973567Z [2024-04-06 01:32:02,382: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:32:02.383055629Z [2024-04-06 01:32:02,382: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:32:02.404248213Z [2024-04-06 01:32:02,404: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:32:02.405436352Z [2024-04-06 01:32:02,405: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:32:02.405579580Z [2024-04-06 01:32:02,405: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:32:02.405711582Z [2024-04-06 01:32:02,405: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:32:02.405727257Z [2024-04-06 01:32:02,405: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:32:02.405996833Z [2024-04-06 01:32:02,405: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:32:02.406016320Z [2024-04-06 01:32:02,405: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:32:02.417128924Z [2024-04-06 01:32:02,416: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T01:32:02.420437935Z [2024-04-06 01:32:02,420: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:32:02.420465021Z [2024-04-06 01:32:02,420: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:32:02.420698559Z [2024-04-06 01:32:02,420: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:32:02.420733318Z [2024-04-06 01:32:02,420: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T01:32:02.422355144Z [2024-04-06 01:32:02,420: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:32:02.422417583Z [2024-04-06 01:32:02,422: INFO/ForkPoolWorker-1] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:32:02.503968151Z [2024-04-06 01:32:02,503: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:32:02.522870253Z [2024-04-06 01:32:02,522: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:32:04.102629730Z [2024-04-06 01:32:04,102: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f291b38b-402c-4f4c-9251-c3eb14146ad7] succeeded in 3.4724229960011144s: None 2024-04-06T01:32:04.371835851Z [2024-04-06 01:32:04,371: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f639c86e-73f0-4b56-a708-f28e9bccc7dd] succeeded in 3.7594642250005563s: None 2024-04-06T01:33:01.002958634Z [2024-04-06 01:33:01,002: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bed76241-9fe2-4db0-bc2b-338430a92ea5] received 2024-04-06T01:33:01.007493872Z [2024-04-06 01:33:01,007: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[19685cb7-06ca-4ae5-b09b-7d6eac9b51d0] received 2024-04-06T01:33:01.009672754Z [2024-04-06 01:33:01,009: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3207e866-74b3-4883-9d67-636a806c6c49] received 2024-04-06T01:33:01.019360011Z [2024-04-06 01:33:01,019: INFO/ForkPoolWorker-15] [bed76241-9fe2-4db0-bc2b-338430a92ea5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:33:01.019381832Z [2024-04-06 01:33:01,019: INFO/ForkPoolWorker-16] [19685cb7-06ca-4ae5-b09b-7d6eac9b51d0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:33:01.024441721Z [2024-04-06 01:33:01,024: INFO/ForkPoolWorker-1] [3207e866-74b3-4883-9d67-636a806c6c49] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T01:33:01.333435072Z [2024-04-06 01:33:01,330: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:33:01.350682475Z [2024-04-06 01:33:01,346: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T01:33:01.357613033Z [2024-04-06 01:33:01,354: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:33:01.529053515Z [2024-04-06 01:33:01,528: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-06T01:33:01.533398802Z [2024-04-06 01:33:01,532: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:33:01.575215722Z [2024-04-06 01:33:01,574: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T01:33:01.577759118Z [2024-04-06 01:33:01,577: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T01:33:01.578061749Z [2024-04-06 01:33:01,577: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T01:33:01.578231182Z [2024-04-06 01:33:01,578: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-06T01:33:01.579029428Z [2024-04-06 01:33:01,578: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T01:33:01.682309781Z [2024-04-06 01:33:01,682: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:33:02.360621205Z [2024-04-06 01:33:02,360: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3207e866-74b3-4883-9d67-636a806c6c49] succeeded in 1.347325799999453s: None 2024-04-06T01:33:02.495156474Z [2024-04-06 01:33:02,494: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:33:02.498873594Z [2024-04-06 01:33:02,498: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:33:02.518524562Z [2024-04-06 01:33:02,518: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:33:02.520235876Z [2024-04-06 01:33:02,519: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:33:02.520369645Z [2024-04-06 01:33:02,520: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:33:02.520568961Z [2024-04-06 01:33:02,520: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:33:02.520849995Z [2024-04-06 01:33:02,520: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:33:02.521144892Z [2024-04-06 01:33:02,521: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:33:02.521312432Z [2024-04-06 01:33:02,521: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:33:02.627831450Z [2024-04-06 01:33:02,627: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:33:02.648726885Z [2024-04-06 01:33:02,648: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:33:02.652312673Z [2024-04-06 01:33:02,651: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:33:02.674501371Z [2024-04-06 01:33:02,674: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:33:02.675957204Z [2024-04-06 01:33:02,675: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:33:02.675988523Z [2024-04-06 01:33:02,675: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:33:02.676112936Z [2024-04-06 01:33:02,675: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:33:02.676158540Z [2024-04-06 01:33:02,676: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:33:02.676424182Z [2024-04-06 01:33:02,676: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:33:02.676615695Z [2024-04-06 01:33:02,676: INFO/ForkPoolWorker-15] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:33:02.774341952Z [2024-04-06 01:33:02,773: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:33:04.453673653Z [2024-04-06 01:33:04,452: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bed76241-9fe2-4db0-bc2b-338430a92ea5] succeeded in 3.4439422590003232s: None 2024-04-06T01:33:04.645364181Z [2024-04-06 01:33:04,644: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[19685cb7-06ca-4ae5-b09b-7d6eac9b51d0] succeeded in 3.6343386370008375s: None 2024-04-06T01:34:00.302342233Z [2024-04-06 01:34:00,301: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7466b054-c2b9-46d2-9b40-295f6a579d15] received 2024-04-06T01:34:00.311535109Z [2024-04-06 01:34:00,311: INFO/ForkPoolWorker-15] [7466b054-c2b9-46d2-9b40-295f6a579d15] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T01:34:00.316925556Z [2024-04-06 01:34:00,316: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[acc1fb97-3090-4cf3-b7d5-e6bf6b6c4bb6] received 2024-04-06T01:34:00.318556161Z [2024-04-06 01:34:00,318: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[edbb6cdf-5b6c-4fc6-9ef1-c55859f2da81] received 2024-04-06T01:34:00.324483961Z [2024-04-06 01:34:00,324: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2794284a-3a4d-4898-8427-7f68bd551271] received 2024-04-06T01:34:00.325715945Z [2024-04-06 01:34:00,325: INFO/ForkPoolWorker-1] [edbb6cdf-5b6c-4fc6-9ef1-c55859f2da81] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:34:00.336315296Z [2024-04-06 01:34:00,335: INFO/ForkPoolWorker-16] [acc1fb97-3090-4cf3-b7d5-e6bf6b6c4bb6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:34:00.337972440Z [2024-04-06 01:34:00,337: INFO/ForkPoolWorker-2] [2794284a-3a4d-4898-8427-7f68bd551271] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T01:34:00.656067250Z [2024-04-06 01:34:00,653: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:34:00.666158363Z [2024-04-06 01:34:00,662: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T01:34:00.776526142Z [2024-04-06 01:34:00,770: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:34:00.832117256Z [2024-04-06 01:34:00,828: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T01:34:01.013698790Z [2024-04-06 01:34:01,009: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:34:01.078970990Z [2024-04-06 01:34:01,078: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-06T01:34:01.082820524Z [2024-04-06 01:34:01,082: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:34:01.102374426Z [2024-04-06 01:34:01,102: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T01:34:01.103571313Z [2024-04-06 01:34:01,103: INFO/ForkPoolWorker-2] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T01:34:01.103629701Z [2024-04-06 01:34:01,103: INFO/ForkPoolWorker-2] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T01:34:01.103712066Z [2024-04-06 01:34:01,103: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-06T01:34:01.104215729Z [2024-04-06 01:34:01,104: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T01:34:01.200124876Z [2024-04-06 01:34:01,199: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:34:01.600510317Z [2024-04-06 01:34:01,599: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7466b054-c2b9-46d2-9b40-295f6a579d15] succeeded in 1.2949856909999653s: None 2024-04-06T01:34:01.758251344Z [2024-04-06 01:34:01,757: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[2794284a-3a4d-4898-8427-7f68bd551271] succeeded in 1.4271933700001682s: None 2024-04-06T01:34:02.021994562Z [2024-04-06 01:34:02,021: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T01:34:02.025203514Z [2024-04-06 01:34:02,024: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:34:02.044811444Z [2024-04-06 01:34:02,044: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T01:34:02.046111248Z [2024-04-06 01:34:02,045: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:34:02.046265692Z [2024-04-06 01:34:02,046: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:34:02.046397691Z [2024-04-06 01:34:02,046: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:34:02.046498439Z [2024-04-06 01:34:02,046: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T01:34:02.046741373Z [2024-04-06 01:34:02,046: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:34:02.046815554Z [2024-04-06 01:34:02,046: INFO/ForkPoolWorker-1] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:34:02.138198430Z [2024-04-06 01:34:02,137: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:34:02.237776945Z [2024-04-06 01:34:02,237: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:34:02.241240723Z [2024-04-06 01:34:02,240: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:34:02.264963714Z [2024-04-06 01:34:02,264: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:34:02.266286928Z [2024-04-06 01:34:02,266: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:34:02.266321759Z [2024-04-06 01:34:02,266: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:34:02.266462297Z [2024-04-06 01:34:02,266: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:34:02.266510597Z [2024-04-06 01:34:02,266: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:34:02.266765167Z [2024-04-06 01:34:02,266: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:34:02.266835610Z [2024-04-06 01:34:02,266: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:34:02.348682546Z [2024-04-06 01:34:02,348: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:34:03.611464399Z [2024-04-06 01:34:03,610: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[edbb6cdf-5b6c-4fc6-9ef1-c55859f2da81] succeeded in 3.287489510999876s: None 2024-04-06T01:34:04.240179532Z [2024-04-06 01:34:04,239: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[acc1fb97-3090-4cf3-b7d5-e6bf6b6c4bb6] succeeded in 3.9187752150010056s: None 2024-04-06T01:35:00.708013022Z [2024-04-06 01:35:00,707: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a9dcf542-6db8-48e6-84c4-10eb230dd21b] received 2024-04-06T01:35:00.709468961Z [2024-04-06 01:35:00,709: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8fa27d3c-08fa-4533-a70c-e113b153bace] received 2024-04-06T01:35:00.716163836Z [2024-04-06 01:35:00,715: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7cfdafa5-0ea2-4f4f-af3d-8164968d4a22] received 2024-04-06T01:35:00.718887489Z [2024-04-06 01:35:00,718: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c8287591-20c2-4f7c-b93c-37b67f6c8c27] received 2024-04-06T01:35:00.725152185Z [2024-04-06 01:35:00,724: INFO/ForkPoolWorker-15] [a9dcf542-6db8-48e6-84c4-10eb230dd21b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T01:35:00.726792455Z [2024-04-06 01:35:00,726: INFO/ForkPoolWorker-16] [8fa27d3c-08fa-4533-a70c-e113b153bace] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:35:00.737003925Z [2024-04-06 01:35:00,736: INFO/ForkPoolWorker-2] [c8287591-20c2-4f7c-b93c-37b67f6c8c27] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T01:35:00.740054354Z [2024-04-06 01:35:00,739: INFO/ForkPoolWorker-1] [7cfdafa5-0ea2-4f4f-af3d-8164968d4a22] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:35:01.061904401Z [2024-04-06 01:35:01,058: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T01:35:01.104542366Z [2024-04-06 01:35:01,101: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:35:01.105829187Z [2024-04-06 01:35:01,102: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:35:01.128675072Z [2024-04-06 01:35:01,120: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T01:35:01.387731902Z [2024-04-06 01:35:01,387: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-06T01:35:01.391864466Z [2024-04-06 01:35:01,391: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:35:01.425133694Z [2024-04-06 01:35:01,424: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T01:35:01.426803695Z [2024-04-06 01:35:01,426: INFO/ForkPoolWorker-2] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T01:35:01.427030826Z [2024-04-06 01:35:01,426: INFO/ForkPoolWorker-2] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T01:35:01.427247043Z [2024-04-06 01:35:01,427: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-06T01:35:01.427638752Z [2024-04-06 01:35:01,427: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T01:35:01.526720024Z [2024-04-06 01:35:01,526: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:35:02.061642846Z [2024-04-06 01:35:02,061: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[c8287591-20c2-4f7c-b93c-37b67f6c8c27] succeeded in 1.3401407849996758s: None 2024-04-06T01:35:02.488159665Z [2024-04-06 01:35:02,487: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:35:02.491914214Z [2024-04-06 01:35:02,491: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:35:02.513153582Z [2024-04-06 01:35:02,512: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:35:02.514472021Z [2024-04-06 01:35:02,514: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:35:02.514483810Z [2024-04-06 01:35:02,514: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:35:02.514517487Z [2024-04-06 01:35:02,514: INFO/ForkPoolWorker-16] Read VIM 53a217fe-e660-47b9-8c59-e1e6821a348b (k8s07_dummy) 2024-04-06T01:35:02.514652010Z [2024-04-06 01:35:02,514: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '53a217fe-e660-47b9-8c59-e1e6821a348b', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-06T01:35:02.514680153Z [2024-04-06 01:35:02,514: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:35:02.514905162Z [2024-04-06 01:35:02,514: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:35:02.514938023Z [2024-04-06 01:35:02,514: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:35:02.519835883Z [2024-04-06 01:35:02,519: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:35:02.538946464Z [2024-04-06 01:35:02,538: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T01:35:02.540955595Z [2024-04-06 01:35:02,540: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:35:02.543107199Z [2024-04-06 01:35:02,542: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:35:02.544324527Z [2024-04-06 01:35:02,543: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:35:02.567856601Z [2024-04-06 01:35:02,567: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T01:35:02.570658375Z [2024-04-06 01:35:02,570: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:35:02.572858538Z [2024-04-06 01:35:02,572: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:35:02.572927154Z [2024-04-06 01:35:02,572: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:35:02.573027860Z [2024-04-06 01:35:02,572: INFO/ForkPoolWorker-15] Read VIM 53a217fe-e660-47b9-8c59-e1e6821a348b (k8s07_dummy) 2024-04-06T01:35:02.573230361Z [2024-04-06 01:35:02,573: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '53a217fe-e660-47b9-8c59-e1e6821a348b', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-06T01:35:02.573303266Z [2024-04-06 01:35:02,573: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:35:02.573653598Z [2024-04-06 01:35:02,573: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T01:35:02.573741546Z [2024-04-06 01:35:02,573: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:35:02.579730789Z [2024-04-06 01:35:02,579: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:35:02.579833573Z [2024-04-06 01:35:02,579: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:35:02.580058500Z [2024-04-06 01:35:02,579: INFO/ForkPoolWorker-1] Read VIM 53a217fe-e660-47b9-8c59-e1e6821a348b (k8s07_dummy) 2024-04-06T01:35:02.580359394Z [2024-04-06 01:35:02,580: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '53a217fe-e660-47b9-8c59-e1e6821a348b', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-06T01:35:02.580530040Z [2024-04-06 01:35:02,580: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T01:35:02.581008590Z [2024-04-06 01:35:02,580: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:35:02.581209918Z [2024-04-06 01:35:02,580: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:35:02.583904815Z [2024-04-06 01:35:02,583: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T01:35:02.590565311Z [2024-04-06 01:35:02,590: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:35:02.599240665Z [2024-04-06 01:35:02,598: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:35:02.668481791Z [2024-04-06 01:35:02,668: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:35:02.675503162Z [2024-04-06 01:35:02,675: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:35:03.271149534Z [2024-04-06 01:35:03,270: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a9dcf542-6db8-48e6-84c4-10eb230dd21b] succeeded in 2.560190520998731s: None 2024-04-06T01:35:03.560670198Z [2024-04-06 01:35:03,560: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dd7b4e31-0351-4ea4-a470-38efb6b5e770] received 2024-04-06T01:35:03.568828317Z [2024-04-06 01:35:03,568: INFO/ForkPoolWorker-15] [dd7b4e31-0351-4ea4-a470-38efb6b5e770] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'split_metrics', 'scheduled__2024-04-06T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T01:35:03.863372253Z [2024-04-06 01:35:03,860: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T01:35:04.027520742Z [2024-04-06 01:35:04,026: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8fa27d3c-08fa-4533-a70c-e113b153bace] succeeded in 3.3143790809990605s: None 2024-04-06T01:35:04.430040301Z [2024-04-06 01:35:04,429: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7cfdafa5-0ea2-4f4f-af3d-8164968d4a22] succeeded in 3.707470678999016s: None 2024-04-06T01:35:05.074606305Z [2024-04-06 01:35:05,074: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:35:05.077814114Z [2024-04-06 01:35:05,077: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:35:05.108834281Z [2024-04-06 01:35:05,108: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:35:05.110056956Z [2024-04-06 01:35:05,109: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:35:05.110089934Z [2024-04-06 01:35:05,109: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:35:05.110095414Z [2024-04-06 01:35:05,109: INFO/ForkPoolWorker-15] Read VIM 53a217fe-e660-47b9-8c59-e1e6821a348b (k8s07_dummy) 2024-04-06T01:35:05.110248472Z [2024-04-06 01:35:05,109: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '53a217fe-e660-47b9-8c59-e1e6821a348b', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-06T01:35:05.110260208Z [2024-04-06 01:35:05,110: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:35:05.110489762Z [2024-04-06 01:35:05,110: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T01:35:05.110500709Z [2024-04-06 01:35:05,110: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:35:05.117785387Z [2024-04-06 01:35:05,117: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T01:35:05.214003940Z [2024-04-06 01:35:05,213: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:35:05.921804361Z [2024-04-06 01:35:05,921: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[dd7b4e31-0351-4ea4-a470-38efb6b5e770] succeeded in 2.3584672789984324s: None 2024-04-06T01:35:06.446342040Z [2024-04-06 01:35:06,445: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a8c26a54-b5f0-4ceb-8423-5e11d4a219bb] received 2024-04-06T01:35:06.459430732Z [2024-04-06 01:35:06,458: INFO/ForkPoolWorker-15] [a8c26a54-b5f0-4ceb-8423-5e11d4a219bb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'collect_metrics', 'scheduled__2024-04-06T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T01:35:06.742158860Z [2024-04-06 01:35:06,739: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T01:35:07.809417672Z [2024-04-06 01:35:07,808: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:35:07.812418311Z [2024-04-06 01:35:07,811: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:35:07.839156518Z [2024-04-06 01:35:07,838: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:35:07.842356863Z [2024-04-06 01:35:07,841: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:35:07.842432340Z [2024-04-06 01:35:07,842: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:35:07.842597041Z [2024-04-06 01:35:07,842: INFO/ForkPoolWorker-15] Read VIM 53a217fe-e660-47b9-8c59-e1e6821a348b (k8s07_dummy) 2024-04-06T01:35:07.843035379Z [2024-04-06 01:35:07,842: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '53a217fe-e660-47b9-8c59-e1e6821a348b', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-06T01:35:07.843177237Z [2024-04-06 01:35:07,842: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:35:07.843619675Z [2024-04-06 01:35:07,843: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T01:35:07.843910575Z [2024-04-06 01:35:07,843: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:35:07.855356013Z [2024-04-06 01:35:07,854: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T01:35:07.965646645Z [2024-04-06 01:35:07,965: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:35:08.608527870Z [2024-04-06 01:35:08,608: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a8c26a54-b5f0-4ceb-8423-5e11d4a219bb] succeeded in 2.1590382300000783s: None 2024-04-06T01:35:09.291038185Z [2024-04-06 01:35:09,290: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2d1e430b-d250-4858-8a17-646f64836682] received 2024-04-06T01:35:09.299712525Z [2024-04-06 01:35:09,299: INFO/ForkPoolWorker-15] [2d1e430b-d250-4858-8a17-646f64836682] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'send_prometheus', 'scheduled__2024-04-06T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T01:35:09.564773387Z [2024-04-06 01:35:09,560: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T01:35:10.866898120Z [2024-04-06 01:35:10,866: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:35:10.870368756Z [2024-04-06 01:35:10,869: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:35:10.893725789Z [2024-04-06 01:35:10,893: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:35:10.895381233Z [2024-04-06 01:35:10,895: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:35:10.895543824Z [2024-04-06 01:35:10,895: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:35:10.895746932Z [2024-04-06 01:35:10,895: INFO/ForkPoolWorker-15] Read VIM 53a217fe-e660-47b9-8c59-e1e6821a348b (k8s07_dummy) 2024-04-06T01:35:10.895966256Z [2024-04-06 01:35:10,895: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '53a217fe-e660-47b9-8c59-e1e6821a348b', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-06T01:35:10.896124006Z [2024-04-06 01:35:10,895: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:35:10.896593644Z [2024-04-06 01:35:10,896: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T01:35:10.896699662Z [2024-04-06 01:35:10,896: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:35:10.903786562Z [2024-04-06 01:35:10,903: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T01:35:10.988525582Z [2024-04-06 01:35:10,988: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:35:11.596625617Z [2024-04-06 01:35:11,595: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2d1e430b-d250-4858-8a17-646f64836682] succeeded in 2.303202154000246s: None 2024-04-06T01:36:00.497037282Z [2024-04-06 01:36:00,496: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ddb9c508-576d-4915-82de-3856fd10c8b1] received 2024-04-06T01:36:00.505314305Z [2024-04-06 01:36:00,504: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7047d2f0-5db1-4927-a945-cd949144d70b] received 2024-04-06T01:36:00.506853582Z [2024-04-06 01:36:00,506: INFO/ForkPoolWorker-15] [ddb9c508-576d-4915-82de-3856fd10c8b1] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T01:36:00.511304846Z [2024-04-06 01:36:00,510: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[06ca1b6d-02dd-49ac-b0d9-9292b08513ae] received 2024-04-06T01:36:00.514634444Z [2024-04-06 01:36:00,513: INFO/ForkPoolWorker-16] [7047d2f0-5db1-4927-a945-cd949144d70b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:36:00.522147061Z [2024-04-06 01:36:00,521: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[65187c84-2467-4a7e-890a-452c697d303a] received 2024-04-06T01:36:00.523077122Z [2024-04-06 01:36:00,522: INFO/ForkPoolWorker-1] [06ca1b6d-02dd-49ac-b0d9-9292b08513ae] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:36:00.537996738Z [2024-04-06 01:36:00,537: INFO/ForkPoolWorker-2] [65187c84-2467-4a7e-890a-452c697d303a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T01:36:00.808050941Z [2024-04-06 01:36:00,803: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:36:00.864660556Z [2024-04-06 01:36:00,860: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:36:01.019308316Z [2024-04-06 01:36:01,016: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T01:36:01.059362205Z [2024-04-06 01:36:01,055: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T01:36:01.268056117Z [2024-04-06 01:36:01,267: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-06T01:36:01.272055857Z [2024-04-06 01:36:01,271: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:36:01.276658738Z [2024-04-06 01:36:01,276: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:36:01.300349267Z [2024-04-06 01:36:01,300: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T01:36:01.303058936Z [2024-04-06 01:36:01,302: INFO/ForkPoolWorker-2] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T01:36:01.303101558Z [2024-04-06 01:36:01,302: INFO/ForkPoolWorker-2] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T01:36:01.303159539Z [2024-04-06 01:36:01,303: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-06T01:36:01.303398216Z [2024-04-06 01:36:01,303: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T01:36:01.446039861Z [2024-04-06 01:36:01,445: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:36:01.863655843Z [2024-04-06 01:36:01,863: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ddb9c508-576d-4915-82de-3856fd10c8b1] succeeded in 1.3625848470001074s: None 2024-04-06T01:36:02.061831609Z [2024-04-06 01:36:02,061: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[65187c84-2467-4a7e-890a-452c697d303a] succeeded in 1.536282121000113s: None 2024-04-06T01:36:02.157430286Z [2024-04-06 01:36:02,157: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T01:36:02.161006619Z [2024-04-06 01:36:02,160: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:36:02.184984084Z [2024-04-06 01:36:02,184: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T01:36:02.187282820Z [2024-04-06 01:36:02,186: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:36:02.187480116Z [2024-04-06 01:36:02,187: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:36:02.187604834Z [2024-04-06 01:36:02,187: INFO/ForkPoolWorker-1] Read VIM 53a217fe-e660-47b9-8c59-e1e6821a348b (k8s07_dummy) 2024-04-06T01:36:02.187804545Z [2024-04-06 01:36:02,187: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '53a217fe-e660-47b9-8c59-e1e6821a348b', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-06T01:36:02.187896981Z [2024-04-06 01:36:02,187: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T01:36:02.188221270Z [2024-04-06 01:36:02,188: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:36:02.188475035Z [2024-04-06 01:36:02,188: INFO/ForkPoolWorker-1] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:36:02.193407211Z [2024-04-06 01:36:02,193: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:36:02.258068808Z [2024-04-06 01:36:02,257: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:36:02.261588679Z [2024-04-06 01:36:02,261: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:36:02.275903994Z [2024-04-06 01:36:02,275: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:36:02.289437570Z [2024-04-06 01:36:02,289: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:36:02.290696687Z [2024-04-06 01:36:02,290: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:36:02.290735388Z [2024-04-06 01:36:02,290: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:36:02.290796584Z [2024-04-06 01:36:02,290: INFO/ForkPoolWorker-16] Read VIM 53a217fe-e660-47b9-8c59-e1e6821a348b (k8s07_dummy) 2024-04-06T01:36:02.290955438Z [2024-04-06 01:36:02,290: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '53a217fe-e660-47b9-8c59-e1e6821a348b', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-06T01:36:02.290966745Z [2024-04-06 01:36:02,290: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:36:02.291185863Z [2024-04-06 01:36:02,291: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:36:02.291234260Z [2024-04-06 01:36:02,291: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:36:02.296042432Z [2024-04-06 01:36:02,295: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:36:02.377241580Z [2024-04-06 01:36:02,376: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:36:03.971967372Z [2024-04-06 01:36:03,971: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[06ca1b6d-02dd-49ac-b0d9-9292b08513ae] succeeded in 3.4576538849996723s: None 2024-04-06T01:36:04.350691725Z [2024-04-06 01:36:04,350: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7047d2f0-5db1-4927-a945-cd949144d70b] succeeded in 3.8426500219993613s: None 2024-04-06T01:37:00.569751444Z [2024-04-06 01:37:00,569: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[208c4ba8-1fc7-4328-8c08-2699fc49d447] received 2024-04-06T01:37:00.577493751Z [2024-04-06 01:37:00,577: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e55c99a8-e32e-4165-a513-ab19125f4705] received 2024-04-06T01:37:00.580777817Z [2024-04-06 01:37:00,580: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8b83c622-8557-4bf7-99ee-e67f32ab4265] received 2024-04-06T01:37:00.582331523Z [2024-04-06 01:37:00,582: INFO/ForkPoolWorker-15] [208c4ba8-1fc7-4328-8c08-2699fc49d447] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:37:00.591650718Z [2024-04-06 01:37:00,591: INFO/ForkPoolWorker-16] [e55c99a8-e32e-4165-a513-ab19125f4705] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T01:37:00.595895839Z [2024-04-06 01:37:00,595: INFO/ForkPoolWorker-1] [8b83c622-8557-4bf7-99ee-e67f32ab4265] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:37:00.853872767Z [2024-04-06 01:37:00,849: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:37:00.907884560Z [2024-04-06 01:37:00,904: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T01:37:00.918850714Z [2024-04-06 01:37:00,915: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:37:01.065002677Z [2024-04-06 01:37:01,064: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-06T01:37:01.068842742Z [2024-04-06 01:37:01,068: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:37:01.087262582Z [2024-04-06 01:37:01,087: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:37:01.088208169Z [2024-04-06 01:37:01,088: INFO/ForkPoolWorker-16] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T01:37:01.088338391Z [2024-04-06 01:37:01,088: INFO/ForkPoolWorker-16] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T01:37:01.088452514Z [2024-04-06 01:37:01,088: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-06T01:37:01.088725546Z [2024-04-06 01:37:01,088: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T01:37:01.167942906Z [2024-04-06 01:37:01,167: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:37:01.729044891Z [2024-04-06 01:37:01,728: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e55c99a8-e32e-4165-a513-ab19125f4705] succeeded in 1.1489994750008918s: None 2024-04-06T01:37:02.054997625Z [2024-04-06 01:37:02,054: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:37:02.058368016Z [2024-04-06 01:37:02,057: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:37:02.086861598Z [2024-04-06 01:37:02,086: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:37:02.089492958Z [2024-04-06 01:37:02,089: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:37:02.089610809Z [2024-04-06 01:37:02,089: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:37:02.089766178Z [2024-04-06 01:37:02,089: INFO/ForkPoolWorker-15] Read VIM 53a217fe-e660-47b9-8c59-e1e6821a348b (k8s07_dummy) 2024-04-06T01:37:02.090027057Z [2024-04-06 01:37:02,089: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '53a217fe-e660-47b9-8c59-e1e6821a348b', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-06T01:37:02.090134942Z [2024-04-06 01:37:02,090: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:37:02.090494783Z [2024-04-06 01:37:02,090: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:37:02.090650620Z [2024-04-06 01:37:02,090: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:37:02.096238773Z [2024-04-06 01:37:02,095: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:37:02.112229349Z [2024-04-06 01:37:02,111: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T01:37:02.115618958Z [2024-04-06 01:37:02,115: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:37:02.147119901Z [2024-04-06 01:37:02,146: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T01:37:02.148707494Z [2024-04-06 01:37:02,148: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:37:02.148864424Z [2024-04-06 01:37:02,148: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:37:02.148991617Z [2024-04-06 01:37:02,148: INFO/ForkPoolWorker-1] Read VIM 53a217fe-e660-47b9-8c59-e1e6821a348b (k8s07_dummy) 2024-04-06T01:37:02.149187361Z [2024-04-06 01:37:02,148: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '53a217fe-e660-47b9-8c59-e1e6821a348b', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-06T01:37:02.149302533Z [2024-04-06 01:37:02,149: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T01:37:02.149593652Z [2024-04-06 01:37:02,149: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:37:02.149709538Z [2024-04-06 01:37:02,149: INFO/ForkPoolWorker-1] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:37:02.155772435Z [2024-04-06 01:37:02,155: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:37:02.167399526Z [2024-04-06 01:37:02,167: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:37:02.282162393Z [2024-04-06 01:37:02,281: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:37:03.852244961Z [2024-04-06 01:37:03,851: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8b83c622-8557-4bf7-99ee-e67f32ab4265] succeeded in 3.2685108080004284s: None 2024-04-06T01:37:04.146529730Z [2024-04-06 01:37:04,145: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[208c4ba8-1fc7-4328-8c08-2699fc49d447] succeeded in 3.57322268399912s: None 2024-04-06T01:38:01.181693238Z [2024-04-06 01:38:01,181: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[377310c6-04ac-479a-b90c-17701036a8e6] received 2024-04-06T01:38:01.199880197Z [2024-04-06 01:38:01,199: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[443c1ef4-26fd-47da-8c0d-be6ba519b819] received 2024-04-06T01:38:01.202574942Z [2024-04-06 01:38:01,202: INFO/ForkPoolWorker-15] [377310c6-04ac-479a-b90c-17701036a8e6] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T01:38:01.207447337Z [2024-04-06 01:38:01,207: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[60fbf14f-f83e-432b-b0db-2b64674c93ec] received 2024-04-06T01:38:01.214251020Z [2024-04-06 01:38:01,213: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3936062f-dcfa-4532-b4b2-fee62568de3e] received 2024-04-06T01:38:01.220007849Z [2024-04-06 01:38:01,219: INFO/ForkPoolWorker-16] [443c1ef4-26fd-47da-8c0d-be6ba519b819] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:38:01.224943642Z [2024-04-06 01:38:01,224: INFO/ForkPoolWorker-2] [3936062f-dcfa-4532-b4b2-fee62568de3e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T01:38:01.225771215Z [2024-04-06 01:38:01,225: INFO/ForkPoolWorker-1] [60fbf14f-f83e-432b-b0db-2b64674c93ec] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:38:01.574557588Z [2024-04-06 01:38:01,569: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T01:38:01.582188317Z [2024-04-06 01:38:01,578: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:38:01.751609035Z [2024-04-06 01:38:01,747: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:38:01.818151943Z [2024-04-06 01:38:01,814: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T01:38:01.970179646Z [2024-04-06 01:38:01,969: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:38:02.013223834Z [2024-04-06 01:38:02,012: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-06T01:38:02.017390895Z [2024-04-06 01:38:02,016: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:38:02.058826677Z [2024-04-06 01:38:02,058: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T01:38:02.060317016Z [2024-04-06 01:38:02,060: INFO/ForkPoolWorker-2] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T01:38:02.060568765Z [2024-04-06 01:38:02,060: INFO/ForkPoolWorker-2] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T01:38:02.060724737Z [2024-04-06 01:38:02,060: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-06T01:38:02.061067376Z [2024-04-06 01:38:02,060: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T01:38:02.161423757Z [2024-04-06 01:38:02,161: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:38:02.653829250Z [2024-04-06 01:38:02,653: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[377310c6-04ac-479a-b90c-17701036a8e6] succeeded in 1.4680819430013798s: None 2024-04-06T01:38:02.839829626Z [2024-04-06 01:38:02,839: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[3936062f-dcfa-4532-b4b2-fee62568de3e] succeeded in 1.6230700400010392s: None 2024-04-06T01:38:03.410427391Z [2024-04-06 01:38:03,409: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T01:38:03.414122962Z [2024-04-06 01:38:03,413: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:38:03.456793338Z [2024-04-06 01:38:03,456: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T01:38:03.459559688Z [2024-04-06 01:38:03,459: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:38:03.464057771Z [2024-04-06 01:38:03,463: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:38:03.465765500Z [2024-04-06 01:38:03,465: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:38:03.466604906Z [2024-04-06 01:38:03,465: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T01:38:03.468476800Z [2024-04-06 01:38:03,467: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:38:03.468748190Z [2024-04-06 01:38:03,468: INFO/ForkPoolWorker-1] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:38:03.485588145Z [2024-04-06 01:38:03,485: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:38:03.489316645Z [2024-04-06 01:38:03,488: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:38:03.517280684Z [2024-04-06 01:38:03,516: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:38:03.518910401Z [2024-04-06 01:38:03,518: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:38:03.518926750Z [2024-04-06 01:38:03,518: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:38:03.519078354Z [2024-04-06 01:38:03,518: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:38:03.519094678Z [2024-04-06 01:38:03,519: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:38:03.519432784Z [2024-04-06 01:38:03,519: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:38:03.519449715Z [2024-04-06 01:38:03,519: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:38:03.602317471Z [2024-04-06 01:38:03,602: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:38:03.621794582Z [2024-04-06 01:38:03,621: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:38:05.516516672Z [2024-04-06 01:38:05,515: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[60fbf14f-f83e-432b-b0db-2b64674c93ec] succeeded in 4.3040551579997555s: None 2024-04-06T01:38:06.011165477Z [2024-04-06 01:38:06,010: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[443c1ef4-26fd-47da-8c0d-be6ba519b819] succeeded in 4.807390459000089s: None 2024-04-06T01:39:01.171404346Z [2024-04-06 01:39:01,170: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ee43b59f-5436-4fdc-86d7-0fa07db4b5ae] received 2024-04-06T01:39:01.183015708Z [2024-04-06 01:39:01,182: INFO/ForkPoolWorker-15] [ee43b59f-5436-4fdc-86d7-0fa07db4b5ae] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:39:01.184610687Z [2024-04-06 01:39:01,183: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ec9e8d8e-f0a4-430a-a8d4-c42a930f5f98] received 2024-04-06T01:39:01.202825581Z [2024-04-06 01:39:01,202: INFO/ForkPoolWorker-16] [ec9e8d8e-f0a4-430a-a8d4-c42a930f5f98] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:39:01.215549630Z [2024-04-06 01:39:01,215: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[054d2fad-5951-49b5-aa74-b3461799c18a] received 2024-04-06T01:39:01.227431574Z [2024-04-06 01:39:01,227: INFO/ForkPoolWorker-1] [054d2fad-5951-49b5-aa74-b3461799c18a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T01:39:01.476931942Z [2024-04-06 01:39:01,473: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:39:01.573994096Z [2024-04-06 01:39:01,570: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:39:01.602696942Z [2024-04-06 01:39:01,598: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T01:39:01.769475575Z [2024-04-06 01:39:01,768: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-06T01:39:01.773735775Z [2024-04-06 01:39:01,773: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:39:01.812653277Z [2024-04-06 01:39:01,812: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T01:39:01.813825480Z [2024-04-06 01:39:01,813: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T01:39:01.813905365Z [2024-04-06 01:39:01,813: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T01:39:01.813958764Z [2024-04-06 01:39:01,813: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-06T01:39:01.814194903Z [2024-04-06 01:39:01,814: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T01:39:01.911799032Z [2024-04-06 01:39:01,911: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:39:02.482010733Z [2024-04-06 01:39:02,481: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[054d2fad-5951-49b5-aa74-b3461799c18a] succeeded in 1.2644814069990389s: None 2024-04-06T01:39:02.641905286Z [2024-04-06 01:39:02,641: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:39:02.645899149Z [2024-04-06 01:39:02,645: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:39:02.670154826Z [2024-04-06 01:39:02,669: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:39:02.672114065Z [2024-04-06 01:39:02,671: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:39:02.672418134Z [2024-04-06 01:39:02,672: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:39:02.672744173Z [2024-04-06 01:39:02,672: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:39:02.672949639Z [2024-04-06 01:39:02,672: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:39:02.673372671Z [2024-04-06 01:39:02,673: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:39:02.673998250Z [2024-04-06 01:39:02,673: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:39:02.736551743Z [2024-04-06 01:39:02,735: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:39:02.739800949Z [2024-04-06 01:39:02,739: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:39:02.761541878Z [2024-04-06 01:39:02,761: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:39:02.762760448Z [2024-04-06 01:39:02,762: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:39:02.762790773Z [2024-04-06 01:39:02,762: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:39:02.762929036Z [2024-04-06 01:39:02,762: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:39:02.762951676Z [2024-04-06 01:39:02,762: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:39:02.763140434Z [2024-04-06 01:39:02,762: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:39:02.763151355Z [2024-04-06 01:39:02,763: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:39:02.780900753Z [2024-04-06 01:39:02,780: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:39:02.854782812Z [2024-04-06 01:39:02,854: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:39:04.499180785Z [2024-04-06 01:39:04,498: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ec9e8d8e-f0a4-430a-a8d4-c42a930f5f98] succeeded in 3.3078499879993615s: None 2024-04-06T01:39:05.158617924Z [2024-04-06 01:39:05,158: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ee43b59f-5436-4fdc-86d7-0fa07db4b5ae] succeeded in 3.985071858000083s: None 2024-04-06T01:40:01.163292607Z [2024-04-06 01:40:01,162: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[70e7ea67-1698-4884-9dc8-62a03152d55b] received 2024-04-06T01:40:01.165534834Z [2024-04-06 01:40:01,165: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d6c86e08-3629-4207-bec7-24c6042a06d6] received 2024-04-06T01:40:01.174885508Z [2024-04-06 01:40:01,174: INFO/ForkPoolWorker-15] [70e7ea67-1698-4884-9dc8-62a03152d55b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T01:40:01.176866577Z [2024-04-06 01:40:01,176: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[04b6f074-5752-47b4-94e4-0b968e614a7e] received 2024-04-06T01:40:01.180329279Z [2024-04-06 01:40:01,180: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5a4fa371-361e-4035-ae8f-bad3e33efd69] received 2024-04-06T01:40:01.184952471Z [2024-04-06 01:40:01,184: INFO/ForkPoolWorker-16] [d6c86e08-3629-4207-bec7-24c6042a06d6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:40:01.198838995Z [2024-04-06 01:40:01,198: INFO/ForkPoolWorker-1] [04b6f074-5752-47b4-94e4-0b968e614a7e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T01:40:01.211776377Z [2024-04-06 01:40:01,211: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7cb611fc-845e-4a22-aa74-9559a9c1a428] received 2024-04-06T01:40:01.226049503Z [2024-04-06 01:40:01,225: INFO/ForkPoolWorker-2] [5a4fa371-361e-4035-ae8f-bad3e33efd69] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:40:01.227189686Z [2024-04-06 01:40:01,226: INFO/ForkPoolWorker-3] [7cb611fc-845e-4a22-aa74-9559a9c1a428] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T01:40:01.538899722Z [2024-04-06 01:40:01,535: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T01:40:01.543201369Z [2024-04-06 01:40:01,540: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:40:01.589086022Z [2024-04-06 01:40:01,584: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T01:40:01.689885900Z [2024-04-06 01:40:01,686: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T01:40:01.810911599Z [2024-04-06 01:40:01,807: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:40:01.862783796Z [2024-04-06 01:40:01,862: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:40:01.873790685Z [2024-04-06 01:40:01,873: INFO/ForkPoolWorker-3] Getting SDNC list 2024-04-06T01:40:01.896473581Z [2024-04-06 01:40:01,895: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:40:01.968124340Z [2024-04-06 01:40:01,967: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-06T01:40:01.972125616Z [2024-04-06 01:40:01,971: INFO/ForkPoolWorker-3] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T01:40:01.972715766Z [2024-04-06 01:40:01,972: INFO/ForkPoolWorker-3] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T01:40:01.972985029Z [2024-04-06 01:40:01,972: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-04-06T01:40:01.973312161Z [2024-04-06 01:40:01,973: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T01:40:02.160448818Z [2024-04-06 01:40:02,160: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:40:02.699175953Z [2024-04-06 01:40:02,697: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[04b6f074-5752-47b4-94e4-0b968e614a7e] succeeded in 1.518850131000363s: None 2024-04-06T01:40:02.901217946Z [2024-04-06 01:40:02,900: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[7cb611fc-845e-4a22-aa74-9559a9c1a428] succeeded in 1.685682782001095s: None 2024-04-06T01:40:02.998844803Z [2024-04-06 01:40:02,998: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:40:03.002210453Z [2024-04-06 01:40:03,001: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:40:03.023115796Z [2024-04-06 01:40:03,022: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:40:03.024683095Z [2024-04-06 01:40:03,024: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:40:03.024806482Z [2024-04-06 01:40:03,024: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:40:03.024981778Z [2024-04-06 01:40:03,024: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:40:03.025069830Z [2024-04-06 01:40:03,024: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:40:03.025320309Z [2024-04-06 01:40:03,025: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T01:40:03.025430684Z [2024-04-06 01:40:03,025: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:40:03.102457324Z [2024-04-06 01:40:03,102: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:40:03.205559324Z [2024-04-06 01:40:03,205: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-06T01:40:03.208890297Z [2024-04-06 01:40:03,208: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:40:03.244129986Z [2024-04-06 01:40:03,243: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T01:40:03.252477895Z [2024-04-06 01:40:03,252: INFO/ForkPoolWorker-2] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:40:03.252500741Z [2024-04-06 01:40:03,252: INFO/ForkPoolWorker-2] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:40:03.252665369Z [2024-04-06 01:40:03,252: INFO/ForkPoolWorker-2] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:40:03.252744016Z [2024-04-06 01:40:03,252: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-06T01:40:03.253017407Z [2024-04-06 01:40:03,252: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:40:03.253052425Z [2024-04-06 01:40:03,252: INFO/ForkPoolWorker-2] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:40:03.311647938Z [2024-04-06 01:40:03,311: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:40:03.315192351Z [2024-04-06 01:40:03,314: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:40:03.341086197Z [2024-04-06 01:40:03,340: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:40:03.341563299Z [2024-04-06 01:40:03,341: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:40:03.342791855Z [2024-04-06 01:40:03,342: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:40:03.342905142Z [2024-04-06 01:40:03,342: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:40:03.343073376Z [2024-04-06 01:40:03,342: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:40:03.343176596Z [2024-04-06 01:40:03,343: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:40:03.343587778Z [2024-04-06 01:40:03,343: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:40:03.343717615Z [2024-04-06 01:40:03,343: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:40:03.427727442Z [2024-04-06 01:40:03,427: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:40:03.776869847Z [2024-04-06 01:40:03,770: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[70e7ea67-1698-4884-9dc8-62a03152d55b] succeeded in 2.60499457700098s: None 2024-04-06T01:40:03.896010258Z [2024-04-06 01:40:03,895: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0271d6b1-dd06-47a0-8953-7383c31cdfa7] received 2024-04-06T01:40:03.904089177Z [2024-04-06 01:40:03,903: INFO/ForkPoolWorker-15] [0271d6b1-dd06-47a0-8953-7383c31cdfa7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'split_metrics', 'scheduled__2024-04-06T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T01:40:04.208405903Z [2024-04-06 01:40:04,205: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T01:40:05.099105923Z [2024-04-06 01:40:05,098: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[5a4fa371-361e-4035-ae8f-bad3e33efd69] succeeded in 3.8892691649998596s: None 2024-04-06T01:40:05.378719492Z [2024-04-06 01:40:05,378: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:40:05.383745637Z [2024-04-06 01:40:05,383: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:40:05.402105558Z [2024-04-06 01:40:05,401: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:40:05.403579541Z [2024-04-06 01:40:05,403: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:40:05.403628564Z [2024-04-06 01:40:05,403: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:40:05.403741789Z [2024-04-06 01:40:05,403: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:40:05.403763122Z [2024-04-06 01:40:05,403: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:40:05.404203695Z [2024-04-06 01:40:05,403: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T01:40:05.404216704Z [2024-04-06 01:40:05,403: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:40:05.431934030Z [2024-04-06 01:40:05,431: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d6c86e08-3629-4207-bec7-24c6042a06d6] succeeded in 4.263328573999388s: None 2024-04-06T01:40:05.557717989Z [2024-04-06 01:40:05,557: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:40:06.215811165Z [2024-04-06 01:40:06,215: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0271d6b1-dd06-47a0-8953-7383c31cdfa7] succeeded in 2.317296511000677s: None 2024-04-06T01:40:07.269689809Z [2024-04-06 01:40:07,269: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[556dce7f-91b6-43e3-b860-d60417c857a1] received 2024-04-06T01:40:07.279529956Z [2024-04-06 01:40:07,278: INFO/ForkPoolWorker-15] [556dce7f-91b6-43e3-b860-d60417c857a1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'collect_metrics', 'scheduled__2024-04-06T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T01:40:07.580456332Z [2024-04-06 01:40:07,577: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T01:40:08.808268316Z [2024-04-06 01:40:08,807: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:40:08.812275048Z [2024-04-06 01:40:08,811: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:40:08.835611246Z [2024-04-06 01:40:08,835: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:40:08.837340129Z [2024-04-06 01:40:08,837: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:40:08.837585729Z [2024-04-06 01:40:08,837: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:40:08.837815033Z [2024-04-06 01:40:08,837: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:40:08.838043770Z [2024-04-06 01:40:08,837: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:40:08.838407948Z [2024-04-06 01:40:08,838: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T01:40:08.838599802Z [2024-04-06 01:40:08,838: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:40:08.925555483Z [2024-04-06 01:40:08,925: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:40:09.545682911Z [2024-04-06 01:40:09,545: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[556dce7f-91b6-43e3-b860-d60417c857a1] succeeded in 2.273670378999668s: None 2024-04-06T01:40:09.585280943Z [2024-04-06 01:40:09,584: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[48c4bee9-cd15-4750-98c1-6e8fc57123ae] received 2024-04-06T01:40:09.594724177Z [2024-04-06 01:40:09,594: INFO/ForkPoolWorker-15] [48c4bee9-cd15-4750-98c1-6e8fc57123ae] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'send_prometheus', 'scheduled__2024-04-06T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T01:40:09.917617967Z [2024-04-06 01:40:09,914: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T01:40:11.085600338Z [2024-04-06 01:40:11,085: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:40:11.088862042Z [2024-04-06 01:40:11,088: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:40:11.116358228Z [2024-04-06 01:40:11,116: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:40:11.117890164Z [2024-04-06 01:40:11,117: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:40:11.118042316Z [2024-04-06 01:40:11,117: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:40:11.118240960Z [2024-04-06 01:40:11,118: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:40:11.118364106Z [2024-04-06 01:40:11,118: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:40:11.118678788Z [2024-04-06 01:40:11,118: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T01:40:11.118909580Z [2024-04-06 01:40:11,118: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:40:11.203136530Z [2024-04-06 01:40:11,202: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:40:11.867804152Z [2024-04-06 01:40:11,867: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[48c4bee9-cd15-4750-98c1-6e8fc57123ae] succeeded in 2.2811005919993477s: None 2024-04-06T01:41:01.051417420Z [2024-04-06 01:41:01,051: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[520a0783-493d-4a1b-853a-3ca00f080834] received 2024-04-06T01:41:01.054500698Z [2024-04-06 01:41:01,054: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[96420f5c-97eb-4f42-b987-637a15a23ac6] received 2024-04-06T01:41:01.061642147Z [2024-04-06 01:41:01,061: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cf3332e5-1ed5-4dd3-872d-ca307bbbece4] received 2024-04-06T01:41:01.070298126Z [2024-04-06 01:41:01,069: INFO/ForkPoolWorker-15] [520a0783-493d-4a1b-853a-3ca00f080834] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:41:01.075881588Z [2024-04-06 01:41:01,075: INFO/ForkPoolWorker-1] [cf3332e5-1ed5-4dd3-872d-ca307bbbece4] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T01:41:01.084915225Z [2024-04-06 01:41:01,084: INFO/ForkPoolWorker-16] [96420f5c-97eb-4f42-b987-637a15a23ac6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:41:01.409121841Z [2024-04-06 01:41:01,405: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:41:01.446569524Z [2024-04-06 01:41:01,432: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:41:01.496426127Z [2024-04-06 01:41:01,492: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T01:41:01.650930647Z [2024-04-06 01:41:01,650: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-06T01:41:01.655164141Z [2024-04-06 01:41:01,654: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:41:01.684241395Z [2024-04-06 01:41:01,683: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T01:41:01.685403001Z [2024-04-06 01:41:01,685: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T01:41:01.685581762Z [2024-04-06 01:41:01,685: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T01:41:01.685639046Z [2024-04-06 01:41:01,685: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-06T01:41:01.686156640Z [2024-04-06 01:41:01,686: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T01:41:01.771649248Z [2024-04-06 01:41:01,771: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:41:02.357069461Z [2024-04-06 01:41:02,356: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[cf3332e5-1ed5-4dd3-872d-ca307bbbece4] succeeded in 1.293561734000832s: None 2024-04-06T01:41:02.674594500Z [2024-04-06 01:41:02,674: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:41:02.677061285Z [2024-04-06 01:41:02,676: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:41:02.678110201Z [2024-04-06 01:41:02,677: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:41:02.680635774Z [2024-04-06 01:41:02,680: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:41:02.699761016Z [2024-04-06 01:41:02,699: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:41:02.702057124Z [2024-04-06 01:41:02,701: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:41:02.702181500Z [2024-04-06 01:41:02,701: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:41:02.702363861Z [2024-04-06 01:41:02,702: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:41:02.702463133Z [2024-04-06 01:41:02,702: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:41:02.702772318Z [2024-04-06 01:41:02,702: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:41:02.702957543Z [2024-04-06 01:41:02,702: INFO/ForkPoolWorker-15] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:41:02.706625005Z [2024-04-06 01:41:02,706: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:41:02.708146590Z [2024-04-06 01:41:02,707: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:41:02.708160832Z [2024-04-06 01:41:02,708: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:41:02.708518796Z [2024-04-06 01:41:02,708: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:41:02.708531517Z [2024-04-06 01:41:02,708: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:41:02.708798667Z [2024-04-06 01:41:02,708: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:41:02.708827567Z [2024-04-06 01:41:02,708: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:41:02.796625599Z [2024-04-06 01:41:02,796: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:41:02.801679211Z [2024-04-06 01:41:02,801: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:41:04.557577958Z [2024-04-06 01:41:04,557: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[520a0783-493d-4a1b-853a-3ca00f080834] succeeded in 3.497916805999921s: None 2024-04-06T01:41:05.253357497Z [2024-04-06 01:41:05,252: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[96420f5c-97eb-4f42-b987-637a15a23ac6] succeeded in 4.1944534509984805s: None 2024-04-06T01:42:00.547037272Z [2024-04-06 01:42:00,546: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9dbff7f6-862b-4514-80dc-c174e1517293] received 2024-04-06T01:42:00.549148698Z [2024-04-06 01:42:00,548: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4c6d513f-bb0b-49c8-8289-69dd5938971a] received 2024-04-06T01:42:00.551243978Z [2024-04-06 01:42:00,551: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3c2d9b87-d1c6-499b-9131-fb0e4e7cb362] received 2024-04-06T01:42:00.553395492Z [2024-04-06 01:42:00,553: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dda4ffaf-56bc-4a38-af97-4a5637ede9c1] received 2024-04-06T01:42:00.569234794Z [2024-04-06 01:42:00,568: INFO/ForkPoolWorker-1] [3c2d9b87-d1c6-499b-9131-fb0e4e7cb362] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:42:00.571445501Z [2024-04-06 01:42:00,571: INFO/ForkPoolWorker-2] [dda4ffaf-56bc-4a38-af97-4a5637ede9c1] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T01:42:00.572252523Z [2024-04-06 01:42:00,571: INFO/ForkPoolWorker-15] [9dbff7f6-862b-4514-80dc-c174e1517293] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T01:42:00.576070963Z [2024-04-06 01:42:00,575: INFO/ForkPoolWorker-16] [4c6d513f-bb0b-49c8-8289-69dd5938971a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:42:00.953431049Z [2024-04-06 01:42:00,950: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:42:01.176628506Z [2024-04-06 01:42:01,173: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T01:42:01.184818491Z [2024-04-06 01:42:01,180: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T01:42:01.318415547Z [2024-04-06 01:42:01,310: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:42:01.481574399Z [2024-04-06 01:42:01,481: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:42:01.498067544Z [2024-04-06 01:42:01,497: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-06T01:42:01.501941693Z [2024-04-06 01:42:01,501: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:42:01.539312471Z [2024-04-06 01:42:01,539: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T01:42:01.544297315Z [2024-04-06 01:42:01,543: INFO/ForkPoolWorker-2] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T01:42:01.544419137Z [2024-04-06 01:42:01,544: INFO/ForkPoolWorker-2] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T01:42:01.544535590Z [2024-04-06 01:42:01,544: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-06T01:42:01.544838498Z [2024-04-06 01:42:01,544: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T01:42:01.655092582Z [2024-04-06 01:42:01,654: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:42:02.187897331Z [2024-04-06 01:42:02,187: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9dbff7f6-862b-4514-80dc-c174e1517293] succeeded in 1.6374797129992658s: None 2024-04-06T01:42:02.418309521Z [2024-04-06 01:42:02,417: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[dda4ffaf-56bc-4a38-af97-4a5637ede9c1] succeeded in 1.8614265060004982s: None 2024-04-06T01:42:02.497105329Z [2024-04-06 01:42:02,496: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T01:42:02.500506070Z [2024-04-06 01:42:02,499: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:42:02.522637987Z [2024-04-06 01:42:02,522: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T01:42:02.524040146Z [2024-04-06 01:42:02,523: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:42:02.524055592Z [2024-04-06 01:42:02,523: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:42:02.524215852Z [2024-04-06 01:42:02,524: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:42:02.524236083Z [2024-04-06 01:42:02,524: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T01:42:02.524510243Z [2024-04-06 01:42:02,524: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:42:02.524539097Z [2024-04-06 01:42:02,524: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:42:02.626283635Z [2024-04-06 01:42:02,625: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:42:02.758191759Z [2024-04-06 01:42:02,757: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:42:02.763383411Z [2024-04-06 01:42:02,762: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:42:02.793042151Z [2024-04-06 01:42:02,792: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:42:02.795571643Z [2024-04-06 01:42:02,795: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:42:02.795607746Z [2024-04-06 01:42:02,795: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:42:02.795823851Z [2024-04-06 01:42:02,795: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:42:02.795856495Z [2024-04-06 01:42:02,795: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:42:02.796406620Z [2024-04-06 01:42:02,796: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:42:02.796735838Z [2024-04-06 01:42:02,796: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:42:02.915917485Z [2024-04-06 01:42:02,915: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:42:04.644134074Z [2024-04-06 01:42:04,643: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4c6d513f-bb0b-49c8-8289-69dd5938971a] succeeded in 4.093194864000907s: None 2024-04-06T01:42:04.652374255Z [2024-04-06 01:42:04,651: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3c2d9b87-d1c6-499b-9131-fb0e4e7cb362] succeeded in 4.098437698001362s: None 2024-04-06T01:43:00.364515773Z [2024-04-06 01:43:00,364: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[016e0de8-fdeb-4b3d-bf6d-61bf94fcde93] received 2024-04-06T01:43:00.371796718Z [2024-04-06 01:43:00,371: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e7c317e8-e0d9-434a-97fe-edae93ac585c] received 2024-04-06T01:43:00.373654692Z [2024-04-06 01:43:00,373: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1645d1b3-ac90-45f0-bfbc-49c6833ffa6f] received 2024-04-06T01:43:00.376899201Z [2024-04-06 01:43:00,376: INFO/ForkPoolWorker-15] [016e0de8-fdeb-4b3d-bf6d-61bf94fcde93] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:43:00.386222404Z [2024-04-06 01:43:00,385: INFO/ForkPoolWorker-1] [1645d1b3-ac90-45f0-bfbc-49c6833ffa6f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T01:43:00.387127698Z [2024-04-06 01:43:00,386: INFO/ForkPoolWorker-16] [e7c317e8-e0d9-434a-97fe-edae93ac585c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:43:00.649955891Z [2024-04-06 01:43:00,646: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:43:00.679599288Z [2024-04-06 01:43:00,676: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T01:43:00.700624287Z [2024-04-06 01:43:00,697: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:43:00.844336177Z [2024-04-06 01:43:00,843: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-06T01:43:00.848383852Z [2024-04-06 01:43:00,847: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:43:00.873294945Z [2024-04-06 01:43:00,873: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T01:43:00.874311303Z [2024-04-06 01:43:00,874: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T01:43:00.874630519Z [2024-04-06 01:43:00,874: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T01:43:00.874981094Z [2024-04-06 01:43:00,874: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-06T01:43:00.875393545Z [2024-04-06 01:43:00,875: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T01:43:00.963512659Z [2024-04-06 01:43:00,963: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:43:01.512229389Z [2024-04-06 01:43:01,511: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1645d1b3-ac90-45f0-bfbc-49c6833ffa6f] succeeded in 1.1355543860008765s: None 2024-04-06T01:43:01.815404189Z [2024-04-06 01:43:01,815: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:43:01.818891414Z [2024-04-06 01:43:01,818: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:43:01.838081395Z [2024-04-06 01:43:01,837: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:43:01.839452425Z [2024-04-06 01:43:01,839: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:43:01.839572846Z [2024-04-06 01:43:01,839: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:43:01.839804810Z [2024-04-06 01:43:01,839: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:43:01.839928712Z [2024-04-06 01:43:01,839: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:43:01.840316987Z [2024-04-06 01:43:01,840: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:43:01.840499463Z [2024-04-06 01:43:01,840: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:43:01.853300776Z [2024-04-06 01:43:01,852: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:43:01.856606357Z [2024-04-06 01:43:01,855: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:43:01.880265023Z [2024-04-06 01:43:01,880: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:43:01.881868100Z [2024-04-06 01:43:01,881: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:43:01.882081190Z [2024-04-06 01:43:01,881: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:43:01.882352498Z [2024-04-06 01:43:01,882: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:43:01.882446699Z [2024-04-06 01:43:01,882: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:43:01.882737636Z [2024-04-06 01:43:01,882: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:43:01.882777721Z [2024-04-06 01:43:01,882: INFO/ForkPoolWorker-15] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:43:01.918902265Z [2024-04-06 01:43:01,918: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:43:01.981286153Z [2024-04-06 01:43:01,980: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:43:03.455381709Z [2024-04-06 01:43:03,454: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[016e0de8-fdeb-4b3d-bf6d-61bf94fcde93] succeeded in 3.087854478999361s: None 2024-04-06T01:43:03.847871686Z [2024-04-06 01:43:03,847: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e7c317e8-e0d9-434a-97fe-edae93ac585c] succeeded in 3.4735060619987053s: None 2024-04-06T01:44:00.422979098Z [2024-04-06 01:44:00,422: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9bd81d81-5774-4c4c-ad06-051943fe8a34] received 2024-04-06T01:44:00.426246971Z [2024-04-06 01:44:00,425: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[85d24c58-0390-4c60-8f7e-f872b3bd5263] received 2024-04-06T01:44:00.429870120Z [2024-04-06 01:44:00,429: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[015ca308-413a-4ba7-96c6-6a2b2ac5756c] received 2024-04-06T01:44:00.435892694Z [2024-04-06 01:44:00,435: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b67a297e-63d0-40e1-bf4c-0d38272d2e7d] received 2024-04-06T01:44:00.438354464Z [2024-04-06 01:44:00,437: INFO/ForkPoolWorker-15] [9bd81d81-5774-4c4c-ad06-051943fe8a34] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:44:00.442317544Z [2024-04-06 01:44:00,442: INFO/ForkPoolWorker-1] [015ca308-413a-4ba7-96c6-6a2b2ac5756c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T01:44:00.452082984Z [2024-04-06 01:44:00,451: INFO/ForkPoolWorker-16] [85d24c58-0390-4c60-8f7e-f872b3bd5263] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T01:44:00.452811756Z [2024-04-06 01:44:00,452: INFO/ForkPoolWorker-2] [b67a297e-63d0-40e1-bf4c-0d38272d2e7d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:44:00.708184198Z [2024-04-06 01:44:00,704: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:44:00.828195573Z [2024-04-06 01:44:00,825: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T01:44:00.853386104Z [2024-04-06 01:44:00,850: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:44:00.862163390Z [2024-04-06 01:44:00,857: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T01:44:01.078235594Z [2024-04-06 01:44:01,077: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-06T01:44:01.083123615Z [2024-04-06 01:44:01,082: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:44:01.131654518Z [2024-04-06 01:44:01,131: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T01:44:01.134632055Z [2024-04-06 01:44:01,132: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T01:44:01.134655116Z [2024-04-06 01:44:01,133: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T01:44:01.134659553Z [2024-04-06 01:44:01,133: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-06T01:44:01.134662777Z [2024-04-06 01:44:01,133: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T01:44:01.153248849Z [2024-04-06 01:44:01,152: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:44:01.312765443Z [2024-04-06 01:44:01,312: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:44:01.844994326Z [2024-04-06 01:44:01,844: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[85d24c58-0390-4c60-8f7e-f872b3bd5263] succeeded in 1.415013480998823s: None 2024-04-06T01:44:01.985151037Z [2024-04-06 01:44:01,984: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[015ca308-413a-4ba7-96c6-6a2b2ac5756c] succeeded in 1.5523057619993779s: None 2024-04-06T01:44:02.118080878Z [2024-04-06 01:44:02,117: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:44:02.121437374Z [2024-04-06 01:44:02,120: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:44:02.143002425Z [2024-04-06 01:44:02,142: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:44:02.144779411Z [2024-04-06 01:44:02,144: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:44:02.144978205Z [2024-04-06 01:44:02,144: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:44:02.145093604Z [2024-04-06 01:44:02,144: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:44:02.145131741Z [2024-04-06 01:44:02,145: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:44:02.145350976Z [2024-04-06 01:44:02,145: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:44:02.145387532Z [2024-04-06 01:44:02,145: INFO/ForkPoolWorker-15] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:44:02.259874094Z [2024-04-06 01:44:02,259: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:44:02.287615714Z [2024-04-06 01:44:02,287: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-06T01:44:02.290795932Z [2024-04-06 01:44:02,290: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:44:02.307579293Z [2024-04-06 01:44:02,307: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T01:44:02.308616492Z [2024-04-06 01:44:02,308: INFO/ForkPoolWorker-2] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:44:02.308652557Z [2024-04-06 01:44:02,308: INFO/ForkPoolWorker-2] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:44:02.308799688Z [2024-04-06 01:44:02,308: INFO/ForkPoolWorker-2] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:44:02.308811288Z [2024-04-06 01:44:02,308: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-06T01:44:02.309038262Z [2024-04-06 01:44:02,308: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:44:02.309047203Z [2024-04-06 01:44:02,308: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:44:02.381451857Z [2024-04-06 01:44:02,381: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:44:03.793824133Z [2024-04-06 01:44:03,793: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9bd81d81-5774-4c4c-ad06-051943fe8a34] succeeded in 3.3652772730001743s: None 2024-04-06T01:44:04.133215918Z [2024-04-06 01:44:04,132: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b67a297e-63d0-40e1-bf4c-0d38272d2e7d] succeeded in 3.692853002999982s: None 2024-04-06T01:45:00.383186669Z [2024-04-06 01:45:00,382: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[767647f1-6ef7-4d12-9f07-a9cf4023e2dd] received 2024-04-06T01:45:00.388848910Z [2024-04-06 01:45:00,388: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a5a9009b-50c1-4670-b5ab-bd1c66c9f36d] received 2024-04-06T01:45:00.394029243Z [2024-04-06 01:45:00,393: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[68846479-1ecb-43ec-800e-bd6c6cf8ef73] received 2024-04-06T01:45:00.399333392Z [2024-04-06 01:45:00,399: INFO/ForkPoolWorker-16] [a5a9009b-50c1-4670-b5ab-bd1c66c9f36d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:45:00.407698584Z [2024-04-06 01:45:00,407: INFO/ForkPoolWorker-1] [68846479-1ecb-43ec-800e-bd6c6cf8ef73] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:45:00.408787255Z [2024-04-06 01:45:00,408: INFO/ForkPoolWorker-15] [767647f1-6ef7-4d12-9f07-a9cf4023e2dd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T01:45:00.413387647Z [2024-04-06 01:45:00,413: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9559a05f-27df-43fc-8f39-5797bedc4450] received 2024-04-06T01:45:00.428173991Z [2024-04-06 01:45:00,427: INFO/ForkPoolWorker-2] [9559a05f-27df-43fc-8f39-5797bedc4450] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T01:45:00.737333173Z [2024-04-06 01:45:00,725: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:45:00.838222687Z [2024-04-06 01:45:00,834: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T01:45:00.862943355Z [2024-04-06 01:45:00,841: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T01:45:01.046916726Z [2024-04-06 01:45:01,046: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-06T01:45:01.051143571Z [2024-04-06 01:45:01,050: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:45:01.092727535Z [2024-04-06 01:45:01,092: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T01:45:01.095416261Z [2024-04-06 01:45:01,095: INFO/ForkPoolWorker-2] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T01:45:01.095755141Z [2024-04-06 01:45:01,095: INFO/ForkPoolWorker-2] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T01:45:01.095877403Z [2024-04-06 01:45:01,095: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-06T01:45:01.096209522Z [2024-04-06 01:45:01,096: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T01:45:01.396859248Z [2024-04-06 01:45:01,388: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:45:01.544139525Z [2024-04-06 01:45:01,543: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:45:02.029933375Z [2024-04-06 01:45:02,029: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:45:02.033998844Z [2024-04-06 01:45:02,033: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:45:02.063572229Z [2024-04-06 01:45:02,063: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:45:02.065184964Z [2024-04-06 01:45:02,064: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:45:02.065208588Z [2024-04-06 01:45:02,065: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:45:02.065382591Z [2024-04-06 01:45:02,065: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:45:02.065400518Z [2024-04-06 01:45:02,065: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:45:02.065622041Z [2024-04-06 01:45:02,065: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:45:02.065637341Z [2024-04-06 01:45:02,065: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:45:02.295417943Z [2024-04-06 01:45:02,295: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:45:02.705450455Z [2024-04-06 01:45:02,705: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:45:02.711634088Z [2024-04-06 01:45:02,711: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[9559a05f-27df-43fc-8f39-5797bedc4450] succeeded in 2.2962444289987616s: None 2024-04-06T01:45:02.712568153Z [2024-04-06 01:45:02,712: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:45:02.750083554Z [2024-04-06 01:45:02,747: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:45:02.756125635Z [2024-04-06 01:45:02,755: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:45:02.756359447Z [2024-04-06 01:45:02,756: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:45:02.757214275Z [2024-04-06 01:45:02,756: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:45:02.757399527Z [2024-04-06 01:45:02,757: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:45:02.757751806Z [2024-04-06 01:45:02,757: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T01:45:02.757979484Z [2024-04-06 01:45:02,757: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:45:02.853515477Z [2024-04-06 01:45:02,853: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:45:03.319512002Z [2024-04-06 01:45:03,319: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T01:45:03.322775942Z [2024-04-06 01:45:03,322: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:45:03.348227412Z [2024-04-06 01:45:03,347: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T01:45:03.351592909Z [2024-04-06 01:45:03,351: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:45:03.351689474Z [2024-04-06 01:45:03,351: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:45:03.351880601Z [2024-04-06 01:45:03,351: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:45:03.351964770Z [2024-04-06 01:45:03,351: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T01:45:03.352340352Z [2024-04-06 01:45:03,352: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:45:03.352413628Z [2024-04-06 01:45:03,352: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:45:03.445890559Z [2024-04-06 01:45:03,445: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:45:03.461051715Z [2024-04-06 01:45:03,460: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0a7f04db-f9fd-4776-a84b-8843c0074080] received 2024-04-06T01:45:03.467210280Z [2024-04-06 01:45:03,466: INFO/ForkPoolWorker-2] [0a7f04db-f9fd-4776-a84b-8843c0074080] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'split_metrics', 'scheduled__2024-04-06T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T01:45:03.538584383Z [2024-04-06 01:45:03,538: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[767647f1-6ef7-4d12-9f07-a9cf4023e2dd] succeeded in 3.149649001999933s: None 2024-04-06T01:45:03.866704851Z [2024-04-06 01:45:03,863: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T01:45:04.025173394Z [2024-04-06 01:45:04,024: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a5a9009b-50c1-4670-b5ab-bd1c66c9f36d] succeeded in 3.6344537750010204s: None 2024-04-06T01:45:05.131558532Z [2024-04-06 01:45:05,131: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-06T01:45:05.134738783Z [2024-04-06 01:45:05,134: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:45:05.159942914Z [2024-04-06 01:45:05,159: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T01:45:05.161258059Z [2024-04-06 01:45:05,160: INFO/ForkPoolWorker-2] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:45:05.161376150Z [2024-04-06 01:45:05,161: INFO/ForkPoolWorker-2] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:45:05.161564302Z [2024-04-06 01:45:05,161: INFO/ForkPoolWorker-2] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:45:05.161645260Z [2024-04-06 01:45:05,161: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-06T01:45:05.161963637Z [2024-04-06 01:45:05,161: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T01:45:05.162068474Z [2024-04-06 01:45:05,161: INFO/ForkPoolWorker-2] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:45:05.264278702Z [2024-04-06 01:45:05,263: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:45:05.966843815Z [2024-04-06 01:45:05,966: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[0a7f04db-f9fd-4776-a84b-8843c0074080] succeeded in 2.5043438590000733s: None 2024-04-06T01:45:06.078152594Z [2024-04-06 01:45:06,077: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[55d9b962-2776-426c-8c4d-ae4d9408034d] received 2024-04-06T01:45:06.084254958Z [2024-04-06 01:45:06,084: INFO/ForkPoolWorker-15] [55d9b962-2776-426c-8c4d-ae4d9408034d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'collect_metrics', 'scheduled__2024-04-06T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T01:45:06.136408396Z [2024-04-06 01:45:06,136: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[68846479-1ecb-43ec-800e-bd6c6cf8ef73] succeeded in 5.740549431000545s: None 2024-04-06T01:45:06.386632094Z [2024-04-06 01:45:06,383: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T01:45:07.663953530Z [2024-04-06 01:45:07,663: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:45:07.667420177Z [2024-04-06 01:45:07,666: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:45:07.691635477Z [2024-04-06 01:45:07,691: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:45:07.692770966Z [2024-04-06 01:45:07,692: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:45:07.692819366Z [2024-04-06 01:45:07,692: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:45:07.693019476Z [2024-04-06 01:45:07,692: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:45:07.693061884Z [2024-04-06 01:45:07,692: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:45:07.693317733Z [2024-04-06 01:45:07,693: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T01:45:07.693358135Z [2024-04-06 01:45:07,693: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:45:07.766278519Z [2024-04-06 01:45:07,765: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:45:08.285764923Z [2024-04-06 01:45:08,285: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[55d9b962-2776-426c-8c4d-ae4d9408034d] succeeded in 2.2057429630003753s: None 2024-04-06T01:45:08.432684598Z [2024-04-06 01:45:08,430: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[058388a9-7f2a-4827-8aba-a08a1d3219d2] received 2024-04-06T01:45:08.453787245Z [2024-04-06 01:45:08,446: INFO/ForkPoolWorker-15] [058388a9-7f2a-4827-8aba-a08a1d3219d2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'send_prometheus', 'scheduled__2024-04-06T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T01:45:08.769276582Z [2024-04-06 01:45:08,766: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T01:45:09.832000979Z [2024-04-06 01:45:09,831: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:45:09.835293402Z [2024-04-06 01:45:09,834: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:45:09.853026916Z [2024-04-06 01:45:09,852: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:45:09.854215793Z [2024-04-06 01:45:09,854: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:45:09.854316616Z [2024-04-06 01:45:09,854: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:45:09.854488043Z [2024-04-06 01:45:09,854: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:45:09.854550974Z [2024-04-06 01:45:09,854: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:45:09.854848319Z [2024-04-06 01:45:09,854: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T01:45:09.854970654Z [2024-04-06 01:45:09,854: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:45:09.965176145Z [2024-04-06 01:45:09,964: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:45:10.718745349Z [2024-04-06 01:45:10,717: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[058388a9-7f2a-4827-8aba-a08a1d3219d2] succeeded in 2.2858523260001675s: None 2024-04-06T01:46:00.393165523Z [2024-04-06 01:46:00,392: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[850d134e-90a1-4b88-b82d-f27cf3c65d13] received 2024-04-06T01:46:00.396798630Z [2024-04-06 01:46:00,396: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[32cf8755-744c-49da-9c04-9522a554ef61] received 2024-04-06T01:46:00.398789284Z [2024-04-06 01:46:00,398: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9d664a34-5fcb-4512-8979-de80dd098da7] received 2024-04-06T01:46:00.402398576Z [2024-04-06 01:46:00,402: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[13b51d62-2192-4ef0-b2fd-9182f7be807b] received 2024-04-06T01:46:00.414499477Z [2024-04-06 01:46:00,414: INFO/ForkPoolWorker-15] [850d134e-90a1-4b88-b82d-f27cf3c65d13] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T01:46:00.421573190Z [2024-04-06 01:46:00,420: INFO/ForkPoolWorker-16] [32cf8755-744c-49da-9c04-9522a554ef61] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:46:00.426343862Z [2024-04-06 01:46:00,425: INFO/ForkPoolWorker-2] [13b51d62-2192-4ef0-b2fd-9182f7be807b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T01:46:00.434855972Z [2024-04-06 01:46:00,434: INFO/ForkPoolWorker-1] [9d664a34-5fcb-4512-8979-de80dd098da7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:46:00.716224521Z [2024-04-06 01:46:00,710: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T01:46:00.759432611Z [2024-04-06 01:46:00,755: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T01:46:00.769441859Z [2024-04-06 01:46:00,766: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:46:00.871759790Z [2024-04-06 01:46:00,865: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:46:00.949117468Z [2024-04-06 01:46:00,948: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-06T01:46:00.953837036Z [2024-04-06 01:46:00,953: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:46:00.981802593Z [2024-04-06 01:46:00,981: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T01:46:00.983114671Z [2024-04-06 01:46:00,982: INFO/ForkPoolWorker-2] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T01:46:00.983480359Z [2024-04-06 01:46:00,983: INFO/ForkPoolWorker-2] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T01:46:00.983873025Z [2024-04-06 01:46:00,983: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-06T01:46:00.984504005Z [2024-04-06 01:46:00,984: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T01:46:01.004691755Z [2024-04-06 01:46:01,004: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:46:01.113241599Z [2024-04-06 01:46:01,112: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:46:01.717990885Z [2024-04-06 01:46:01,717: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[850d134e-90a1-4b88-b82d-f27cf3c65d13] succeeded in 1.321940824000194s: None 2024-04-06T01:46:01.997514947Z [2024-04-06 01:46:01,997: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[13b51d62-2192-4ef0-b2fd-9182f7be807b] succeeded in 1.5867401300001802s: None 2024-04-06T01:46:02.465306120Z [2024-04-06 01:46:02,464: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:46:02.469226430Z [2024-04-06 01:46:02,468: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:46:02.491804626Z [2024-04-06 01:46:02,491: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:46:02.495410008Z [2024-04-06 01:46:02,495: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:46:02.495582235Z [2024-04-06 01:46:02,495: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:46:02.495789567Z [2024-04-06 01:46:02,495: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:46:02.495982456Z [2024-04-06 01:46:02,495: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:46:02.496791342Z [2024-04-06 01:46:02,496: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:46:02.496999219Z [2024-04-06 01:46:02,496: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:46:02.563715626Z [2024-04-06 01:46:02,563: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T01:46:02.566946353Z [2024-04-06 01:46:02,566: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:46:02.590293997Z [2024-04-06 01:46:02,590: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:46:02.601093943Z [2024-04-06 01:46:02,600: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T01:46:02.602935091Z [2024-04-06 01:46:02,602: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:46:02.603186309Z [2024-04-06 01:46:02,603: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:46:02.603615541Z [2024-04-06 01:46:02,603: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:46:02.603766726Z [2024-04-06 01:46:02,603: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T01:46:02.604153601Z [2024-04-06 01:46:02,603: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:46:02.604705339Z [2024-04-06 01:46:02,604: INFO/ForkPoolWorker-1] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:46:02.702260534Z [2024-04-06 01:46:02,701: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:46:04.393624847Z [2024-04-06 01:46:04,393: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9d664a34-5fcb-4512-8979-de80dd098da7] succeeded in 3.9869230889999017s: None 2024-04-06T01:46:04.854617186Z [2024-04-06 01:46:04,854: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[32cf8755-744c-49da-9c04-9522a554ef61] succeeded in 4.45532649300003s: None 2024-04-06T01:47:00.329874137Z [2024-04-06 01:47:00,329: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d8b0310a-cb04-4425-ae7d-77be6f5412fb] received 2024-04-06T01:47:00.332462075Z [2024-04-06 01:47:00,332: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0136582b-7bbc-4994-a8cb-a063f224f53a] received 2024-04-06T01:47:00.340568330Z [2024-04-06 01:47:00,340: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[60973947-8d51-4dac-ba91-cd6b0cc90208] received 2024-04-06T01:47:00.347529221Z [2024-04-06 01:47:00,347: INFO/ForkPoolWorker-15] [d8b0310a-cb04-4425-ae7d-77be6f5412fb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:47:00.352514777Z [2024-04-06 01:47:00,351: INFO/ForkPoolWorker-16] [0136582b-7bbc-4994-a8cb-a063f224f53a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:47:00.352838150Z [2024-04-06 01:47:00,352: INFO/ForkPoolWorker-1] [60973947-8d51-4dac-ba91-cd6b0cc90208] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T01:47:00.627959971Z [2024-04-06 01:47:00,624: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T01:47:00.649867561Z [2024-04-06 01:47:00,646: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:47:00.686183823Z [2024-04-06 01:47:00,682: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:47:00.797013586Z [2024-04-06 01:47:00,796: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-06T01:47:00.800981327Z [2024-04-06 01:47:00,800: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:47:00.828303679Z [2024-04-06 01:47:00,828: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T01:47:00.829583288Z [2024-04-06 01:47:00,829: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T01:47:00.829837615Z [2024-04-06 01:47:00,829: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T01:47:00.829965906Z [2024-04-06 01:47:00,829: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-06T01:47:00.830315050Z [2024-04-06 01:47:00,830: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T01:47:00.922907748Z [2024-04-06 01:47:00,922: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:47:01.547142223Z [2024-04-06 01:47:01,546: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[60973947-8d51-4dac-ba91-cd6b0cc90208] succeeded in 1.2048243819990603s: None 2024-04-06T01:47:01.926255580Z [2024-04-06 01:47:01,925: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:47:01.930852682Z [2024-04-06 01:47:01,930: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:47:01.953544254Z [2024-04-06 01:47:01,953: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:47:01.954876290Z [2024-04-06 01:47:01,954: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:47:01.954888847Z [2024-04-06 01:47:01,954: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:47:01.955065421Z [2024-04-06 01:47:01,954: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:47:01.955096687Z [2024-04-06 01:47:01,954: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:47:01.955423906Z [2024-04-06 01:47:01,955: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:47:01.955442014Z [2024-04-06 01:47:01,955: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:47:02.024123276Z [2024-04-06 01:47:02,023: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:47:02.033576428Z [2024-04-06 01:47:02,033: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:47:02.072320774Z [2024-04-06 01:47:02,072: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:47:02.075912683Z [2024-04-06 01:47:02,075: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:47:02.080014649Z [2024-04-06 01:47:02,079: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:47:02.080053001Z [2024-04-06 01:47:02,079: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:47:02.083606650Z [2024-04-06 01:47:02,079: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:47:02.083685688Z [2024-04-06 01:47:02,083: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:47:02.084183561Z [2024-04-06 01:47:02,083: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:47:02.087589217Z [2024-04-06 01:47:02,084: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:47:02.187574130Z [2024-04-06 01:47:02,187: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:47:03.786742800Z [2024-04-06 01:47:03,786: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0136582b-7bbc-4994-a8cb-a063f224f53a] succeeded in 3.4522816080007033s: None 2024-04-06T01:47:04.089318304Z [2024-04-06 01:47:04,088: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d8b0310a-cb04-4425-ae7d-77be6f5412fb] succeeded in 3.7557046879992413s: None 2024-04-06T01:48:01.294552120Z [2024-04-06 01:48:01,294: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0fd08822-83ee-4247-918a-e2c349394cda] received 2024-04-06T01:48:01.300251693Z [2024-04-06 01:48:01,300: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[55e8f8e3-6825-49db-8e98-af21c6af61c8] received 2024-04-06T01:48:01.305773365Z [2024-04-06 01:48:01,305: INFO/ForkPoolWorker-15] [0fd08822-83ee-4247-918a-e2c349394cda] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T01:48:01.311107936Z [2024-04-06 01:48:01,310: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[26af2da1-71fa-4575-857d-50605086647c] received 2024-04-06T01:48:01.316222895Z [2024-04-06 01:48:01,315: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[87bc51ac-3463-45d9-97e8-4a4c36fc6734] received 2024-04-06T01:48:01.319137869Z [2024-04-06 01:48:01,318: INFO/ForkPoolWorker-16] [55e8f8e3-6825-49db-8e98-af21c6af61c8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:48:01.321193491Z [2024-04-06 01:48:01,320: INFO/ForkPoolWorker-1] [26af2da1-71fa-4575-857d-50605086647c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:48:01.328879145Z [2024-04-06 01:48:01,328: INFO/ForkPoolWorker-2] [87bc51ac-3463-45d9-97e8-4a4c36fc6734] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T01:48:01.629480487Z [2024-04-06 01:48:01,625: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T01:48:01.694516647Z [2024-04-06 01:48:01,686: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:48:01.696445375Z [2024-04-06 01:48:01,692: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:48:01.792855957Z [2024-04-06 01:48:01,787: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T01:48:01.941694623Z [2024-04-06 01:48:01,941: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:48:02.087718495Z [2024-04-06 01:48:02,087: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-06T01:48:02.091918231Z [2024-04-06 01:48:02,091: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:48:02.114323614Z [2024-04-06 01:48:02,114: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T01:48:02.115632266Z [2024-04-06 01:48:02,115: INFO/ForkPoolWorker-2] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T01:48:02.115849120Z [2024-04-06 01:48:02,115: INFO/ForkPoolWorker-2] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T01:48:02.116042282Z [2024-04-06 01:48:02,115: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-06T01:48:02.116358453Z [2024-04-06 01:48:02,116: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T01:48:02.245109023Z [2024-04-06 01:48:02,244: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:48:02.663438112Z [2024-04-06 01:48:02,662: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0fd08822-83ee-4247-918a-e2c349394cda] succeeded in 1.367050091001147s: None 2024-04-06T01:48:02.987729287Z [2024-04-06 01:48:02,987: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[87bc51ac-3463-45d9-97e8-4a4c36fc6734] succeeded in 1.667218803000651s: None 2024-04-06T01:48:03.170584716Z [2024-04-06 01:48:03,170: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:48:03.177656892Z [2024-04-06 01:48:03,176: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:48:03.205413255Z [2024-04-06 01:48:03,205: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:48:03.208113291Z [2024-04-06 01:48:03,207: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:48:03.208294258Z [2024-04-06 01:48:03,208: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:48:03.208534734Z [2024-04-06 01:48:03,208: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:48:03.208664235Z [2024-04-06 01:48:03,208: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:48:03.209137910Z [2024-04-06 01:48:03,208: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:48:03.209364226Z [2024-04-06 01:48:03,209: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:48:03.318881090Z [2024-04-06 01:48:03,318: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T01:48:03.322300320Z [2024-04-06 01:48:03,321: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:48:03.364011031Z [2024-04-06 01:48:03,363: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:48:03.366228705Z [2024-04-06 01:48:03,366: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T01:48:03.367911267Z [2024-04-06 01:48:03,367: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:48:03.367968712Z [2024-04-06 01:48:03,367: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:48:03.368227028Z [2024-04-06 01:48:03,367: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:48:03.368330044Z [2024-04-06 01:48:03,368: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T01:48:03.368690576Z [2024-04-06 01:48:03,368: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:48:03.368802846Z [2024-04-06 01:48:03,368: INFO/ForkPoolWorker-1] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:48:03.512089699Z [2024-04-06 01:48:03,511: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:48:05.197536366Z [2024-04-06 01:48:05,196: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[26af2da1-71fa-4575-857d-50605086647c] succeeded in 3.88422569100112s: None 2024-04-06T01:48:05.311537961Z [2024-04-06 01:48:05,310: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[55e8f8e3-6825-49db-8e98-af21c6af61c8] succeeded in 4.006282951000685s: None 2024-04-06T01:49:01.321902387Z [2024-04-06 01:49:01,321: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[41e195cd-9677-4d83-bd56-e2e660b39fb4] received 2024-04-06T01:49:01.325436568Z [2024-04-06 01:49:01,325: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[58d550a2-eced-43ea-b2b8-c5b92938ce13] received 2024-04-06T01:49:01.335428548Z [2024-04-06 01:49:01,335: INFO/ForkPoolWorker-16] [58d550a2-eced-43ea-b2b8-c5b92938ce13] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:49:01.337831779Z [2024-04-06 01:49:01,337: INFO/ForkPoolWorker-15] [41e195cd-9677-4d83-bd56-e2e660b39fb4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:49:01.361223601Z [2024-04-06 01:49:01,360: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2c3b1e12-6aa2-48b4-9f29-c27c3c3d2df2] received 2024-04-06T01:49:01.372745811Z [2024-04-06 01:49:01,372: INFO/ForkPoolWorker-1] [2c3b1e12-6aa2-48b4-9f29-c27c3c3d2df2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T01:49:01.659082221Z [2024-04-06 01:49:01,655: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:49:01.665688714Z [2024-04-06 01:49:01,662: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:49:01.713163014Z [2024-04-06 01:49:01,694: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T01:49:01.926999178Z [2024-04-06 01:49:01,926: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-06T01:49:01.932386047Z [2024-04-06 01:49:01,931: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:49:01.964875568Z [2024-04-06 01:49:01,964: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T01:49:01.968182505Z [2024-04-06 01:49:01,967: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T01:49:01.968354427Z [2024-04-06 01:49:01,968: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T01:49:01.968477483Z [2024-04-06 01:49:01,968: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-06T01:49:01.968762980Z [2024-04-06 01:49:01,968: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T01:49:02.098231292Z [2024-04-06 01:49:02,097: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:49:02.701841293Z [2024-04-06 01:49:02,701: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2c3b1e12-6aa2-48b4-9f29-c27c3c3d2df2] succeeded in 1.3380358649992559s: None 2024-04-06T01:49:03.019796212Z [2024-04-06 01:49:03,019: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:49:03.023569884Z [2024-04-06 01:49:03,022: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:49:03.041458894Z [2024-04-06 01:49:03,041: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:49:03.042945864Z [2024-04-06 01:49:03,042: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:49:03.043469916Z [2024-04-06 01:49:03,042: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:49:03.043673569Z [2024-04-06 01:49:03,043: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:49:03.043780592Z [2024-04-06 01:49:03,043: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:49:03.044599939Z [2024-04-06 01:49:03,044: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:49:03.044701149Z [2024-04-06 01:49:03,044: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:49:03.117226537Z [2024-04-06 01:49:03,116: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:49:03.123433679Z [2024-04-06 01:49:03,122: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:49:03.129985564Z [2024-04-06 01:49:03,129: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:49:03.159100871Z [2024-04-06 01:49:03,158: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:49:03.161509377Z [2024-04-06 01:49:03,161: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:49:03.161832783Z [2024-04-06 01:49:03,161: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:49:03.162201685Z [2024-04-06 01:49:03,161: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:49:03.162413164Z [2024-04-06 01:49:03,162: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:49:03.163045414Z [2024-04-06 01:49:03,162: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:49:03.163227191Z [2024-04-06 01:49:03,163: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:49:03.271612791Z [2024-04-06 01:49:03,271: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:49:04.966234337Z [2024-04-06 01:49:04,965: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[58d550a2-eced-43ea-b2b8-c5b92938ce13] succeeded in 3.638670677999471s: None 2024-04-06T01:49:06.633184861Z [2024-04-06 01:49:06,632: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[41e195cd-9677-4d83-bd56-e2e660b39fb4] succeeded in 5.3082344949998514s: None 2024-04-06T01:50:01.251708883Z [2024-04-06 01:50:01,251: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[22c1e0bd-64be-4073-89bd-f15a8b303920] received 2024-04-06T01:50:01.257164428Z [2024-04-06 01:50:01,256: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[61fc776b-f587-4005-bbd1-e0e4c9d63dee] received 2024-04-06T01:50:01.260558406Z [2024-04-06 01:50:01,260: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3b4f1472-7f32-477e-8e74-2ef0e10cc16f] received 2024-04-06T01:50:01.275113035Z [2024-04-06 01:50:01,274: INFO/ForkPoolWorker-1] [3b4f1472-7f32-477e-8e74-2ef0e10cc16f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T01:50:01.281004813Z [2024-04-06 01:50:01,280: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ce523905-c75b-47a9-b9bc-9c466885325f] received 2024-04-06T01:50:01.283014652Z [2024-04-06 01:50:01,282: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2a79d8ba-6ed3-4422-8d61-3d2cbd9154e5] received 2024-04-06T01:50:01.291071821Z [2024-04-06 01:50:01,290: INFO/ForkPoolWorker-16] [61fc776b-f587-4005-bbd1-e0e4c9d63dee] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T01:50:01.324301177Z [2024-04-06 01:50:01,323: INFO/ForkPoolWorker-3] [2a79d8ba-6ed3-4422-8d61-3d2cbd9154e5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:50:01.330758801Z [2024-04-06 01:50:01,330: INFO/ForkPoolWorker-15] [22c1e0bd-64be-4073-89bd-f15a8b303920] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T01:50:01.371341697Z [2024-04-06 01:50:01,370: INFO/ForkPoolWorker-2] [ce523905-c75b-47a9-b9bc-9c466885325f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:50:01.605567491Z [2024-04-06 01:50:01,602: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T01:50:02.388136008Z [2024-04-06 01:50:02,383: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T01:50:02.428353923Z [2024-04-06 01:50:02,420: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:50:02.429352201Z [2024-04-06 01:50:02,428: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-06T01:50:02.436331113Z [2024-04-06 01:50:02,435: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:50:02.458366372Z [2024-04-06 01:50:02,442: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:50:02.488425179Z [2024-04-06 01:50:02,488: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T01:50:02.489771229Z [2024-04-06 01:50:02,489: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T01:50:02.489831902Z [2024-04-06 01:50:02,489: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T01:50:02.489844158Z [2024-04-06 01:50:02,489: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-06T01:50:02.490496732Z [2024-04-06 01:50:02,490: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T01:50:02.618759831Z [2024-04-06 01:50:02,618: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:50:02.621315373Z [2024-04-06 01:50:02,606: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T01:50:02.954000598Z [2024-04-06 01:50:02,953: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:50:04.243465914Z [2024-04-06 01:50:04,243: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3b4f1472-7f32-477e-8e74-2ef0e10cc16f] succeeded in 2.973686622000969s: None 2024-04-06T01:50:05.000402531Z [2024-04-06 01:50:04,999: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[61fc776b-f587-4005-bbd1-e0e4c9d63dee] succeeded in 3.737816804999966s: None 2024-04-06T01:50:05.425678908Z [2024-04-06 01:50:05,425: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-06T01:50:05.429189733Z [2024-04-06 01:50:05,428: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:50:05.456773897Z [2024-04-06 01:50:05,456: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T01:50:05.458510669Z [2024-04-06 01:50:05,458: INFO/ForkPoolWorker-2] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:50:05.458524967Z [2024-04-06 01:50:05,458: INFO/ForkPoolWorker-2] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:50:05.458683194Z [2024-04-06 01:50:05,458: INFO/ForkPoolWorker-2] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:50:05.458710050Z [2024-04-06 01:50:05,458: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-06T01:50:05.458966788Z [2024-04-06 01:50:05,458: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:50:05.459006921Z [2024-04-06 01:50:05,458: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:50:05.520890081Z [2024-04-06 01:50:05,520: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:50:05.523787396Z [2024-04-06 01:50:05,523: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:50:05.546002771Z [2024-04-06 01:50:05,545: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:50:05.546744846Z [2024-04-06 01:50:05,546: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:50:05.547042014Z [2024-04-06 01:50:05,546: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:50:05.547083312Z [2024-04-06 01:50:05,547: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:50:05.547204602Z [2024-04-06 01:50:05,547: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:50:05.547240092Z [2024-04-06 01:50:05,547: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:50:05.547493219Z [2024-04-06 01:50:05,547: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T01:50:05.547534985Z [2024-04-06 01:50:05,547: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:50:05.647377990Z [2024-04-06 01:50:05,647: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:50:05.767014686Z [2024-04-06 01:50:05,766: INFO/ForkPoolWorker-3] Getting VIM list 2024-04-06T01:50:05.774770950Z [2024-04-06 01:50:05,774: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:50:05.801661666Z [2024-04-06 01:50:05,801: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-06T01:50:05.802970479Z [2024-04-06 01:50:05,802: INFO/ForkPoolWorker-3] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:50:05.803100916Z [2024-04-06 01:50:05,802: INFO/ForkPoolWorker-3] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:50:05.803326126Z [2024-04-06 01:50:05,803: INFO/ForkPoolWorker-3] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:50:05.803387531Z [2024-04-06 01:50:05,803: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-04-06T01:50:05.803618035Z [2024-04-06 01:50:05,803: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:50:05.803659181Z [2024-04-06 01:50:05,803: INFO/ForkPoolWorker-3] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:50:05.879424772Z [2024-04-06 01:50:05,879: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:50:06.376723084Z [2024-04-06 01:50:06,376: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[22c1e0bd-64be-4073-89bd-f15a8b303920] succeeded in 5.118573526000546s: None 2024-04-06T01:50:06.945731334Z [2024-04-06 01:50:06,943: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[11311432-918c-439c-8ab7-1984051cce7a] received 2024-04-06T01:50:06.950204431Z [2024-04-06 01:50:06,949: INFO/ForkPoolWorker-15] [11311432-918c-439c-8ab7-1984051cce7a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'split_metrics', 'scheduled__2024-04-06T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T01:50:07.288436151Z [2024-04-06 01:50:07,283: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T01:50:07.571241379Z [2024-04-06 01:50:07,570: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[2a79d8ba-6ed3-4422-8d61-3d2cbd9154e5] succeeded in 6.283719361999829s: None 2024-04-06T01:50:07.677233844Z [2024-04-06 01:50:07,676: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[ce523905-c75b-47a9-b9bc-9c466885325f] succeeded in 6.3799852690008265s: None 2024-04-06T01:50:08.551324902Z [2024-04-06 01:50:08,550: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:50:08.555885066Z [2024-04-06 01:50:08,555: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:50:08.580698801Z [2024-04-06 01:50:08,580: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:50:08.582082607Z [2024-04-06 01:50:08,581: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:50:08.582151949Z [2024-04-06 01:50:08,582: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:50:08.582341507Z [2024-04-06 01:50:08,582: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:50:08.582415161Z [2024-04-06 01:50:08,582: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:50:08.582690653Z [2024-04-06 01:50:08,582: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T01:50:08.582800152Z [2024-04-06 01:50:08,582: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:50:08.678882402Z [2024-04-06 01:50:08,678: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:50:09.402594721Z [2024-04-06 01:50:09,400: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[55f82cfd-c752-4dad-b163-5f1d71832388] received 2024-04-06T01:50:09.407966625Z [2024-04-06 01:50:09,407: INFO/ForkPoolWorker-16] [55f82cfd-c752-4dad-b163-5f1d71832388] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'collect_metrics', 'scheduled__2024-04-06T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T01:50:09.438793934Z [2024-04-06 01:50:09,438: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[11311432-918c-439c-8ab7-1984051cce7a] succeeded in 2.4931572919995233s: None 2024-04-06T01:50:09.744639321Z [2024-04-06 01:50:09,737: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T01:50:11.064721541Z [2024-04-06 01:50:11,064: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:50:11.068540666Z [2024-04-06 01:50:11,068: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:50:11.088798421Z [2024-04-06 01:50:11,088: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:50:11.090150299Z [2024-04-06 01:50:11,089: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:50:11.090179155Z [2024-04-06 01:50:11,090: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:50:11.090357525Z [2024-04-06 01:50:11,090: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:50:11.090425674Z [2024-04-06 01:50:11,090: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:50:11.090684425Z [2024-04-06 01:50:11,090: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T01:50:11.090740086Z [2024-04-06 01:50:11,090: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:50:11.170644554Z [2024-04-06 01:50:11,170: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:50:11.778475099Z [2024-04-06 01:50:11,778: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[91a62cfc-ff67-4742-8371-d5420370022d] received 2024-04-06T01:50:11.803720959Z [2024-04-06 01:50:11,803: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[55f82cfd-c752-4dad-b163-5f1d71832388] succeeded in 2.4013470509999024s: None 2024-04-06T01:50:11.807329281Z [2024-04-06 01:50:11,806: INFO/ForkPoolWorker-15] [91a62cfc-ff67-4742-8371-d5420370022d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'send_prometheus', 'scheduled__2024-04-06T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T01:50:12.122175372Z [2024-04-06 01:50:12,118: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T01:50:13.250498531Z [2024-04-06 01:50:13,250: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:50:13.253916022Z [2024-04-06 01:50:13,253: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:50:13.270878429Z [2024-04-06 01:50:13,270: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:50:13.272100173Z [2024-04-06 01:50:13,271: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:50:13.272208109Z [2024-04-06 01:50:13,272: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:50:13.272333503Z [2024-04-06 01:50:13,272: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:50:13.272411791Z [2024-04-06 01:50:13,272: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:50:13.272628752Z [2024-04-06 01:50:13,272: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T01:50:13.272712520Z [2024-04-06 01:50:13,272: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:50:13.386672200Z [2024-04-06 01:50:13,386: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:50:13.926425578Z [2024-04-06 01:50:13,925: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[91a62cfc-ff67-4742-8371-d5420370022d] succeeded in 2.141863265998836s: None 2024-04-06T01:51:00.407113427Z [2024-04-06 01:51:00,406: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[20ca7b44-d8bf-486e-abf9-e66969ee7fd7] received 2024-04-06T01:51:00.415021322Z [2024-04-06 01:51:00,414: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c8286888-e7b1-49e5-af43-da5aceb4de3c] received 2024-04-06T01:51:00.421244250Z [2024-04-06 01:51:00,420: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[08b37a04-defb-4057-89ef-51cc61334950] received 2024-04-06T01:51:00.421439444Z [2024-04-06 01:51:00,421: INFO/ForkPoolWorker-15] [20ca7b44-d8bf-486e-abf9-e66969ee7fd7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:51:00.444829489Z [2024-04-06 01:51:00,444: INFO/ForkPoolWorker-1] [08b37a04-defb-4057-89ef-51cc61334950] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T01:51:00.446201858Z [2024-04-06 01:51:00,445: INFO/ForkPoolWorker-16] [c8286888-e7b1-49e5-af43-da5aceb4de3c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:51:00.830275134Z [2024-04-06 01:51:00,826: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:51:00.851160914Z [2024-04-06 01:51:00,846: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T01:51:00.866457065Z [2024-04-06 01:51:00,863: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:51:01.049370913Z [2024-04-06 01:51:01,048: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-06T01:51:01.053692479Z [2024-04-06 01:51:01,053: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:51:01.076649170Z [2024-04-06 01:51:01,076: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T01:51:01.078808266Z [2024-04-06 01:51:01,078: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T01:51:01.079119025Z [2024-04-06 01:51:01,078: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T01:51:01.079379629Z [2024-04-06 01:51:01,079: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-06T01:51:01.079963548Z [2024-04-06 01:51:01,079: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T01:51:01.210191532Z [2024-04-06 01:51:01,209: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:51:01.902793268Z [2024-04-06 01:51:01,902: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[08b37a04-defb-4057-89ef-51cc61334950] succeeded in 1.4733499809990462s: None 2024-04-06T01:51:02.148388623Z [2024-04-06 01:51:02,147: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:51:02.151522603Z [2024-04-06 01:51:02,151: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:51:02.176616600Z [2024-04-06 01:51:02,176: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:51:02.177947423Z [2024-04-06 01:51:02,177: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:51:02.177988836Z [2024-04-06 01:51:02,177: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:51:02.178123710Z [2024-04-06 01:51:02,177: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:51:02.178162517Z [2024-04-06 01:51:02,178: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:51:02.178416450Z [2024-04-06 01:51:02,178: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:51:02.178482510Z [2024-04-06 01:51:02,178: INFO/ForkPoolWorker-15] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:51:02.190340901Z [2024-04-06 01:51:02,189: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:51:02.193985708Z [2024-04-06 01:51:02,193: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:51:02.216393778Z [2024-04-06 01:51:02,216: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:51:02.228687094Z [2024-04-06 01:51:02,228: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:51:02.228726678Z [2024-04-06 01:51:02,228: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:51:02.229096796Z [2024-04-06 01:51:02,228: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:51:02.229103330Z [2024-04-06 01:51:02,228: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:51:02.229253645Z [2024-04-06 01:51:02,229: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:51:02.229769180Z [2024-04-06 01:51:02,229: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:51:02.260813993Z [2024-04-06 01:51:02,260: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:51:02.316452483Z [2024-04-06 01:51:02,316: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:51:03.905821144Z [2024-04-06 01:51:03,905: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[20ca7b44-d8bf-486e-abf9-e66969ee7fd7] succeeded in 3.496071319999828s: None 2024-04-06T01:51:04.751524089Z [2024-04-06 01:51:04,750: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c8286888-e7b1-49e5-af43-da5aceb4de3c] succeeded in 4.329807926000285s: None 2024-04-06T01:52:01.065529272Z [2024-04-06 01:52:01,064: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7b43aa8c-97bf-4240-bbe6-5b8552e67b5b] received 2024-04-06T01:52:01.068264367Z [2024-04-06 01:52:01,067: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[33fc80df-531d-4b48-8238-bc96c10c6221] received 2024-04-06T01:52:01.072869747Z [2024-04-06 01:52:01,072: INFO/ForkPoolWorker-15] [7b43aa8c-97bf-4240-bbe6-5b8552e67b5b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:52:01.073579959Z [2024-04-06 01:52:01,073: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2795b89e-25dc-4d6c-ac0a-b77c7459e17f] received 2024-04-06T01:52:01.076783086Z [2024-04-06 01:52:01,076: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7af17872-310d-4479-902d-561666514275] received 2024-04-06T01:52:01.087101342Z [2024-04-06 01:52:01,086: INFO/ForkPoolWorker-1] [2795b89e-25dc-4d6c-ac0a-b77c7459e17f] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T01:52:01.087918865Z [2024-04-06 01:52:01,087: INFO/ForkPoolWorker-16] [33fc80df-531d-4b48-8238-bc96c10c6221] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T01:52:01.098491294Z [2024-04-06 01:52:01,098: INFO/ForkPoolWorker-2] [7af17872-310d-4479-902d-561666514275] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:52:01.396502473Z [2024-04-06 01:52:01,392: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T01:52:01.412026523Z [2024-04-06 01:52:01,407: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T01:52:01.444039491Z [2024-04-06 01:52:01,439: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:52:01.559549657Z [2024-04-06 01:52:01,556: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:52:01.612801810Z [2024-04-06 01:52:01,612: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-06T01:52:01.616731896Z [2024-04-06 01:52:01,616: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:52:01.654583069Z [2024-04-06 01:52:01,652: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:52:01.657305777Z [2024-04-06 01:52:01,657: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:52:01.658290467Z [2024-04-06 01:52:01,658: INFO/ForkPoolWorker-16] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T01:52:01.658486177Z [2024-04-06 01:52:01,658: INFO/ForkPoolWorker-16] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T01:52:01.658628397Z [2024-04-06 01:52:01,658: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-06T01:52:01.658896722Z [2024-04-06 01:52:01,658: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T01:52:01.770364975Z [2024-04-06 01:52:01,770: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:52:02.369797230Z [2024-04-06 01:52:02,369: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2795b89e-25dc-4d6c-ac0a-b77c7459e17f] succeeded in 1.2940461970010801s: None 2024-04-06T01:52:02.551867684Z [2024-04-06 01:52:02,551: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[33fc80df-531d-4b48-8238-bc96c10c6221] succeeded in 1.4811378119993606s: None 2024-04-06T01:52:02.802678988Z [2024-04-06 01:52:02,802: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:52:02.805785475Z [2024-04-06 01:52:02,805: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:52:02.830565041Z [2024-04-06 01:52:02,830: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:52:02.832128181Z [2024-04-06 01:52:02,831: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:52:02.832163734Z [2024-04-06 01:52:02,832: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:52:02.832479382Z [2024-04-06 01:52:02,832: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:52:02.832500011Z [2024-04-06 01:52:02,832: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:52:02.833194103Z [2024-04-06 01:52:02,832: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:52:02.833290778Z [2024-04-06 01:52:02,833: INFO/ForkPoolWorker-15] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:52:02.919447844Z [2024-04-06 01:52:02,918: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:52:03.099644990Z [2024-04-06 01:52:03,099: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-06T01:52:03.103178538Z [2024-04-06 01:52:03,102: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:52:03.131358250Z [2024-04-06 01:52:03,130: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T01:52:03.133762044Z [2024-04-06 01:52:03,133: INFO/ForkPoolWorker-2] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:52:03.133845337Z [2024-04-06 01:52:03,133: INFO/ForkPoolWorker-2] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:52:03.134106219Z [2024-04-06 01:52:03,133: INFO/ForkPoolWorker-2] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:52:03.134243907Z [2024-04-06 01:52:03,134: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-06T01:52:03.134750096Z [2024-04-06 01:52:03,134: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:52:03.135579526Z [2024-04-06 01:52:03,135: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:52:03.237305877Z [2024-04-06 01:52:03,236: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:52:04.373552854Z [2024-04-06 01:52:04,373: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7b43aa8c-97bf-4240-bbe6-5b8552e67b5b] succeeded in 3.3062777600007394s: None 2024-04-06T01:52:05.665165675Z [2024-04-06 01:52:05,664: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[7af17872-310d-4479-902d-561666514275] succeeded in 4.584897548998924s: None 2024-04-06T01:53:00.952712025Z [2024-04-06 01:53:00,952: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a8dd59fe-ae9a-488d-adeb-05f5b82e1660] received 2024-04-06T01:53:00.960627164Z [2024-04-06 01:53:00,960: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c6048b00-4946-48f8-bb40-bcad8a82c455] received 2024-04-06T01:53:00.964924664Z [2024-04-06 01:53:00,964: INFO/ForkPoolWorker-15] [a8dd59fe-ae9a-488d-adeb-05f5b82e1660] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:53:00.968582938Z [2024-04-06 01:53:00,968: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[55dd31ac-9165-4512-97ce-aa8af52fcb5f] received 2024-04-06T01:53:00.974609857Z [2024-04-06 01:53:00,973: INFO/ForkPoolWorker-16] [c6048b00-4946-48f8-bb40-bcad8a82c455] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:53:00.985816407Z [2024-04-06 01:53:00,985: INFO/ForkPoolWorker-1] [55dd31ac-9165-4512-97ce-aa8af52fcb5f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T01:53:01.300938015Z [2024-04-06 01:53:01,297: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:53:01.302941930Z [2024-04-06 01:53:01,299: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:53:01.315027955Z [2024-04-06 01:53:01,311: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T01:53:01.481011805Z [2024-04-06 01:53:01,480: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-06T01:53:01.485204118Z [2024-04-06 01:53:01,484: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:53:01.512760102Z [2024-04-06 01:53:01,512: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T01:53:01.514038818Z [2024-04-06 01:53:01,513: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T01:53:01.514213585Z [2024-04-06 01:53:01,513: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T01:53:01.514355312Z [2024-04-06 01:53:01,514: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-06T01:53:01.514633768Z [2024-04-06 01:53:01,514: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T01:53:01.603768134Z [2024-04-06 01:53:01,603: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:53:02.196442431Z [2024-04-06 01:53:02,195: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[55dd31ac-9165-4512-97ce-aa8af52fcb5f] succeeded in 1.2225664489997143s: None 2024-04-06T01:53:02.536831539Z [2024-04-06 01:53:02,536: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:53:02.540281906Z [2024-04-06 01:53:02,539: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:53:02.559555502Z [2024-04-06 01:53:02,559: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:53:02.563021803Z [2024-04-06 01:53:02,562: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:53:02.563443959Z [2024-04-06 01:53:02,563: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:53:02.564828203Z [2024-04-06 01:53:02,564: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:53:02.564851540Z [2024-04-06 01:53:02,564: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:53:02.564969019Z [2024-04-06 01:53:02,564: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:53:02.565096842Z [2024-04-06 01:53:02,564: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:53:02.565299077Z [2024-04-06 01:53:02,565: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:53:02.565478508Z [2024-04-06 01:53:02,565: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:53:02.585260385Z [2024-04-06 01:53:02,585: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:53:02.586596332Z [2024-04-06 01:53:02,586: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:53:02.586612826Z [2024-04-06 01:53:02,586: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:53:02.586716923Z [2024-04-06 01:53:02,586: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:53:02.586796436Z [2024-04-06 01:53:02,586: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:53:02.586989888Z [2024-04-06 01:53:02,586: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:53:02.587134831Z [2024-04-06 01:53:02,586: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:53:02.649833559Z [2024-04-06 01:53:02,649: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:53:02.675028570Z [2024-04-06 01:53:02,674: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:53:04.069575825Z [2024-04-06 01:53:04,069: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c6048b00-4946-48f8-bb40-bcad8a82c455] succeeded in 3.1054999730004056s: None 2024-04-06T01:53:04.456203872Z [2024-04-06 01:53:04,452: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a8dd59fe-ae9a-488d-adeb-05f5b82e1660] succeeded in 3.4951423759994213s: None 2024-04-06T01:54:00.838321336Z [2024-04-06 01:54:00,837: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f224546d-484e-4364-8c54-efe7a758243d] received 2024-04-06T01:54:00.849178867Z [2024-04-06 01:54:00,848: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[856ebc22-957e-4a0d-83db-518dbecc4196] received 2024-04-06T01:54:00.849673414Z [2024-04-06 01:54:00,849: INFO/ForkPoolWorker-15] [f224546d-484e-4364-8c54-efe7a758243d] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T01:54:00.851723794Z [2024-04-06 01:54:00,851: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[125db670-021e-4269-be10-81cd87f66033] received 2024-04-06T01:54:00.854371038Z [2024-04-06 01:54:00,854: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[edc0c5de-e0fa-4f81-bf97-eeee5c96fc16] received 2024-04-06T01:54:00.862423692Z [2024-04-06 01:54:00,862: INFO/ForkPoolWorker-16] [856ebc22-957e-4a0d-83db-518dbecc4196] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:54:00.868196793Z [2024-04-06 01:54:00,867: INFO/ForkPoolWorker-1] [125db670-021e-4269-be10-81cd87f66033] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:54:00.884524499Z [2024-04-06 01:54:00,884: INFO/ForkPoolWorker-2] [edc0c5de-e0fa-4f81-bf97-eeee5c96fc16] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T01:54:01.193081463Z [2024-04-06 01:54:01,189: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T01:54:01.216314657Z [2024-04-06 01:54:01,212: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:54:01.220448139Z [2024-04-06 01:54:01,217: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:54:01.343393408Z [2024-04-06 01:54:01,338: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T01:54:01.411019720Z [2024-04-06 01:54:01,409: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-06T01:54:01.415110044Z [2024-04-06 01:54:01,414: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:54:01.444887607Z [2024-04-06 01:54:01,444: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T01:54:01.446162119Z [2024-04-06 01:54:01,445: INFO/ForkPoolWorker-2] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T01:54:01.446367373Z [2024-04-06 01:54:01,446: INFO/ForkPoolWorker-2] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T01:54:01.446620622Z [2024-04-06 01:54:01,446: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-06T01:54:01.447361530Z [2024-04-06 01:54:01,447: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T01:54:01.571308302Z [2024-04-06 01:54:01,570: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:54:01.721857657Z [2024-04-06 01:54:01,721: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:54:02.264050630Z [2024-04-06 01:54:02,263: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[edc0c5de-e0fa-4f81-bf97-eeee5c96fc16] succeeded in 1.3953103549993102s: None 2024-04-06T01:54:02.453784665Z [2024-04-06 01:54:02,453: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f224546d-484e-4364-8c54-efe7a758243d] succeeded in 1.6113738539988844s: None 2024-04-06T01:54:02.623151472Z [2024-04-06 01:54:02,622: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:54:02.626702771Z [2024-04-06 01:54:02,626: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:54:02.650842430Z [2024-04-06 01:54:02,650: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:54:02.653078300Z [2024-04-06 01:54:02,652: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:54:02.653099293Z [2024-04-06 01:54:02,653: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:54:02.653306210Z [2024-04-06 01:54:02,653: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:54:02.653378103Z [2024-04-06 01:54:02,653: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:54:02.653650613Z [2024-04-06 01:54:02,653: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:54:02.653720112Z [2024-04-06 01:54:02,653: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:54:02.741320891Z [2024-04-06 01:54:02,741: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:54:03.062993217Z [2024-04-06 01:54:03,062: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T01:54:03.066251960Z [2024-04-06 01:54:03,065: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:54:03.107095877Z [2024-04-06 01:54:03,106: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T01:54:03.112705897Z [2024-04-06 01:54:03,112: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:54:03.112919413Z [2024-04-06 01:54:03,112: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:54:03.113176537Z [2024-04-06 01:54:03,112: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:54:03.113359221Z [2024-04-06 01:54:03,113: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T01:54:03.113848472Z [2024-04-06 01:54:03,113: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:54:03.114082902Z [2024-04-06 01:54:03,113: INFO/ForkPoolWorker-1] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:54:03.214580134Z [2024-04-06 01:54:03,214: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:54:04.647022654Z [2024-04-06 01:54:04,646: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[856ebc22-957e-4a0d-83db-518dbecc4196] succeeded in 3.7955296769996494s: None 2024-04-06T01:54:04.960283803Z [2024-04-06 01:54:04,959: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[125db670-021e-4269-be10-81cd87f66033] succeeded in 4.104326456999843s: None 2024-04-06T01:55:00.392338321Z [2024-04-06 01:55:00,391: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b289e811-93ab-4c8b-9194-5592bf6d6663] received 2024-04-06T01:55:00.407871160Z [2024-04-06 01:55:00,407: INFO/ForkPoolWorker-15] [b289e811-93ab-4c8b-9194-5592bf6d6663] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T01:55:00.413977307Z [2024-04-06 01:55:00,413: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[841cc095-2697-4ca5-baab-7aa7c29cc331] received 2024-04-06T01:55:00.429083415Z [2024-04-06 01:55:00,428: INFO/ForkPoolWorker-16] [841cc095-2697-4ca5-baab-7aa7c29cc331] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:55:00.441880701Z [2024-04-06 01:55:00,435: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3062efb0-408e-43ac-a954-72ea31638031] received 2024-04-06T01:55:00.442988206Z [2024-04-06 01:55:00,442: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d4fc7b6a-ea17-4472-81f5-69b41d154191] received 2024-04-06T01:55:00.450060319Z [2024-04-06 01:55:00,449: INFO/ForkPoolWorker-2] [d4fc7b6a-ea17-4472-81f5-69b41d154191] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T01:55:00.480047397Z [2024-04-06 01:55:00,479: INFO/ForkPoolWorker-1] [3062efb0-408e-43ac-a954-72ea31638031] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:55:00.759011984Z [2024-04-06 01:55:00,755: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T01:55:00.893583760Z [2024-04-06 01:55:00,885: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:55:00.959670019Z [2024-04-06 01:55:00,956: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:55:00.981388910Z [2024-04-06 01:55:00,978: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T01:55:01.154728554Z [2024-04-06 01:55:01,154: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-06T01:55:01.158776063Z [2024-04-06 01:55:01,158: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:55:01.196187446Z [2024-04-06 01:55:01,195: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T01:55:01.200143418Z [2024-04-06 01:55:01,199: INFO/ForkPoolWorker-2] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T01:55:01.200336183Z [2024-04-06 01:55:01,200: INFO/ForkPoolWorker-2] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T01:55:01.200477729Z [2024-04-06 01:55:01,200: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-06T01:55:01.200767482Z [2024-04-06 01:55:01,200: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T01:55:01.328517018Z [2024-04-06 01:55:01,328: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:55:01.956285751Z [2024-04-06 01:55:01,955: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d4fc7b6a-ea17-4472-81f5-69b41d154191] succeeded in 1.5116620499993587s: None 2024-04-06T01:55:02.141156464Z [2024-04-06 01:55:02,140: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:55:02.144570824Z [2024-04-06 01:55:02,144: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:55:02.173348447Z [2024-04-06 01:55:02,172: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:55:02.176323852Z [2024-04-06 01:55:02,176: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:55:02.176657828Z [2024-04-06 01:55:02,176: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:55:02.176907247Z [2024-04-06 01:55:02,176: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:55:02.177056367Z [2024-04-06 01:55:02,176: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:55:02.177484857Z [2024-04-06 01:55:02,177: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T01:55:02.177636387Z [2024-04-06 01:55:02,177: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:55:02.283895623Z [2024-04-06 01:55:02,283: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:55:02.467554449Z [2024-04-06 01:55:02,467: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:55:02.472332866Z [2024-04-06 01:55:02,471: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:55:02.498656200Z [2024-04-06 01:55:02,498: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:55:02.501484242Z [2024-04-06 01:55:02,500: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:55:02.501498373Z [2024-04-06 01:55:02,500: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:55:02.501502206Z [2024-04-06 01:55:02,501: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:55:02.501506061Z [2024-04-06 01:55:02,501: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:55:02.502664641Z [2024-04-06 01:55:02,501: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:55:02.502680926Z [2024-04-06 01:55:02,502: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:55:02.542148735Z [2024-04-06 01:55:02,541: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T01:55:02.544986550Z [2024-04-06 01:55:02,544: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:55:02.568553783Z [2024-04-06 01:55:02,568: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T01:55:02.569920957Z [2024-04-06 01:55:02,569: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:55:02.569939446Z [2024-04-06 01:55:02,569: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:55:02.570061213Z [2024-04-06 01:55:02,569: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:55:02.570072069Z [2024-04-06 01:55:02,570: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T01:55:02.570628601Z [2024-04-06 01:55:02,570: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:55:02.570680511Z [2024-04-06 01:55:02,570: INFO/ForkPoolWorker-1] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:55:02.647464646Z [2024-04-06 01:55:02,646: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:55:02.675901888Z [2024-04-06 01:55:02,675: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:55:02.956939868Z [2024-04-06 01:55:02,956: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b289e811-93ab-4c8b-9194-5592bf6d6663] succeeded in 2.5627546359992266s: None 2024-04-06T01:55:03.548811998Z [2024-04-06 01:55:03,548: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5997dcb6-1511-4c05-80c5-7b032c7f0990] received 2024-04-06T01:55:03.562738106Z [2024-04-06 01:55:03,562: INFO/ForkPoolWorker-15] [5997dcb6-1511-4c05-80c5-7b032c7f0990] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'split_metrics', 'scheduled__2024-04-06T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T01:55:03.966491271Z [2024-04-06 01:55:03,963: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T01:55:04.429949475Z [2024-04-06 01:55:04,429: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3062efb0-408e-43ac-a954-72ea31638031] succeeded in 3.989325644000928s: None 2024-04-06T01:55:04.631337481Z [2024-04-06 01:55:04,630: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[841cc095-2697-4ca5-baab-7aa7c29cc331] succeeded in 4.215344637999806s: None 2024-04-06T01:55:05.289328740Z [2024-04-06 01:55:05,288: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:55:05.292484818Z [2024-04-06 01:55:05,292: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:55:05.312694485Z [2024-04-06 01:55:05,312: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:55:05.314082847Z [2024-04-06 01:55:05,313: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:55:05.314109695Z [2024-04-06 01:55:05,313: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:55:05.314254003Z [2024-04-06 01:55:05,314: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:55:05.314264596Z [2024-04-06 01:55:05,314: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:55:05.314538974Z [2024-04-06 01:55:05,314: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T01:55:05.314567798Z [2024-04-06 01:55:05,314: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:55:05.407500475Z [2024-04-06 01:55:05,407: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:55:06.067525316Z [2024-04-06 01:55:06,066: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5997dcb6-1511-4c05-80c5-7b032c7f0990] succeeded in 2.516635383999528s: None 2024-04-06T01:55:07.073536171Z [2024-04-06 01:55:07,073: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0d49cbb7-a537-47bb-8a68-5b8e17c6092d] received 2024-04-06T01:55:07.097432355Z [2024-04-06 01:55:07,097: INFO/ForkPoolWorker-15] [0d49cbb7-a537-47bb-8a68-5b8e17c6092d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'collect_metrics', 'scheduled__2024-04-06T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T01:55:07.379963146Z [2024-04-06 01:55:07,376: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T01:55:08.476301803Z [2024-04-06 01:55:08,475: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:55:08.479615293Z [2024-04-06 01:55:08,479: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:55:08.496154347Z [2024-04-06 01:55:08,495: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:55:08.497413254Z [2024-04-06 01:55:08,497: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:55:08.497539534Z [2024-04-06 01:55:08,497: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:55:08.497719033Z [2024-04-06 01:55:08,497: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:55:08.497801018Z [2024-04-06 01:55:08,497: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:55:08.498142020Z [2024-04-06 01:55:08,497: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T01:55:08.498300461Z [2024-04-06 01:55:08,498: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:55:08.576736583Z [2024-04-06 01:55:08,576: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:55:09.112470364Z [2024-04-06 01:55:09,112: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b7208958-dcfb-4cf2-afa9-76c3e6f9f94d] received 2024-04-06T01:55:09.129166001Z [2024-04-06 01:55:09,128: INFO/ForkPoolWorker-16] [b7208958-dcfb-4cf2-afa9-76c3e6f9f94d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'send_prometheus', 'scheduled__2024-04-06T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T01:55:09.158875919Z [2024-04-06 01:55:09,158: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0d49cbb7-a537-47bb-8a68-5b8e17c6092d] succeeded in 2.081792538998343s: None 2024-04-06T01:55:09.415044548Z [2024-04-06 01:55:09,411: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T01:55:10.516592926Z [2024-04-06 01:55:10,516: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:55:10.520087174Z [2024-04-06 01:55:10,519: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:55:10.538245033Z [2024-04-06 01:55:10,538: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:55:10.540340000Z [2024-04-06 01:55:10,539: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:55:10.540366242Z [2024-04-06 01:55:10,539: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:55:10.540376036Z [2024-04-06 01:55:10,540: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:55:10.540383722Z [2024-04-06 01:55:10,540: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:55:10.540593998Z [2024-04-06 01:55:10,540: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T01:55:10.540658794Z [2024-04-06 01:55:10,540: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:55:10.611988127Z [2024-04-06 01:55:10,611: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:55:11.210492365Z [2024-04-06 01:55:11,209: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b7208958-dcfb-4cf2-afa9-76c3e6f9f94d] succeeded in 2.0923080580014357s: None 2024-04-06T01:56:00.760972297Z [2024-04-06 01:56:00,760: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[94e8828d-3e80-4c2e-b9ef-5541d8149260] received 2024-04-06T01:56:00.772326163Z [2024-04-06 01:56:00,772: INFO/ForkPoolWorker-15] [94e8828d-3e80-4c2e-b9ef-5541d8149260] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T01:56:00.777371756Z [2024-04-06 01:56:00,777: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[47d4f023-acfe-4d2e-98af-b895b86e1510] received 2024-04-06T01:56:00.785335048Z [2024-04-06 01:56:00,785: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c53b8344-2c67-47f5-b8d6-e6b3ad6a638e] received 2024-04-06T01:56:00.786434869Z [2024-04-06 01:56:00,785: INFO/ForkPoolWorker-16] [47d4f023-acfe-4d2e-98af-b895b86e1510] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:56:00.803047535Z [2024-04-06 01:56:00,802: INFO/ForkPoolWorker-1] [c53b8344-2c67-47f5-b8d6-e6b3ad6a638e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:56:00.808085193Z [2024-04-06 01:56:00,807: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ac6b6d4b-b14b-4c51-8c5f-130e306149dc] received 2024-04-06T01:56:00.820638510Z [2024-04-06 01:56:00,820: INFO/ForkPoolWorker-2] [ac6b6d4b-b14b-4c51-8c5f-130e306149dc] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T01:56:01.139231537Z [2024-04-06 01:56:01,135: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:56:01.155712214Z [2024-04-06 01:56:01,152: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T01:56:01.266879724Z [2024-04-06 01:56:01,256: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:56:01.287697349Z [2024-04-06 01:56:01,283: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T01:56:01.318513508Z [2024-04-06 01:56:01,318: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-06T01:56:01.322514898Z [2024-04-06 01:56:01,322: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:56:01.357863030Z [2024-04-06 01:56:01,357: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T01:56:01.359482697Z [2024-04-06 01:56:01,359: INFO/ForkPoolWorker-2] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T01:56:01.359672762Z [2024-04-06 01:56:01,359: INFO/ForkPoolWorker-2] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T01:56:01.359820229Z [2024-04-06 01:56:01,359: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-06T01:56:01.360199355Z [2024-04-06 01:56:01,359: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T01:56:01.456199578Z [2024-04-06 01:56:01,455: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:56:01.621683147Z [2024-04-06 01:56:01,621: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:56:02.201608217Z [2024-04-06 01:56:02,201: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[ac6b6d4b-b14b-4c51-8c5f-130e306149dc] succeeded in 1.3909461599996575s: None 2024-04-06T01:56:02.499992019Z [2024-04-06 01:56:02,499: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[94e8828d-3e80-4c2e-b9ef-5541d8149260] succeeded in 1.7363927770002192s: None 2024-04-06T01:56:02.713075783Z [2024-04-06 01:56:02,712: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:56:02.719485803Z [2024-04-06 01:56:02,715: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:56:02.748875040Z [2024-04-06 01:56:02,748: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:56:02.752726280Z [2024-04-06 01:56:02,752: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:56:02.752755248Z [2024-04-06 01:56:02,752: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:56:02.752920601Z [2024-04-06 01:56:02,752: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:56:02.752960314Z [2024-04-06 01:56:02,752: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:56:02.753280040Z [2024-04-06 01:56:02,753: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:56:02.753337661Z [2024-04-06 01:56:02,753: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:56:02.810769591Z [2024-04-06 01:56:02,810: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T01:56:02.814030757Z [2024-04-06 01:56:02,813: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:56:02.837058286Z [2024-04-06 01:56:02,836: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T01:56:02.838578811Z [2024-04-06 01:56:02,838: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:56:02.838591832Z [2024-04-06 01:56:02,838: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:56:02.838717745Z [2024-04-06 01:56:02,838: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:56:02.838729666Z [2024-04-06 01:56:02,838: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T01:56:02.838946224Z [2024-04-06 01:56:02,838: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:56:02.838973136Z [2024-04-06 01:56:02,838: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:56:02.855077505Z [2024-04-06 01:56:02,854: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:56:02.919008196Z [2024-04-06 01:56:02,918: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:56:04.681740922Z [2024-04-06 01:56:04,681: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[47d4f023-acfe-4d2e-98af-b895b86e1510] succeeded in 3.9008433560011326s: None 2024-04-06T01:56:05.009968631Z [2024-04-06 01:56:05,009: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c53b8344-2c67-47f5-b8d6-e6b3ad6a638e] succeeded in 4.218123632999777s: None 2024-04-06T01:57:01.123241605Z [2024-04-06 01:57:01,122: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2029bf4d-9d9a-49ac-9add-013c7465aaa3] received 2024-04-06T01:57:01.130337966Z [2024-04-06 01:57:01,130: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8ed67f94-14cf-4103-910d-7c35de90b9c8] received 2024-04-06T01:57:01.132368686Z [2024-04-06 01:57:01,132: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4bdcd611-a8b4-4c89-9018-bc0e3ed681e9] received 2024-04-06T01:57:01.136522597Z [2024-04-06 01:57:01,136: INFO/ForkPoolWorker-15] [2029bf4d-9d9a-49ac-9add-013c7465aaa3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:57:01.142196766Z [2024-04-06 01:57:01,141: INFO/ForkPoolWorker-1] [4bdcd611-a8b4-4c89-9018-bc0e3ed681e9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:57:01.146248344Z [2024-04-06 01:57:01,145: INFO/ForkPoolWorker-16] [8ed67f94-14cf-4103-910d-7c35de90b9c8] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T01:57:01.452446225Z [2024-04-06 01:57:01,448: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:57:01.458944832Z [2024-04-06 01:57:01,454: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T01:57:01.493257391Z [2024-04-06 01:57:01,490: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:57:01.628175917Z [2024-04-06 01:57:01,627: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-06T01:57:01.632402604Z [2024-04-06 01:57:01,631: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:57:01.652840409Z [2024-04-06 01:57:01,652: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:57:01.654063370Z [2024-04-06 01:57:01,653: INFO/ForkPoolWorker-16] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T01:57:01.654217341Z [2024-04-06 01:57:01,654: INFO/ForkPoolWorker-16] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T01:57:01.654325731Z [2024-04-06 01:57:01,654: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-06T01:57:01.654566984Z [2024-04-06 01:57:01,654: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T01:57:01.760275142Z [2024-04-06 01:57:01,759: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:57:02.297394363Z [2024-04-06 01:57:02,296: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8ed67f94-14cf-4103-910d-7c35de90b9c8] succeeded in 1.1615811650008254s: None 2024-04-06T01:57:02.652215647Z [2024-04-06 01:57:02,651: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:57:02.655971628Z [2024-04-06 01:57:02,655: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:57:02.677326009Z [2024-04-06 01:57:02,677: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:57:02.679769936Z [2024-04-06 01:57:02,679: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:57:02.679794280Z [2024-04-06 01:57:02,679: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:57:02.679937996Z [2024-04-06 01:57:02,679: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:57:02.679950266Z [2024-04-06 01:57:02,679: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:57:02.680211860Z [2024-04-06 01:57:02,680: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:57:02.680233349Z [2024-04-06 01:57:02,680: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:57:02.719436548Z [2024-04-06 01:57:02,715: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T01:57:02.719462318Z [2024-04-06 01:57:02,718: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:57:02.741649952Z [2024-04-06 01:57:02,741: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T01:57:02.743084970Z [2024-04-06 01:57:02,742: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:57:02.743095302Z [2024-04-06 01:57:02,743: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:57:02.743476354Z [2024-04-06 01:57:02,743: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:57:02.743570164Z [2024-04-06 01:57:02,743: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T01:57:02.744593217Z [2024-04-06 01:57:02,744: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:57:02.744909868Z [2024-04-06 01:57:02,744: INFO/ForkPoolWorker-1] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:57:02.779307792Z [2024-04-06 01:57:02,778: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:57:02.838886125Z [2024-04-06 01:57:02,838: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:57:04.726857656Z [2024-04-06 01:57:04,719: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4bdcd611-a8b4-4c89-9018-bc0e3ed681e9] succeeded in 3.582808240000304s: None 2024-04-06T01:57:05.052046501Z [2024-04-06 01:57:05,051: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2029bf4d-9d9a-49ac-9add-013c7465aaa3] succeeded in 3.926073095999527s: None 2024-04-06T01:58:00.281532244Z [2024-04-06 01:58:00,281: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e78f8ac4-bea3-4e6e-b0e9-5ae4c2596a25] received 2024-04-06T01:58:00.285013753Z [2024-04-06 01:58:00,284: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[383c67a5-b4ca-49b5-b390-eacd96572754] received 2024-04-06T01:58:00.288213435Z [2024-04-06 01:58:00,287: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3c99bbe7-affe-4106-9c03-da566cf27cc4] received 2024-04-06T01:58:00.289312548Z [2024-04-06 01:58:00,289: INFO/ForkPoolWorker-15] [e78f8ac4-bea3-4e6e-b0e9-5ae4c2596a25] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:58:00.291478424Z [2024-04-06 01:58:00,291: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[96d86aad-f94c-40b0-b339-43af93eb8bf6] received 2024-04-06T01:58:00.291522972Z [2024-04-06 01:58:00,291: INFO/ForkPoolWorker-16] [383c67a5-b4ca-49b5-b390-eacd96572754] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T01:58:00.299116417Z [2024-04-06 01:58:00,298: INFO/ForkPoolWorker-2] [96d86aad-f94c-40b0-b339-43af93eb8bf6] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T01:58:00.301198482Z [2024-04-06 01:58:00,300: INFO/ForkPoolWorker-1] [3c99bbe7-affe-4106-9c03-da566cf27cc4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:58:00.602091235Z [2024-04-06 01:58:00,585: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:58:00.629887625Z [2024-04-06 01:58:00,626: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T01:58:00.699046933Z [2024-04-06 01:58:00,695: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T01:58:00.723087608Z [2024-04-06 01:58:00,709: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:58:00.899827082Z [2024-04-06 01:58:00,899: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:58:00.924144840Z [2024-04-06 01:58:00,923: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-06T01:58:00.930026072Z [2024-04-06 01:58:00,929: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:58:00.957867331Z [2024-04-06 01:58:00,957: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T01:58:00.959088827Z [2024-04-06 01:58:00,958: INFO/ForkPoolWorker-2] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T01:58:00.959314559Z [2024-04-06 01:58:00,959: INFO/ForkPoolWorker-2] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T01:58:00.959463463Z [2024-04-06 01:58:00,959: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-06T01:58:00.960077098Z [2024-04-06 01:58:00,959: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T01:58:01.074149917Z [2024-04-06 01:58:01,073: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:58:01.479928649Z [2024-04-06 01:58:01,466: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[383c67a5-b4ca-49b5-b390-eacd96572754] succeeded in 1.1799217210009374s: None 2024-04-06T01:58:01.700549778Z [2024-04-06 01:58:01,700: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[96d86aad-f94c-40b0-b339-43af93eb8bf6] succeeded in 1.407200626001213s: None 2024-04-06T01:58:01.850616931Z [2024-04-06 01:58:01,850: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:58:01.853939363Z [2024-04-06 01:58:01,853: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:58:01.880050258Z [2024-04-06 01:58:01,879: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:58:01.881417197Z [2024-04-06 01:58:01,881: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:58:01.881439200Z [2024-04-06 01:58:01,881: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:58:01.881606548Z [2024-04-06 01:58:01,881: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:58:01.881646373Z [2024-04-06 01:58:01,881: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:58:01.881913627Z [2024-04-06 01:58:01,881: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:58:01.881957443Z [2024-04-06 01:58:01,881: INFO/ForkPoolWorker-15] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:58:01.953568528Z [2024-04-06 01:58:01,953: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:58:01.987860280Z [2024-04-06 01:58:01,987: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T01:58:01.991089023Z [2024-04-06 01:58:01,990: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:58:02.019454680Z [2024-04-06 01:58:02,019: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T01:58:02.020724245Z [2024-04-06 01:58:02,020: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:58:02.020738848Z [2024-04-06 01:58:02,020: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:58:02.020857780Z [2024-04-06 01:58:02,020: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:58:02.020906307Z [2024-04-06 01:58:02,020: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T01:58:02.021105688Z [2024-04-06 01:58:02,020: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:58:02.021120668Z [2024-04-06 01:58:02,021: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:58:02.134865944Z [2024-04-06 01:58:02,134: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:58:03.799967961Z [2024-04-06 01:58:03,799: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e78f8ac4-bea3-4e6e-b0e9-5ae4c2596a25] succeeded in 3.516605744000117s: None 2024-04-06T01:58:05.862720008Z [2024-04-06 01:58:05,861: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3c99bbe7-affe-4106-9c03-da566cf27cc4] succeeded in 5.571617924000748s: None 2024-04-06T01:59:00.379728667Z [2024-04-06 01:59:00,379: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[db874af4-81b8-455a-850c-c5b565c48be7] received 2024-04-06T01:59:00.382958157Z [2024-04-06 01:59:00,382: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[90f420eb-614c-48c3-86ee-17584412b63e] received 2024-04-06T01:59:00.384514063Z [2024-04-06 01:59:00,384: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[43d59990-3312-47c4-a8ad-a80a1e61d34d] received 2024-04-06T01:59:00.387423760Z [2024-04-06 01:59:00,387: INFO/ForkPoolWorker-15] [db874af4-81b8-455a-850c-c5b565c48be7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:59:00.407039205Z [2024-04-06 01:59:00,406: INFO/ForkPoolWorker-16] [90f420eb-614c-48c3-86ee-17584412b63e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:59:00.407914952Z [2024-04-06 01:59:00,407: INFO/ForkPoolWorker-1] [43d59990-3312-47c4-a8ad-a80a1e61d34d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T01:59:00.679724766Z [2024-04-06 01:59:00,676: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T01:59:00.694255905Z [2024-04-06 01:59:00,690: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T01:59:00.750756792Z [2024-04-06 01:59:00,746: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T01:59:00.918419608Z [2024-04-06 01:59:00,917: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-06T01:59:00.924213584Z [2024-04-06 01:59:00,923: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:59:00.952796567Z [2024-04-06 01:59:00,952: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T01:59:00.953966275Z [2024-04-06 01:59:00,953: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T01:59:00.954164350Z [2024-04-06 01:59:00,953: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T01:59:00.954302798Z [2024-04-06 01:59:00,954: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-06T01:59:00.954593933Z [2024-04-06 01:59:00,954: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T01:59:01.063419563Z [2024-04-06 01:59:01,063: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:59:01.753462297Z [2024-04-06 01:59:01,752: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[43d59990-3312-47c4-a8ad-a80a1e61d34d] succeeded in 1.3642504930012365s: None 2024-04-06T01:59:01.910842137Z [2024-04-06 01:59:01,910: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T01:59:01.914591424Z [2024-04-06 01:59:01,913: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:59:01.949964555Z [2024-04-06 01:59:01,949: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T01:59:01.953872224Z [2024-04-06 01:59:01,953: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T01:59:01.954935019Z [2024-04-06 01:59:01,954: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T01:59:01.957264836Z [2024-04-06 01:59:01,956: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:59:01.957284672Z [2024-04-06 01:59:01,957: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:59:01.957565132Z [2024-04-06 01:59:01,957: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:59:01.957790233Z [2024-04-06 01:59:01,957: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T01:59:01.958411192Z [2024-04-06 01:59:01,958: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T01:59:01.958635311Z [2024-04-06 01:59:01,958: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:59:01.978058905Z [2024-04-06 01:59:01,977: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T01:59:01.979979606Z [2024-04-06 01:59:01,979: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T01:59:01.980002870Z [2024-04-06 01:59:01,979: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T01:59:01.980162949Z [2024-04-06 01:59:01,979: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T01:59:01.980264464Z [2024-04-06 01:59:01,980: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T01:59:01.980610160Z [2024-04-06 01:59:01,980: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T01:59:01.980621582Z [2024-04-06 01:59:01,980: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T01:59:02.055562866Z [2024-04-06 01:59:02,055: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:59:02.085586696Z [2024-04-06 01:59:02,085: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T01:59:03.579599420Z [2024-04-06 01:59:03,579: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[90f420eb-614c-48c3-86ee-17584412b63e] succeeded in 3.194314223001129s: None 2024-04-06T01:59:04.001107157Z [2024-04-06 01:59:04,000: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[db874af4-81b8-455a-850c-c5b565c48be7] succeeded in 3.6195118360010383s: None 2024-04-06T02:00:01.069456225Z [2024-04-06 02:00:01,068: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4649c245-0bcf-4eef-a7d0-7d3a946a9517] received 2024-04-06T02:00:01.074005713Z [2024-04-06 02:00:01,073: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2b5e1391-d458-4985-a089-6ffeb773a6cd] received 2024-04-06T02:00:01.079104471Z [2024-04-06 02:00:01,078: INFO/ForkPoolWorker-15] [4649c245-0bcf-4eef-a7d0-7d3a946a9517] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:00:01.084628247Z [2024-04-06 02:00:01,084: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e6db253b-ffcf-4297-bbe1-119180a8bc81] received 2024-04-06T02:00:01.090817785Z [2024-04-06 02:00:01,090: INFO/ForkPoolWorker-16] [2b5e1391-d458-4985-a089-6ffeb773a6cd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:00:01.092102330Z [2024-04-06 02:00:01,091: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[23d210a7-afcb-43fe-a023-06ab42a6ef64] received 2024-04-06T02:00:01.094171755Z [2024-04-06 02:00:01,093: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3bb3a574-e8f3-424a-a56a-2b55d341c663] received 2024-04-06T02:00:01.099754744Z [2024-04-06 02:00:01,099: INFO/ForkPoolWorker-1] [e6db253b-ffcf-4297-bbe1-119180a8bc81] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T02:00:01.109616184Z [2024-04-06 02:00:01,109: INFO/ForkPoolWorker-2] [23d210a7-afcb-43fe-a023-06ab42a6ef64] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:00:01.124676004Z [2024-04-06 02:00:01,124: INFO/ForkPoolWorker-3] [3bb3a574-e8f3-424a-a56a-2b55d341c663] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T02:00:01.515002744Z [2024-04-06 02:00:01,510: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:00:01.515473823Z [2024-04-06 02:00:01,511: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T02:00:01.562182347Z [2024-04-06 02:00:01,557: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:00:01.666520051Z [2024-04-06 02:00:01,662: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T02:00:01.798646260Z [2024-04-06 02:00:01,798: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:00:01.842992114Z [2024-04-06 02:00:01,822: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:00:01.972558845Z [2024-04-06 02:00:01,971: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-06T02:00:01.978582579Z [2024-04-06 02:00:01,977: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:00:02.022228397Z [2024-04-06 02:00:02,021: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T02:00:02.024366659Z [2024-04-06 02:00:02,024: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T02:00:02.024478748Z [2024-04-06 02:00:02,024: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T02:00:02.024569921Z [2024-04-06 02:00:02,024: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-06T02:00:02.024874462Z [2024-04-06 02:00:02,024: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T02:00:02.226557543Z [2024-04-06 02:00:02,226: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:00:02.585913577Z [2024-04-06 02:00:02,585: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[3bb3a574-e8f3-424a-a56a-2b55d341c663] succeeded in 1.476623174999986s: None 2024-04-06T02:00:02.993206687Z [2024-04-06 02:00:02,992: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e6db253b-ffcf-4297-bbe1-119180a8bc81] succeeded in 1.9057189530012693s: None 2024-04-06T02:00:03.274409847Z [2024-04-06 02:00:03,274: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-06T02:00:03.277989915Z [2024-04-06 02:00:03,277: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:00:03.316264107Z [2024-04-06 02:00:03,316: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T02:00:03.318074823Z [2024-04-06 02:00:03,317: INFO/ForkPoolWorker-2] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:00:03.318276840Z [2024-04-06 02:00:03,318: INFO/ForkPoolWorker-2] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:00:03.318517115Z [2024-04-06 02:00:03,318: INFO/ForkPoolWorker-2] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:00:03.318650540Z [2024-04-06 02:00:03,318: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-06T02:00:03.319011026Z [2024-04-06 02:00:03,318: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:00:03.319151792Z [2024-04-06 02:00:03,319: INFO/ForkPoolWorker-2] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:00:03.411159259Z [2024-04-06 02:00:03,410: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:00:03.466449947Z [2024-04-06 02:00:03,465: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:00:03.470043361Z [2024-04-06 02:00:03,469: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:00:03.501955825Z [2024-04-06 02:00:03,501: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:00:03.504603783Z [2024-04-06 02:00:03,504: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:00:03.504771469Z [2024-04-06 02:00:03,504: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:00:03.505057259Z [2024-04-06 02:00:03,504: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:00:03.505280991Z [2024-04-06 02:00:03,505: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:00:03.505682898Z [2024-04-06 02:00:03,505: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:00:03.505850790Z [2024-04-06 02:00:03,505: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:00:03.600177470Z [2024-04-06 02:00:03,599: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:00:03.603802083Z [2024-04-06 02:00:03,603: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:00:03.616874442Z [2024-04-06 02:00:03,616: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:00:03.632120651Z [2024-04-06 02:00:03,631: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:00:03.635640767Z [2024-04-06 02:00:03,634: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:00:03.636598359Z [2024-04-06 02:00:03,635: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:00:03.636896286Z [2024-04-06 02:00:03,636: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:00:03.636999932Z [2024-04-06 02:00:03,636: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:00:03.637522287Z [2024-04-06 02:00:03,637: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:00:03.637685901Z [2024-04-06 02:00:03,637: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:00:03.828968344Z [2024-04-06 02:00:03,828: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:00:04.143092965Z [2024-04-06 02:00:04,142: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[23cabb22-7ce0-4200-989f-b35c6fffda29] received 2024-04-06T02:00:04.158393694Z [2024-04-06 02:00:04,157: INFO/ForkPoolWorker-1] [23cabb22-7ce0-4200-989f-b35c6fffda29] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'split_metrics', 'scheduled__2024-04-06T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:00:04.274676097Z [2024-04-06 02:00:04,274: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[23d210a7-afcb-43fe-a023-06ab42a6ef64] succeeded in 3.177134637000563s: None 2024-04-06T02:00:04.665937739Z [2024-04-06 02:00:04,662: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:00:05.444003358Z [2024-04-06 02:00:05,443: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2b5e1391-d458-4985-a089-6ffeb773a6cd] succeeded in 4.365612934001547s: None 2024-04-06T02:00:05.828931769Z [2024-04-06 02:00:05,828: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T02:00:05.832409040Z [2024-04-06 02:00:05,831: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:00:05.855869095Z [2024-04-06 02:00:05,855: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T02:00:05.857352741Z [2024-04-06 02:00:05,857: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:00:05.857445025Z [2024-04-06 02:00:05,857: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:00:05.857718702Z [2024-04-06 02:00:05,857: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:00:05.857847177Z [2024-04-06 02:00:05,857: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T02:00:05.858130408Z [2024-04-06 02:00:05,858: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:00:05.858248008Z [2024-04-06 02:00:05,858: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:00:05.868889455Z [2024-04-06 02:00:05,868: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4649c245-0bcf-4eef-a7d0-7d3a946a9517] succeeded in 4.795738553999399s: None 2024-04-06T02:00:05.951095671Z [2024-04-06 02:00:05,950: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:00:06.700924045Z [2024-04-06 02:00:06,700: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[23cabb22-7ce0-4200-989f-b35c6fffda29] succeeded in 2.5542374159995234s: None 2024-04-06T02:00:06.778487590Z [2024-04-06 02:00:06,776: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4b6a1f2f-3e77-457e-be14-1d07c7ef79be] received 2024-04-06T02:00:06.813636648Z [2024-04-06 02:00:06,813: INFO/ForkPoolWorker-15] [4b6a1f2f-3e77-457e-be14-1d07c7ef79be] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'collect_metrics', 'scheduled__2024-04-06T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T02:00:07.134700234Z [2024-04-06 02:00:07,131: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:00:08.236878586Z [2024-04-06 02:00:08,236: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:00:08.239897039Z [2024-04-06 02:00:08,239: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:00:08.269490861Z [2024-04-06 02:00:08,269: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:00:08.271914540Z [2024-04-06 02:00:08,271: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:00:08.271940177Z [2024-04-06 02:00:08,271: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:00:08.272158487Z [2024-04-06 02:00:08,271: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:00:08.272197517Z [2024-04-06 02:00:08,272: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:00:08.272541091Z [2024-04-06 02:00:08,272: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:00:08.272550667Z [2024-04-06 02:00:08,272: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:00:08.388266278Z [2024-04-06 02:00:08,387: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:00:10.020477398Z [2024-04-06 02:00:10,020: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4b6a1f2f-3e77-457e-be14-1d07c7ef79be] succeeded in 3.23917708999943s: None 2024-04-06T02:00:10.300918651Z [2024-04-06 02:00:10,300: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fee54b67-0429-408e-9858-2f9a41838295] received 2024-04-06T02:00:10.308000899Z [2024-04-06 02:00:10,307: INFO/ForkPoolWorker-15] [fee54b67-0429-408e-9858-2f9a41838295] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'send_prometheus', 'scheduled__2024-04-06T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:00:10.662139637Z [2024-04-06 02:00:10,658: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:00:11.726610939Z [2024-04-06 02:00:11,726: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:00:11.729787091Z [2024-04-06 02:00:11,729: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:00:11.753899981Z [2024-04-06 02:00:11,753: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:00:11.755288891Z [2024-04-06 02:00:11,754: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:00:11.755331542Z [2024-04-06 02:00:11,755: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:00:11.755474172Z [2024-04-06 02:00:11,755: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:00:11.755501485Z [2024-04-06 02:00:11,755: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:00:11.755809466Z [2024-04-06 02:00:11,755: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:00:11.755839317Z [2024-04-06 02:00:11,755: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:00:11.859314890Z [2024-04-06 02:00:11,858: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:00:12.420391530Z [2024-04-06 02:00:12,419: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fee54b67-0429-408e-9858-2f9a41838295] succeeded in 2.117686440000398s: None 2024-04-06T02:01:01.124782956Z [2024-04-06 02:01:01,124: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[98c4c2b3-65d8-44b0-80dc-2c79db0ee019] received 2024-04-06T02:01:01.131120009Z [2024-04-06 02:01:01,130: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6782a720-4ed2-4aa0-9609-f6949b73e101] received 2024-04-06T02:01:01.135085341Z [2024-04-06 02:01:01,134: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0eb7f3b3-d1c0-4bf7-886a-e925106f05d1] received 2024-04-06T02:01:01.144189343Z [2024-04-06 02:01:01,143: INFO/ForkPoolWorker-1] [0eb7f3b3-d1c0-4bf7-886a-e925106f05d1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:01:01.144744084Z [2024-04-06 02:01:01,144: INFO/ForkPoolWorker-16] [6782a720-4ed2-4aa0-9609-f6949b73e101] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:01:01.145172605Z [2024-04-06 02:01:01,144: INFO/ForkPoolWorker-15] [98c4c2b3-65d8-44b0-80dc-2c79db0ee019] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T02:01:01.435337532Z [2024-04-06 02:01:01,432: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:01:01.437137286Z [2024-04-06 02:01:01,433: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T02:01:01.462612911Z [2024-04-06 02:01:01,459: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:01:01.601608078Z [2024-04-06 02:01:01,601: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-06T02:01:01.605516964Z [2024-04-06 02:01:01,605: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:01:01.633839396Z [2024-04-06 02:01:01,633: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:01:01.635094327Z [2024-04-06 02:01:01,634: INFO/ForkPoolWorker-15] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T02:01:01.635223607Z [2024-04-06 02:01:01,635: INFO/ForkPoolWorker-15] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T02:01:01.635532161Z [2024-04-06 02:01:01,635: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-06T02:01:01.635789345Z [2024-04-06 02:01:01,635: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T02:01:01.748643715Z [2024-04-06 02:01:01,748: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:01:02.408399521Z [2024-04-06 02:01:02,407: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[98c4c2b3-65d8-44b0-80dc-2c79db0ee019] succeeded in 1.2723264229989582s: None 2024-04-06T02:01:02.628553610Z [2024-04-06 02:01:02,628: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:01:02.632146323Z [2024-04-06 02:01:02,631: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:01:02.657812378Z [2024-04-06 02:01:02,657: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:01:02.660861735Z [2024-04-06 02:01:02,660: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:01:02.660911183Z [2024-04-06 02:01:02,660: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:01:02.661147034Z [2024-04-06 02:01:02,660: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:01:02.661303620Z [2024-04-06 02:01:02,661: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:01:02.661672392Z [2024-04-06 02:01:02,661: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:01:02.661815423Z [2024-04-06 02:01:02,661: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:01:02.749638019Z [2024-04-06 02:01:02,749: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:01:02.796755142Z [2024-04-06 02:01:02,796: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T02:01:02.800257418Z [2024-04-06 02:01:02,799: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:01:02.820424599Z [2024-04-06 02:01:02,820: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T02:01:02.821933075Z [2024-04-06 02:01:02,821: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:01:02.822032971Z [2024-04-06 02:01:02,821: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:01:02.822242754Z [2024-04-06 02:01:02,822: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:01:02.822395536Z [2024-04-06 02:01:02,822: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T02:01:02.822820556Z [2024-04-06 02:01:02,822: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:01:02.822982003Z [2024-04-06 02:01:02,822: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:01:02.904752457Z [2024-04-06 02:01:02,904: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:01:04.272244524Z [2024-04-06 02:01:04,271: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6782a720-4ed2-4aa0-9609-f6949b73e101] succeeded in 3.1395945250005752s: None 2024-04-06T02:01:05.423171922Z [2024-04-06 02:01:05,422: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0eb7f3b3-d1c0-4bf7-886a-e925106f05d1] succeeded in 4.285905396000089s: None 2024-04-06T02:02:00.973008794Z [2024-04-06 02:02:00,972: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eda8ed3b-9b49-4104-9174-60ab1e8ace26] received 2024-04-06T02:02:00.979887533Z [2024-04-06 02:02:00,979: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a656946c-f984-4087-b9ac-6c3b76958354] received 2024-04-06T02:02:00.988827959Z [2024-04-06 02:02:00,988: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c384359b-058d-4a96-81f0-a360e3482dbb] received 2024-04-06T02:02:00.988867420Z [2024-04-06 02:02:00,988: INFO/ForkPoolWorker-15] [eda8ed3b-9b49-4104-9174-60ab1e8ace26] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T02:02:00.997097674Z [2024-04-06 02:02:00,996: INFO/ForkPoolWorker-1] [c384359b-058d-4a96-81f0-a360e3482dbb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:02:01.005259046Z [2024-04-06 02:02:01,005: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[762dcdd6-acac-4a78-8d5e-94217188cb95] received 2024-04-06T02:02:01.010093061Z [2024-04-06 02:02:01,009: INFO/ForkPoolWorker-16] [a656946c-f984-4087-b9ac-6c3b76958354] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:02:01.025680969Z [2024-04-06 02:02:01,025: INFO/ForkPoolWorker-2] [762dcdd6-acac-4a78-8d5e-94217188cb95] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T02:02:01.350127688Z [2024-04-06 02:02:01,347: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T02:02:01.372172865Z [2024-04-06 02:02:01,368: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:02:01.378964661Z [2024-04-06 02:02:01,375: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T02:02:01.572393364Z [2024-04-06 02:02:01,568: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:02:01.574356457Z [2024-04-06 02:02:01,573: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-06T02:02:01.578603438Z [2024-04-06 02:02:01,578: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:02:01.594727562Z [2024-04-06 02:02:01,594: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:02:01.620094026Z [2024-04-06 02:02:01,619: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T02:02:01.623142460Z [2024-04-06 02:02:01,622: INFO/ForkPoolWorker-2] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T02:02:01.623530975Z [2024-04-06 02:02:01,623: INFO/ForkPoolWorker-2] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T02:02:01.623704809Z [2024-04-06 02:02:01,623: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-06T02:02:01.623996713Z [2024-04-06 02:02:01,623: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T02:02:01.715163945Z [2024-04-06 02:02:01,714: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:02:02.238004958Z [2024-04-06 02:02:02,237: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[eda8ed3b-9b49-4104-9174-60ab1e8ace26] succeeded in 1.263539314000809s: None 2024-04-06T02:02:02.388511630Z [2024-04-06 02:02:02,388: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[762dcdd6-acac-4a78-8d5e-94217188cb95] succeeded in 1.3811145199997554s: None 2024-04-06T02:02:02.740424332Z [2024-04-06 02:02:02,740: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:02:02.744025216Z [2024-04-06 02:02:02,743: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:02:02.766444153Z [2024-04-06 02:02:02,766: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:02:02.768051429Z [2024-04-06 02:02:02,767: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:02:02.768268037Z [2024-04-06 02:02:02,768: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:02:02.768517204Z [2024-04-06 02:02:02,768: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:02:02.768612132Z [2024-04-06 02:02:02,768: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:02:02.769025582Z [2024-04-06 02:02:02,768: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:02:02.769172964Z [2024-04-06 02:02:02,769: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:02:02.805463522Z [2024-04-06 02:02:02,804: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T02:02:02.808715333Z [2024-04-06 02:02:02,808: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:02:02.832584046Z [2024-04-06 02:02:02,832: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T02:02:02.834815937Z [2024-04-06 02:02:02,834: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:02:02.834964883Z [2024-04-06 02:02:02,834: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:02:02.835158499Z [2024-04-06 02:02:02,834: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:02:02.835404206Z [2024-04-06 02:02:02,835: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T02:02:02.835869046Z [2024-04-06 02:02:02,835: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:02:02.835999273Z [2024-04-06 02:02:02,835: INFO/ForkPoolWorker-1] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:02:02.849125579Z [2024-04-06 02:02:02,848: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:02:02.919340930Z [2024-04-06 02:02:02,919: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:02:04.520028644Z [2024-04-06 02:02:04,519: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c384359b-058d-4a96-81f0-a360e3482dbb] succeeded in 3.5293098599995574s: None 2024-04-06T02:02:04.957638177Z [2024-04-06 02:02:04,957: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a656946c-f984-4087-b9ac-6c3b76958354] succeeded in 3.967310242998792s: None 2024-04-06T02:03:00.860543852Z [2024-04-06 02:03:00,860: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5a05906c-10a0-4952-b7ca-56e6b23cb22d] received 2024-04-06T02:03:00.872959821Z [2024-04-06 02:03:00,872: INFO/ForkPoolWorker-15] [5a05906c-10a0-4952-b7ca-56e6b23cb22d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T02:03:00.880105644Z [2024-04-06 02:03:00,879: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a0ae70c2-60aa-4040-99a8-e3ed883f1287] received 2024-04-06T02:03:00.881784972Z [2024-04-06 02:03:00,881: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[433c1705-adc6-4dae-9c40-0fe28371caab] received 2024-04-06T02:03:00.893643505Z [2024-04-06 02:03:00,893: INFO/ForkPoolWorker-16] [a0ae70c2-60aa-4040-99a8-e3ed883f1287] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:03:00.898620193Z [2024-04-06 02:03:00,898: INFO/ForkPoolWorker-1] [433c1705-adc6-4dae-9c40-0fe28371caab] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:03:01.185719981Z [2024-04-06 02:03:01,182: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T02:03:01.212363436Z [2024-04-06 02:03:01,209: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:03:01.226549325Z [2024-04-06 02:03:01,222: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:03:01.342110787Z [2024-04-06 02:03:01,341: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-06T02:03:01.346333005Z [2024-04-06 02:03:01,345: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:03:01.372915994Z [2024-04-06 02:03:01,372: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:03:01.374150818Z [2024-04-06 02:03:01,373: INFO/ForkPoolWorker-15] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T02:03:01.374418737Z [2024-04-06 02:03:01,374: INFO/ForkPoolWorker-15] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T02:03:01.374584625Z [2024-04-06 02:03:01,374: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-06T02:03:01.375030064Z [2024-04-06 02:03:01,374: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T02:03:01.459636474Z [2024-04-06 02:03:01,459: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:03:01.984953019Z [2024-04-06 02:03:01,984: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5a05906c-10a0-4952-b7ca-56e6b23cb22d] succeeded in 1.1210279909992096s: None 2024-04-06T02:03:02.447034345Z [2024-04-06 02:03:02,446: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:03:02.450712782Z [2024-04-06 02:03:02,450: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:03:02.470201883Z [2024-04-06 02:03:02,469: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T02:03:02.475942039Z [2024-04-06 02:03:02,475: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:03:02.484319704Z [2024-04-06 02:03:02,484: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:03:02.485809234Z [2024-04-06 02:03:02,485: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:03:02.486035773Z [2024-04-06 02:03:02,485: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:03:02.486254254Z [2024-04-06 02:03:02,485: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:03:02.486421381Z [2024-04-06 02:03:02,486: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:03:02.486830814Z [2024-04-06 02:03:02,486: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:03:02.487411651Z [2024-04-06 02:03:02,486: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:03:02.503360254Z [2024-04-06 02:03:02,503: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T02:03:02.504707174Z [2024-04-06 02:03:02,504: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:03:02.504717608Z [2024-04-06 02:03:02,504: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:03:02.504926893Z [2024-04-06 02:03:02,504: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:03:02.504995923Z [2024-04-06 02:03:02,504: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T02:03:02.505265619Z [2024-04-06 02:03:02,505: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:03:02.505275942Z [2024-04-06 02:03:02,505: INFO/ForkPoolWorker-1] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:03:02.586511411Z [2024-04-06 02:03:02,586: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:03:02.608305643Z [2024-04-06 02:03:02,608: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:03:04.076220139Z [2024-04-06 02:03:04,075: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[433c1705-adc6-4dae-9c40-0fe28371caab] succeeded in 3.191263202999835s: None 2024-04-06T02:03:04.591746078Z [2024-04-06 02:03:04,591: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a0ae70c2-60aa-4040-99a8-e3ed883f1287] succeeded in 3.7083082890003425s: None 2024-04-06T02:04:01.189333362Z [2024-04-06 02:04:01,188: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b685ffb4-21e0-4e4b-9c92-16dedd47cb24] received 2024-04-06T02:04:01.197390623Z [2024-04-06 02:04:01,197: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[57e31de9-055e-48b5-a549-71c01dffc58e] received 2024-04-06T02:04:01.201630524Z [2024-04-06 02:04:01,201: INFO/ForkPoolWorker-15] [b685ffb4-21e0-4e4b-9c92-16dedd47cb24] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:04:01.202096338Z [2024-04-06 02:04:01,201: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ac3e4828-0e21-4170-ac7b-dbd8654ac1eb] received 2024-04-06T02:04:01.209948038Z [2024-04-06 02:04:01,209: INFO/ForkPoolWorker-16] [57e31de9-055e-48b5-a549-71c01dffc58e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T02:04:01.210259850Z [2024-04-06 02:04:01,210: INFO/ForkPoolWorker-1] [ac3e4828-0e21-4170-ac7b-dbd8654ac1eb] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T02:04:01.210312652Z [2024-04-06 02:04:01,210: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[80e868ed-76bd-4584-9e24-9f9a3d15a90b] received 2024-04-06T02:04:01.228049615Z [2024-04-06 02:04:01,227: INFO/ForkPoolWorker-2] [80e868ed-76bd-4584-9e24-9f9a3d15a90b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:04:01.616195361Z [2024-04-06 02:04:01,612: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:04:01.784234755Z [2024-04-06 02:04:01,780: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T02:04:01.851400376Z [2024-04-06 02:04:01,847: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:04:01.950572841Z [2024-04-06 02:04:01,950: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-06T02:04:01.952401515Z [2024-04-06 02:04:01,949: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T02:04:01.954873536Z [2024-04-06 02:04:01,954: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:04:02.007352739Z [2024-04-06 02:04:02,007: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:04:02.014567982Z [2024-04-06 02:04:02,014: INFO/ForkPoolWorker-16] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T02:04:02.014817247Z [2024-04-06 02:04:02,014: INFO/ForkPoolWorker-16] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T02:04:02.018172221Z [2024-04-06 02:04:02,014: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-06T02:04:02.018572584Z [2024-04-06 02:04:02,018: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T02:04:02.135674709Z [2024-04-06 02:04:02,135: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:04:02.294625269Z [2024-04-06 02:04:02,294: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:04:02.778318248Z [2024-04-06 02:04:02,777: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[57e31de9-055e-48b5-a549-71c01dffc58e] succeeded in 1.577574741000717s: None 2024-04-06T02:04:02.940879712Z [2024-04-06 02:04:02,940: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ac3e4828-0e21-4170-ac7b-dbd8654ac1eb] succeeded in 1.737050754001757s: None 2024-04-06T02:04:03.227230893Z [2024-04-06 02:04:03,226: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-06T02:04:03.230990675Z [2024-04-06 02:04:03,230: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:04:03.257244727Z [2024-04-06 02:04:03,256: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T02:04:03.260169644Z [2024-04-06 02:04:03,259: INFO/ForkPoolWorker-2] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:04:03.260716482Z [2024-04-06 02:04:03,260: INFO/ForkPoolWorker-2] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:04:03.261129793Z [2024-04-06 02:04:03,260: INFO/ForkPoolWorker-2] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:04:03.261369100Z [2024-04-06 02:04:03,261: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-06T02:04:03.263196728Z [2024-04-06 02:04:03,261: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:04:03.263507965Z [2024-04-06 02:04:03,263: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:04:03.392935107Z [2024-04-06 02:04:03,392: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:04:03.464515654Z [2024-04-06 02:04:03,464: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:04:03.467873470Z [2024-04-06 02:04:03,467: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:04:03.489866303Z [2024-04-06 02:04:03,489: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:04:03.491986486Z [2024-04-06 02:04:03,491: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:04:03.492000314Z [2024-04-06 02:04:03,491: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:04:03.492004376Z [2024-04-06 02:04:03,491: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:04:03.492008051Z [2024-04-06 02:04:03,491: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:04:03.492317223Z [2024-04-06 02:04:03,492: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:04:03.492829893Z [2024-04-06 02:04:03,492: INFO/ForkPoolWorker-15] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:04:03.578044337Z [2024-04-06 02:04:03,577: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:04:05.827183757Z [2024-04-06 02:04:05,826: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[80e868ed-76bd-4584-9e24-9f9a3d15a90b] succeeded in 4.614352131999112s: None 2024-04-06T02:04:06.106968654Z [2024-04-06 02:04:06,106: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b685ffb4-21e0-4e4b-9c92-16dedd47cb24] succeeded in 4.912234909999825s: None 2024-04-06T02:05:01.190571394Z [2024-04-06 02:05:01,190: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cc04d036-1036-44eb-bd8b-e9821c13fb64] received 2024-04-06T02:05:01.199982208Z [2024-04-06 02:05:01,199: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2fa479b0-1476-41c0-bf5b-b732f1633dbe] received 2024-04-06T02:05:01.207593399Z [2024-04-06 02:05:01,207: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e87c37d9-92ab-4429-884b-c931858b8f78] received 2024-04-06T02:05:01.213509278Z [2024-04-06 02:05:01,213: INFO/ForkPoolWorker-16] [2fa479b0-1476-41c0-bf5b-b732f1633dbe] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:05:01.218936059Z [2024-04-06 02:05:01,218: INFO/ForkPoolWorker-15] [cc04d036-1036-44eb-bd8b-e9821c13fb64] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:05:01.220408037Z [2024-04-06 02:05:01,219: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[15e90608-8cf0-4430-b29c-01d266f943e5] received 2024-04-06T02:05:01.226216108Z [2024-04-06 02:05:01,225: INFO/ForkPoolWorker-1] [e87c37d9-92ab-4429-884b-c931858b8f78] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T02:05:01.237108850Z [2024-04-06 02:05:01,236: INFO/ForkPoolWorker-2] [15e90608-8cf0-4430-b29c-01d266f943e5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:05:01.587956504Z [2024-04-06 02:05:01,582: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:05:01.654065205Z [2024-04-06 02:05:01,649: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:05:01.745729336Z [2024-04-06 02:05:01,742: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:05:01.967160517Z [2024-04-06 02:05:01,963: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T02:05:02.179966352Z [2024-04-06 02:05:02,179: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-06T02:05:02.184648243Z [2024-04-06 02:05:02,184: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:05:02.232927866Z [2024-04-06 02:05:02,232: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T02:05:02.234350193Z [2024-04-06 02:05:02,234: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T02:05:02.234391414Z [2024-04-06 02:05:02,234: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T02:05:02.234448961Z [2024-04-06 02:05:02,234: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-06T02:05:02.234683438Z [2024-04-06 02:05:02,234: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T02:05:02.350733993Z [2024-04-06 02:05:02,350: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:05:03.391911872Z [2024-04-06 02:05:03,391: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:05:03.395604294Z [2024-04-06 02:05:03,394: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:05:03.435467514Z [2024-04-06 02:05:03,432: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:05:03.440869947Z [2024-04-06 02:05:03,440: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:05:03.440917147Z [2024-04-06 02:05:03,440: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:05:03.441068734Z [2024-04-06 02:05:03,440: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:05:03.441144277Z [2024-04-06 02:05:03,441: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:05:03.441436163Z [2024-04-06 02:05:03,441: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:05:03.441449343Z [2024-04-06 02:05:03,441: INFO/ForkPoolWorker-15] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:05:03.500343517Z [2024-04-06 02:05:03,499: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e87c37d9-92ab-4429-884b-c931858b8f78] succeeded in 2.287955936000799s: None 2024-04-06T02:05:03.540517763Z [2024-04-06 02:05:03,540: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:05:03.569665747Z [2024-04-06 02:05:03,569: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:05:03.573520988Z [2024-04-06 02:05:03,572: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:05:03.616675513Z [2024-04-06 02:05:03,616: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:05:03.620994621Z [2024-04-06 02:05:03,620: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:05:03.621355640Z [2024-04-06 02:05:03,620: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:05:03.621727163Z [2024-04-06 02:05:03,621: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:05:03.621897958Z [2024-04-06 02:05:03,621: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:05:03.622439931Z [2024-04-06 02:05:03,622: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:05:03.623036105Z [2024-04-06 02:05:03,622: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:05:03.821642754Z [2024-04-06 02:05:03,821: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:05:03.857637981Z [2024-04-06 02:05:03,857: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-06T02:05:03.862065688Z [2024-04-06 02:05:03,861: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:05:03.893687681Z [2024-04-06 02:05:03,893: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T02:05:03.896015408Z [2024-04-06 02:05:03,895: INFO/ForkPoolWorker-2] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:05:03.896187241Z [2024-04-06 02:05:03,895: INFO/ForkPoolWorker-2] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:05:03.896387861Z [2024-04-06 02:05:03,896: INFO/ForkPoolWorker-2] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:05:03.896517810Z [2024-04-06 02:05:03,896: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-06T02:05:03.896837313Z [2024-04-06 02:05:03,896: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:05:03.896964335Z [2024-04-06 02:05:03,896: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:05:03.999987868Z [2024-04-06 02:05:03,999: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:05:04.604221962Z [2024-04-06 02:05:04,603: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2fa479b0-1476-41c0-bf5b-b732f1633dbe] succeeded in 3.398878195999714s: None 2024-04-06T02:05:05.000157917Z [2024-04-06 02:05:04,999: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9cf8c24b-bb49-4f07-bd7a-b4a3d3db6c98] received 2024-04-06T02:05:05.013735303Z [2024-04-06 02:05:05,013: INFO/ForkPoolWorker-16] [9cf8c24b-bb49-4f07-bd7a-b4a3d3db6c98] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'split_metrics', 'scheduled__2024-04-06T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:05:05.288738532Z [2024-04-06 02:05:05,288: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cc04d036-1036-44eb-bd8b-e9821c13fb64] succeeded in 4.08676968600048s: None 2024-04-06T02:05:05.369176786Z [2024-04-06 02:05:05,365: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:05:06.080986177Z [2024-04-06 02:05:06,080: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[15e90608-8cf0-4430-b29c-01d266f943e5] succeeded in 4.858059299998786s: None 2024-04-06T02:05:06.536127654Z [2024-04-06 02:05:06,535: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:05:06.539924593Z [2024-04-06 02:05:06,539: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:05:06.568568701Z [2024-04-06 02:05:06,568: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:05:06.570441516Z [2024-04-06 02:05:06,569: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:05:06.570511777Z [2024-04-06 02:05:06,570: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:05:06.570537365Z [2024-04-06 02:05:06,570: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:05:06.570570612Z [2024-04-06 02:05:06,570: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:05:06.570882358Z [2024-04-06 02:05:06,570: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:05:06.570902987Z [2024-04-06 02:05:06,570: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:05:06.657019894Z [2024-04-06 02:05:06,656: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:05:07.259440429Z [2024-04-06 02:05:07,258: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9cf8c24b-bb49-4f07-bd7a-b4a3d3db6c98] succeeded in 2.25410656799977s: None 2024-04-06T02:05:07.469670224Z [2024-04-06 02:05:07,469: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0abb46e4-5f81-4f31-898b-1b86988b1a5a] received 2024-04-06T02:05:07.477313154Z [2024-04-06 02:05:07,476: INFO/ForkPoolWorker-15] [0abb46e4-5f81-4f31-898b-1b86988b1a5a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'collect_metrics', 'scheduled__2024-04-06T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T02:05:07.776265565Z [2024-04-06 02:05:07,772: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:05:08.977618340Z [2024-04-06 02:05:08,977: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:05:08.981274779Z [2024-04-06 02:05:08,980: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:05:09.014252664Z [2024-04-06 02:05:09,013: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:05:09.015789152Z [2024-04-06 02:05:09,015: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:05:09.015804648Z [2024-04-06 02:05:09,015: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:05:09.015968521Z [2024-04-06 02:05:09,015: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:05:09.016023193Z [2024-04-06 02:05:09,015: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:05:09.016228584Z [2024-04-06 02:05:09,016: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:05:09.016262211Z [2024-04-06 02:05:09,016: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:05:09.153346483Z [2024-04-06 02:05:09,152: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:05:10.667433930Z [2024-04-06 02:05:10,666: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0abb46e4-5f81-4f31-898b-1b86988b1a5a] succeeded in 3.1957572880000953s: None 2024-04-06T02:05:11.348982903Z [2024-04-06 02:05:11,348: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2a4a1671-044a-44c6-8511-eb753a20c567] received 2024-04-06T02:05:11.360853842Z [2024-04-06 02:05:11,360: INFO/ForkPoolWorker-15] [2a4a1671-044a-44c6-8511-eb753a20c567] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'send_prometheus', 'scheduled__2024-04-06T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:05:11.655768034Z [2024-04-06 02:05:11,652: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:05:12.984544887Z [2024-04-06 02:05:12,983: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:05:12.987580406Z [2024-04-06 02:05:12,987: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:05:13.011930291Z [2024-04-06 02:05:13,011: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:05:13.013316402Z [2024-04-06 02:05:13,013: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:05:13.013389916Z [2024-04-06 02:05:13,013: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:05:13.013464390Z [2024-04-06 02:05:13,013: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:05:13.013493206Z [2024-04-06 02:05:13,013: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:05:13.013842684Z [2024-04-06 02:05:13,013: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:05:13.013901312Z [2024-04-06 02:05:13,013: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:05:13.089342142Z [2024-04-06 02:05:13,089: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:05:13.752052259Z [2024-04-06 02:05:13,750: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2a4a1671-044a-44c6-8511-eb753a20c567] succeeded in 2.3994607490003546s: None 2024-04-06T02:06:01.261493527Z [2024-04-06 02:06:01,261: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[46fd39d3-b349-47a0-af9f-5d44e909926b] received 2024-04-06T02:06:01.264355412Z [2024-04-06 02:06:01,264: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ca2d3695-61bd-4df9-82c5-6469f4a1e47a] received 2024-04-06T02:06:01.267942670Z [2024-04-06 02:06:01,267: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[218a8853-e29c-4a33-8f13-98b2e9e48b43] received 2024-04-06T02:06:01.269924861Z [2024-04-06 02:06:01,269: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ae006d2a-3748-44e4-a392-ac825ef6279f] received 2024-04-06T02:06:01.274493098Z [2024-04-06 02:06:01,274: INFO/ForkPoolWorker-15] [46fd39d3-b349-47a0-af9f-5d44e909926b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T02:06:01.278966652Z [2024-04-06 02:06:01,278: INFO/ForkPoolWorker-2] [ae006d2a-3748-44e4-a392-ac825ef6279f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T02:06:01.288690218Z [2024-04-06 02:06:01,287: INFO/ForkPoolWorker-1] [218a8853-e29c-4a33-8f13-98b2e9e48b43] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:06:01.289503871Z [2024-04-06 02:06:01,289: INFO/ForkPoolWorker-16] [ca2d3695-61bd-4df9-82c5-6469f4a1e47a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:06:01.606703566Z [2024-04-06 02:06:01,603: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:06:01.650623705Z [2024-04-06 02:06:01,645: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T02:06:01.740919065Z [2024-04-06 02:06:01,737: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T02:06:01.756098173Z [2024-04-06 02:06:01,753: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:06:01.854283224Z [2024-04-06 02:06:01,853: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-06T02:06:01.858951121Z [2024-04-06 02:06:01,858: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:06:01.886477118Z [2024-04-06 02:06:01,886: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T02:06:01.887810698Z [2024-04-06 02:06:01,887: INFO/ForkPoolWorker-2] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T02:06:01.888153881Z [2024-04-06 02:06:01,887: INFO/ForkPoolWorker-2] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T02:06:01.888212225Z [2024-04-06 02:06:01,888: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-06T02:06:01.889470886Z [2024-04-06 02:06:01,889: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T02:06:02.005128272Z [2024-04-06 02:06:02,004: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:06:02.077626903Z [2024-04-06 02:06:02,077: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:06:02.678206313Z [2024-04-06 02:06:02,677: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[46fd39d3-b349-47a0-af9f-5d44e909926b] succeeded in 1.4143770659993606s: None 2024-04-06T02:06:02.762023233Z [2024-04-06 02:06:02,761: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[ae006d2a-3748-44e4-a392-ac825ef6279f] succeeded in 1.4898212009993586s: None 2024-04-06T02:06:03.033815222Z [2024-04-06 02:06:03,033: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:06:03.037562525Z [2024-04-06 02:06:03,037: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:06:03.060597675Z [2024-04-06 02:06:03,060: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:06:03.062073594Z [2024-04-06 02:06:03,061: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:06:03.062150482Z [2024-04-06 02:06:03,062: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:06:03.062348976Z [2024-04-06 02:06:03,062: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:06:03.062430204Z [2024-04-06 02:06:03,062: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:06:03.062863840Z [2024-04-06 02:06:03,062: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:06:03.063187809Z [2024-04-06 02:06:03,063: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:06:03.077177226Z [2024-04-06 02:06:03,076: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T02:06:03.084479776Z [2024-04-06 02:06:03,083: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:06:03.114323672Z [2024-04-06 02:06:03,114: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T02:06:03.116868462Z [2024-04-06 02:06:03,116: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:06:03.116919081Z [2024-04-06 02:06:03,116: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:06:03.117090981Z [2024-04-06 02:06:03,116: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:06:03.117123379Z [2024-04-06 02:06:03,117: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T02:06:03.117531562Z [2024-04-06 02:06:03,117: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:06:03.117572094Z [2024-04-06 02:06:03,117: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:06:03.143911197Z [2024-04-06 02:06:03,143: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:06:03.218670307Z [2024-04-06 02:06:03,218: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:06:05.435395887Z [2024-04-06 02:06:05,434: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ca2d3695-61bd-4df9-82c5-6469f4a1e47a] succeeded in 4.168019294998885s: None 2024-04-06T02:06:06.098389619Z [2024-04-06 02:06:06,097: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[218a8853-e29c-4a33-8f13-98b2e9e48b43] succeeded in 4.827427337999325s: None 2024-04-06T02:07:01.047894795Z [2024-04-06 02:07:01,047: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0c301402-9567-4384-98e3-288902918fea] received 2024-04-06T02:07:01.049569662Z [2024-04-06 02:07:01,049: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4ba13bbf-6285-4c5e-a897-69546dc95e78] received 2024-04-06T02:07:01.058942881Z [2024-04-06 02:07:01,058: INFO/ForkPoolWorker-16] [4ba13bbf-6285-4c5e-a897-69546dc95e78] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:07:01.059010624Z [2024-04-06 02:07:01,058: INFO/ForkPoolWorker-15] [0c301402-9567-4384-98e3-288902918fea] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:07:01.059433212Z [2024-04-06 02:07:01,059: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8bb93a20-4f43-469e-aca4-d7149f35c0c5] received 2024-04-06T02:07:01.073210374Z [2024-04-06 02:07:01,072: INFO/ForkPoolWorker-1] [8bb93a20-4f43-469e-aca4-d7149f35c0c5] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T02:07:01.365718109Z [2024-04-06 02:07:01,362: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:07:01.405858563Z [2024-04-06 02:07:01,402: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T02:07:01.431024898Z [2024-04-06 02:07:01,427: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:07:01.588963171Z [2024-04-06 02:07:01,588: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-06T02:07:01.593215820Z [2024-04-06 02:07:01,592: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:07:01.623366974Z [2024-04-06 02:07:01,623: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T02:07:01.626490148Z [2024-04-06 02:07:01,626: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T02:07:01.626632855Z [2024-04-06 02:07:01,626: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T02:07:01.626757785Z [2024-04-06 02:07:01,626: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-06T02:07:01.627156928Z [2024-04-06 02:07:01,626: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T02:07:01.730533604Z [2024-04-06 02:07:01,730: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:07:02.375757424Z [2024-04-06 02:07:02,375: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8bb93a20-4f43-469e-aca4-d7149f35c0c5] succeeded in 1.3124870619994908s: None 2024-04-06T02:07:02.566164379Z [2024-04-06 02:07:02,565: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:07:02.569448618Z [2024-04-06 02:07:02,568: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:07:02.595508916Z [2024-04-06 02:07:02,595: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:07:02.597228662Z [2024-04-06 02:07:02,596: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:07:02.597246707Z [2024-04-06 02:07:02,597: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:07:02.597455980Z [2024-04-06 02:07:02,597: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:07:02.597552433Z [2024-04-06 02:07:02,597: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:07:02.598335172Z [2024-04-06 02:07:02,598: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:07:02.598472778Z [2024-04-06 02:07:02,598: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:07:02.658151744Z [2024-04-06 02:07:02,657: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:07:02.662177032Z [2024-04-06 02:07:02,661: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:07:02.688210268Z [2024-04-06 02:07:02,688: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:07:02.689735715Z [2024-04-06 02:07:02,689: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:07:02.689924622Z [2024-04-06 02:07:02,689: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:07:02.690151634Z [2024-04-06 02:07:02,689: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:07:02.690284647Z [2024-04-06 02:07:02,690: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:07:02.690680491Z [2024-04-06 02:07:02,690: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:07:02.690775455Z [2024-04-06 02:07:02,690: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:07:02.697716436Z [2024-04-06 02:07:02,697: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:07:02.790222569Z [2024-04-06 02:07:02,789: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:07:04.181134592Z [2024-04-06 02:07:04,180: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4ba13bbf-6285-4c5e-a897-69546dc95e78] succeeded in 3.1296871550002834s: None 2024-04-06T02:07:04.540217644Z [2024-04-06 02:07:04,539: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0c301402-9567-4384-98e3-288902918fea] succeeded in 3.4886670319992845s: None 2024-04-06T02:08:00.802546514Z [2024-04-06 02:08:00,801: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2fed21e4-ab9d-46c2-b2c5-ab1886f7ee28] received 2024-04-06T02:08:00.808943631Z [2024-04-06 02:08:00,808: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6d971240-ab5c-4762-8dcb-bc88d3d674c7] received 2024-04-06T02:08:00.818596432Z [2024-04-06 02:08:00,818: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[86cd7889-a550-4e71-863c-16259d7c4ebf] received 2024-04-06T02:08:00.820113310Z [2024-04-06 02:08:00,819: INFO/ForkPoolWorker-15] [2fed21e4-ab9d-46c2-b2c5-ab1886f7ee28] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:08:00.821746912Z [2024-04-06 02:08:00,821: INFO/ForkPoolWorker-16] [6d971240-ab5c-4762-8dcb-bc88d3d674c7] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T02:08:00.827187671Z [2024-04-06 02:08:00,826: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9a81b963-9cb7-45c0-abbb-45ad122280a8] received 2024-04-06T02:08:00.838933687Z [2024-04-06 02:08:00,838: INFO/ForkPoolWorker-1] [86cd7889-a550-4e71-863c-16259d7c4ebf] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T02:08:00.847237501Z [2024-04-06 02:08:00,846: INFO/ForkPoolWorker-2] [9a81b963-9cb7-45c0-abbb-45ad122280a8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:08:01.209665221Z [2024-04-06 02:08:01,205: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:08:01.229323612Z [2024-04-06 02:08:01,225: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T02:08:01.339136063Z [2024-04-06 02:08:01,335: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T02:08:01.369464667Z [2024-04-06 02:08:01,363: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:08:01.488445854Z [2024-04-06 02:08:01,488: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:08:01.500264961Z [2024-04-06 02:08:01,499: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-06T02:08:01.504464550Z [2024-04-06 02:08:01,504: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:08:01.533275379Z [2024-04-06 02:08:01,533: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:08:01.534189204Z [2024-04-06 02:08:01,534: INFO/ForkPoolWorker-16] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T02:08:01.534274053Z [2024-04-06 02:08:01,534: INFO/ForkPoolWorker-16] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T02:08:01.534306652Z [2024-04-06 02:08:01,534: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-06T02:08:01.534481271Z [2024-04-06 02:08:01,534: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T02:08:01.651135117Z [2024-04-06 02:08:01,650: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:08:02.095567681Z [2024-04-06 02:08:02,095: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[86cd7889-a550-4e71-863c-16259d7c4ebf] succeeded in 1.267908146000991s: None 2024-04-06T02:08:02.320416118Z [2024-04-06 02:08:02,319: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6d971240-ab5c-4762-8dcb-bc88d3d674c7] succeeded in 1.5078573989994766s: None 2024-04-06T02:08:02.541569273Z [2024-04-06 02:08:02,541: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-06T02:08:02.545162905Z [2024-04-06 02:08:02,544: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:08:02.565062706Z [2024-04-06 02:08:02,564: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T02:08:02.566356370Z [2024-04-06 02:08:02,566: INFO/ForkPoolWorker-2] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:08:02.566406796Z [2024-04-06 02:08:02,566: INFO/ForkPoolWorker-2] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:08:02.566541312Z [2024-04-06 02:08:02,566: INFO/ForkPoolWorker-2] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:08:02.566593654Z [2024-04-06 02:08:02,566: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-06T02:08:02.566818154Z [2024-04-06 02:08:02,566: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:08:02.566868833Z [2024-04-06 02:08:02,566: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:08:02.652650731Z [2024-04-06 02:08:02,652: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:08:02.696332363Z [2024-04-06 02:08:02,695: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:08:02.699877352Z [2024-04-06 02:08:02,699: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:08:02.724471610Z [2024-04-06 02:08:02,724: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:08:02.728675003Z [2024-04-06 02:08:02,728: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:08:02.728883415Z [2024-04-06 02:08:02,728: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:08:02.729064182Z [2024-04-06 02:08:02,728: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:08:02.729176602Z [2024-04-06 02:08:02,729: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:08:02.729489651Z [2024-04-06 02:08:02,729: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:08:02.729611478Z [2024-04-06 02:08:02,729: INFO/ForkPoolWorker-15] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:08:02.839491402Z [2024-04-06 02:08:02,839: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:08:04.337284901Z [2024-04-06 02:08:04,336: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2fed21e4-ab9d-46c2-b2c5-ab1886f7ee28] succeeded in 3.52932611200049s: None 2024-04-06T02:08:04.681251015Z [2024-04-06 02:08:04,680: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[9a81b963-9cb7-45c0-abbb-45ad122280a8] succeeded in 3.8492216329996154s: None 2024-04-06T02:09:00.367180395Z [2024-04-06 02:09:00,366: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d4135413-356a-4786-bda6-b34a768510d7] received 2024-04-06T02:09:00.377805712Z [2024-04-06 02:09:00,377: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0ffd9383-1402-44d1-8ac0-eae561ee0cd1] received 2024-04-06T02:09:00.380810578Z [2024-04-06 02:09:00,380: INFO/ForkPoolWorker-15] [d4135413-356a-4786-bda6-b34a768510d7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:09:00.384566632Z [2024-04-06 02:09:00,384: INFO/ForkPoolWorker-16] [0ffd9383-1402-44d1-8ac0-eae561ee0cd1] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T02:09:00.396319015Z [2024-04-06 02:09:00,396: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8cda56fc-6565-4f11-8791-1f8fe8692dde] received 2024-04-06T02:09:00.414859649Z [2024-04-06 02:09:00,414: INFO/ForkPoolWorker-1] [8cda56fc-6565-4f11-8791-1f8fe8692dde] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:09:00.703186170Z [2024-04-06 02:09:00,700: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T02:09:00.717244266Z [2024-04-06 02:09:00,710: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:09:00.860027234Z [2024-04-06 02:09:00,856: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:09:00.875719172Z [2024-04-06 02:09:00,875: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-06T02:09:00.880552629Z [2024-04-06 02:09:00,880: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:09:00.921803504Z [2024-04-06 02:09:00,921: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:09:00.922809479Z [2024-04-06 02:09:00,922: INFO/ForkPoolWorker-16] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T02:09:00.922912696Z [2024-04-06 02:09:00,922: INFO/ForkPoolWorker-16] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T02:09:00.922952267Z [2024-04-06 02:09:00,922: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-06T02:09:00.923147049Z [2024-04-06 02:09:00,923: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T02:09:01.020435262Z [2024-04-06 02:09:01,020: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:09:01.592251323Z [2024-04-06 02:09:01,591: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0ffd9383-1402-44d1-8ac0-eae561ee0cd1] succeeded in 1.2129147209998337s: None 2024-04-06T02:09:01.947190320Z [2024-04-06 02:09:01,946: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T02:09:01.950916784Z [2024-04-06 02:09:01,950: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:09:01.974988225Z [2024-04-06 02:09:01,974: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T02:09:01.980973747Z [2024-04-06 02:09:01,980: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:09:01.981374069Z [2024-04-06 02:09:01,980: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:09:01.981557924Z [2024-04-06 02:09:01,981: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:09:01.981807879Z [2024-04-06 02:09:01,981: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T02:09:01.982432349Z [2024-04-06 02:09:01,982: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:09:01.982861612Z [2024-04-06 02:09:01,982: INFO/ForkPoolWorker-1] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:09:02.006798823Z [2024-04-06 02:09:02,006: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:09:02.010681566Z [2024-04-06 02:09:02,010: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:09:02.034541847Z [2024-04-06 02:09:02,034: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:09:02.036039319Z [2024-04-06 02:09:02,035: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:09:02.036185916Z [2024-04-06 02:09:02,035: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:09:02.036426191Z [2024-04-06 02:09:02,036: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:09:02.036595852Z [2024-04-06 02:09:02,036: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:09:02.037045908Z [2024-04-06 02:09:02,036: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:09:02.037194082Z [2024-04-06 02:09:02,037: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:09:02.084487841Z [2024-04-06 02:09:02,084: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:09:02.119020409Z [2024-04-06 02:09:02,118: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:09:03.807509470Z [2024-04-06 02:09:03,807: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8cda56fc-6565-4f11-8791-1f8fe8692dde] succeeded in 3.4087716290014214s: None 2024-04-06T02:09:04.166862545Z [2024-04-06 02:09:04,166: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d4135413-356a-4786-bda6-b34a768510d7] succeeded in 3.7972008289998485s: None 2024-04-06T02:10:00.384120526Z [2024-04-06 02:10:00,383: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c9d6b2ad-dab3-42a2-ab2a-88570cb01ff0] received 2024-04-06T02:10:00.388457280Z [2024-04-06 02:10:00,387: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6872308a-42e8-41d1-a266-b7fb76a14c9e] received 2024-04-06T02:10:00.397464172Z [2024-04-06 02:10:00,397: INFO/ForkPoolWorker-15] [c9d6b2ad-dab3-42a2-ab2a-88570cb01ff0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:10:00.397641920Z [2024-04-06 02:10:00,397: INFO/ForkPoolWorker-16] [6872308a-42e8-41d1-a266-b7fb76a14c9e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T02:10:00.398074240Z [2024-04-06 02:10:00,397: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b42d8ab7-0488-4206-99d4-5eeb3dcb66b5] received 2024-04-06T02:10:00.401525893Z [2024-04-06 02:10:00,401: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6ee4dfa3-20c0-4e54-904d-66f2091c821e] received 2024-04-06T02:10:00.411075837Z [2024-04-06 02:10:00,410: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5c957fdf-59d1-4948-bd0f-de81f4a315cb] received 2024-04-06T02:10:00.428362174Z [2024-04-06 02:10:00,427: INFO/ForkPoolWorker-1] [b42d8ab7-0488-4206-99d4-5eeb3dcb66b5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:10:00.432264351Z [2024-04-06 02:10:00,431: INFO/ForkPoolWorker-3] [5c957fdf-59d1-4948-bd0f-de81f4a315cb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:10:00.434026617Z [2024-04-06 02:10:00,433: INFO/ForkPoolWorker-2] [6ee4dfa3-20c0-4e54-904d-66f2091c821e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T02:10:00.818347068Z [2024-04-06 02:10:00,814: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T02:10:00.873880767Z [2024-04-06 02:10:00,870: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T02:10:00.893273695Z [2024-04-06 02:10:00,882: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:10:00.898824585Z [2024-04-06 02:10:00,895: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:10:00.940634152Z [2024-04-06 02:10:00,933: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:10:01.053797510Z [2024-04-06 02:10:01,053: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-06T02:10:01.057791968Z [2024-04-06 02:10:01,057: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:10:01.106622745Z [2024-04-06 02:10:01,106: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T02:10:01.108354573Z [2024-04-06 02:10:01,108: INFO/ForkPoolWorker-2] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T02:10:01.108706006Z [2024-04-06 02:10:01,108: INFO/ForkPoolWorker-2] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T02:10:01.108954505Z [2024-04-06 02:10:01,108: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-06T02:10:01.109334211Z [2024-04-06 02:10:01,109: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T02:10:01.163719321Z [2024-04-06 02:10:01,163: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:10:01.216108988Z [2024-04-06 02:10:01,215: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:10:01.843324821Z [2024-04-06 02:10:01,842: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6872308a-42e8-41d1-a266-b7fb76a14c9e] succeeded in 1.4528952230011782s: None 2024-04-06T02:10:01.908403531Z [2024-04-06 02:10:01,907: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[6ee4dfa3-20c0-4e54-904d-66f2091c821e] succeeded in 1.5048643040008756s: None 2024-04-06T02:10:02.382754522Z [2024-04-06 02:10:02,382: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:10:02.386080769Z [2024-04-06 02:10:02,385: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:10:02.413848823Z [2024-04-06 02:10:02,413: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:10:02.415845906Z [2024-04-06 02:10:02,415: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:10:02.416109119Z [2024-04-06 02:10:02,415: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:10:02.416422452Z [2024-04-06 02:10:02,416: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:10:02.416647580Z [2024-04-06 02:10:02,416: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:10:02.417434519Z [2024-04-06 02:10:02,417: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:10:02.417666788Z [2024-04-06 02:10:02,417: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:10:02.501229800Z [2024-04-06 02:10:02,500: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:10:02.514215008Z [2024-04-06 02:10:02,513: INFO/ForkPoolWorker-3] Getting VIM list 2024-04-06T02:10:02.517470715Z [2024-04-06 02:10:02,517: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:10:02.548301014Z [2024-04-06 02:10:02,548: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-06T02:10:02.549637514Z [2024-04-06 02:10:02,549: INFO/ForkPoolWorker-3] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:10:02.549785074Z [2024-04-06 02:10:02,549: INFO/ForkPoolWorker-3] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:10:02.550017091Z [2024-04-06 02:10:02,549: INFO/ForkPoolWorker-3] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:10:02.550066619Z [2024-04-06 02:10:02,549: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-04-06T02:10:02.550653299Z [2024-04-06 02:10:02,550: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:10:02.550665976Z [2024-04-06 02:10:02,550: INFO/ForkPoolWorker-3] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:10:02.629471266Z [2024-04-06 02:10:02,629: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:10:02.902472631Z [2024-04-06 02:10:02,902: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T02:10:02.907001351Z [2024-04-06 02:10:02,906: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:10:02.948597485Z [2024-04-06 02:10:02,948: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T02:10:02.952255270Z [2024-04-06 02:10:02,951: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:10:02.953174063Z [2024-04-06 02:10:02,952: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:10:02.953370683Z [2024-04-06 02:10:02,953: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:10:02.953492552Z [2024-04-06 02:10:02,953: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T02:10:02.953894671Z [2024-04-06 02:10:02,953: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:10:02.954339410Z [2024-04-06 02:10:02,954: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:10:03.056732587Z [2024-04-06 02:10:03,056: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:10:03.138228904Z [2024-04-06 02:10:03,137: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c9d6b2ad-dab3-42a2-ab2a-88570cb01ff0] succeeded in 2.7511178980003024s: None 2024-04-06T02:10:03.179452110Z [2024-04-06 02:10:03,179: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1bc2fbd2-bf51-4475-a696-5bdd44e5f988] received 2024-04-06T02:10:03.186086064Z [2024-04-06 02:10:03,185: INFO/ForkPoolWorker-15] [1bc2fbd2-bf51-4475-a696-5bdd44e5f988] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'split_metrics', 'scheduled__2024-04-06T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:10:03.484479685Z [2024-04-06 02:10:03,480: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:10:04.217188775Z [2024-04-06 02:10:04,216: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[5c957fdf-59d1-4948-bd0f-de81f4a315cb] succeeded in 3.799797164998381s: None 2024-04-06T02:10:04.806360197Z [2024-04-06 02:10:04,805: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:10:04.809767966Z [2024-04-06 02:10:04,809: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:10:04.835391678Z [2024-04-06 02:10:04,835: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:10:04.837173408Z [2024-04-06 02:10:04,836: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:10:04.837235106Z [2024-04-06 02:10:04,837: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:10:04.837363016Z [2024-04-06 02:10:04,837: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:10:04.837426879Z [2024-04-06 02:10:04,837: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:10:04.837871984Z [2024-04-06 02:10:04,837: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:10:04.837929180Z [2024-04-06 02:10:04,837: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:10:04.897190425Z [2024-04-06 02:10:04,896: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b42d8ab7-0488-4206-99d4-5eeb3dcb66b5] succeeded in 4.493814985999052s: None 2024-04-06T02:10:04.964887888Z [2024-04-06 02:10:04,964: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:10:05.620710496Z [2024-04-06 02:10:05,620: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1bc2fbd2-bf51-4475-a696-5bdd44e5f988] succeeded in 2.4395403140006238s: None 2024-04-06T02:10:05.771241438Z [2024-04-06 02:10:05,770: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[485040e5-b17e-42c2-8254-326bc54ab920] received 2024-04-06T02:10:05.777869827Z [2024-04-06 02:10:05,777: INFO/ForkPoolWorker-15] [485040e5-b17e-42c2-8254-326bc54ab920] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'collect_metrics', 'scheduled__2024-04-06T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T02:10:06.049139371Z [2024-04-06 02:10:06,045: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:10:07.121399065Z [2024-04-06 02:10:07,120: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:10:07.124676003Z [2024-04-06 02:10:07,124: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:10:07.158316796Z [2024-04-06 02:10:07,157: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:10:07.161252524Z [2024-04-06 02:10:07,160: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:10:07.161406787Z [2024-04-06 02:10:07,161: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:10:07.161856705Z [2024-04-06 02:10:07,161: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:10:07.162058976Z [2024-04-06 02:10:07,161: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:10:07.162555934Z [2024-04-06 02:10:07,162: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:10:07.163388437Z [2024-04-06 02:10:07,162: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:10:07.257860828Z [2024-04-06 02:10:07,257: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:10:08.785740251Z [2024-04-06 02:10:08,785: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[485040e5-b17e-42c2-8254-326bc54ab920] succeeded in 3.011871976999828s: None 2024-04-06T02:10:09.454963534Z [2024-04-06 02:10:09,454: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3f512f14-a3ed-48fb-8f26-76ad251d8667] received 2024-04-06T02:10:09.467880531Z [2024-04-06 02:10:09,467: INFO/ForkPoolWorker-15] [3f512f14-a3ed-48fb-8f26-76ad251d8667] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'send_prometheus', 'scheduled__2024-04-06T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:10:09.760011369Z [2024-04-06 02:10:09,754: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:10:11.004879127Z [2024-04-06 02:10:11,004: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:10:11.007967576Z [2024-04-06 02:10:11,007: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:10:11.026390967Z [2024-04-06 02:10:11,026: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:10:11.027609000Z [2024-04-06 02:10:11,027: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:10:11.027629934Z [2024-04-06 02:10:11,027: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:10:11.027765736Z [2024-04-06 02:10:11,027: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:10:11.027778365Z [2024-04-06 02:10:11,027: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:10:11.027997594Z [2024-04-06 02:10:11,027: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:10:11.028027422Z [2024-04-06 02:10:11,027: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:10:11.099988011Z [2024-04-06 02:10:11,099: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:10:11.655000442Z [2024-04-06 02:10:11,654: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3f512f14-a3ed-48fb-8f26-76ad251d8667] succeeded in 2.1954258249988925s: None 2024-04-06T02:11:00.304695306Z [2024-04-06 02:11:00,304: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c37d238e-2b41-403f-9ed2-a36843a70b7b] received 2024-04-06T02:11:00.306731052Z [2024-04-06 02:11:00,306: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aaa7bd12-c556-40c5-b52b-ac81e632eca2] received 2024-04-06T02:11:00.309344933Z [2024-04-06 02:11:00,309: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3ecfb1d8-8327-4570-b93d-8d2e57e6bad6] received 2024-04-06T02:11:00.318677117Z [2024-04-06 02:11:00,318: INFO/ForkPoolWorker-16] [aaa7bd12-c556-40c5-b52b-ac81e632eca2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:11:00.320194873Z [2024-04-06 02:11:00,319: INFO/ForkPoolWorker-15] [c37d238e-2b41-403f-9ed2-a36843a70b7b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T02:11:00.322998114Z [2024-04-06 02:11:00,320: INFO/ForkPoolWorker-1] [3ecfb1d8-8327-4570-b93d-8d2e57e6bad6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:11:00.629782241Z [2024-04-06 02:11:00,626: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T02:11:00.644172216Z [2024-04-06 02:11:00,640: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:11:00.652326588Z [2024-04-06 02:11:00,648: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:11:00.793876144Z [2024-04-06 02:11:00,793: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-06T02:11:00.798232255Z [2024-04-06 02:11:00,797: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:11:00.815812688Z [2024-04-06 02:11:00,815: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:11:00.816912733Z [2024-04-06 02:11:00,816: INFO/ForkPoolWorker-15] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T02:11:00.817148545Z [2024-04-06 02:11:00,816: INFO/ForkPoolWorker-15] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T02:11:00.817229265Z [2024-04-06 02:11:00,817: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-06T02:11:00.817437460Z [2024-04-06 02:11:00,817: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T02:11:00.902978611Z [2024-04-06 02:11:00,902: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:11:01.545031925Z [2024-04-06 02:11:01,544: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c37d238e-2b41-403f-9ed2-a36843a70b7b] succeeded in 1.2380427300013253s: None 2024-04-06T02:11:01.771425762Z [2024-04-06 02:11:01,770: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:11:01.775065139Z [2024-04-06 02:11:01,774: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:11:01.802742373Z [2024-04-06 02:11:01,802: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:11:01.804793218Z [2024-04-06 02:11:01,804: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:11:01.804982822Z [2024-04-06 02:11:01,804: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:11:01.805273144Z [2024-04-06 02:11:01,804: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:11:01.805471901Z [2024-04-06 02:11:01,805: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:11:01.805993802Z [2024-04-06 02:11:01,805: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:11:01.806341955Z [2024-04-06 02:11:01,805: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:11:01.826875118Z [2024-04-06 02:11:01,826: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T02:11:01.831225204Z [2024-04-06 02:11:01,830: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:11:01.862317270Z [2024-04-06 02:11:01,862: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T02:11:01.864680461Z [2024-04-06 02:11:01,864: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:11:01.864698577Z [2024-04-06 02:11:01,864: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:11:01.864905567Z [2024-04-06 02:11:01,864: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:11:01.864967543Z [2024-04-06 02:11:01,864: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T02:11:01.865483263Z [2024-04-06 02:11:01,865: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:11:01.865505364Z [2024-04-06 02:11:01,865: INFO/ForkPoolWorker-1] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:11:01.915823534Z [2024-04-06 02:11:01,915: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:11:01.956154150Z [2024-04-06 02:11:01,955: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:11:03.476053111Z [2024-04-06 02:11:03,475: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3ecfb1d8-8327-4570-b93d-8d2e57e6bad6] succeeded in 3.164389489000314s: None 2024-04-06T02:11:03.882248005Z [2024-04-06 02:11:03,881: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[aaa7bd12-c556-40c5-b52b-ac81e632eca2] succeeded in 3.572517541000707s: None 2024-04-06T02:11:23.227399028Z [2024-04-06 02:11:23,226: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f48fe9da-50fe-41c3-ad70-6c7a5c6f76e5] received 2024-04-06T02:11:23.242537331Z [2024-04-06 02:11:23,242: INFO/ForkPoolWorker-15] [f48fe9da-50fe-41c3-ad70-6c7a5c6f76e5] Executing command in Celery: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240406021122_350121', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-04-06T02:11:23.519490952Z [2024-04-06 02:11:23,516: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/scaleout_vdu.py 2024-04-06T02:11:23.824634817Z [2024-04-06 02:11:23,824: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:11:24.545301020Z [2024-04-06 02:11:24,544: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f48fe9da-50fe-41c3-ad70-6c7a5c6f76e5] succeeded in 1.3118331559999206s: None 2024-04-06T02:12:01.298203147Z [2024-04-06 02:12:01,297: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a8783ca2-8d7a-4461-9048-d967c60bf002] received 2024-04-06T02:12:01.300894086Z [2024-04-06 02:12:01,300: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[37623b0e-227f-4d66-b748-46b8f14a5766] received 2024-04-06T02:12:01.309412590Z [2024-04-06 02:12:01,309: INFO/ForkPoolWorker-15] [a8783ca2-8d7a-4461-9048-d967c60bf002] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T02:12:01.311095122Z [2024-04-06 02:12:01,310: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[00364430-874d-4bb1-8c38-cf8ce8bd0b57] received 2024-04-06T02:12:01.319842166Z [2024-04-06 02:12:01,319: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f36ef034-6987-45d9-9fc4-bc10eb38d253] received 2024-04-06T02:12:01.321164532Z [2024-04-06 02:12:01,320: INFO/ForkPoolWorker-1] [00364430-874d-4bb1-8c38-cf8ce8bd0b57] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:12:01.323184318Z [2024-04-06 02:12:01,322: INFO/ForkPoolWorker-16] [37623b0e-227f-4d66-b748-46b8f14a5766] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:12:01.333925218Z [2024-04-06 02:12:01,333: INFO/ForkPoolWorker-2] [f36ef034-6987-45d9-9fc4-bc10eb38d253] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T02:12:01.645823297Z [2024-04-06 02:12:01,642: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:12:01.762637642Z [2024-04-06 02:12:01,746: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T02:12:01.809853056Z [2024-04-06 02:12:01,806: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:12:01.817882683Z [2024-04-06 02:12:01,814: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T02:12:01.983014529Z [2024-04-06 02:12:01,982: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-06T02:12:01.987879433Z [2024-04-06 02:12:01,986: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:12:02.048677373Z [2024-04-06 02:12:02,048: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T02:12:02.052130056Z [2024-04-06 02:12:02,051: INFO/ForkPoolWorker-2] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T02:12:02.052164532Z [2024-04-06 02:12:02,052: INFO/ForkPoolWorker-2] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T02:12:02.052212758Z [2024-04-06 02:12:02,052: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-06T02:12:02.053246573Z [2024-04-06 02:12:02,053: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T02:12:02.077501557Z [2024-04-06 02:12:02,077: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:12:02.185412140Z [2024-04-06 02:12:02,185: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:12:02.815447720Z [2024-04-06 02:12:02,814: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a8783ca2-8d7a-4461-9048-d967c60bf002] succeeded in 1.5131528819983942s: None 2024-04-06T02:12:03.141169291Z [2024-04-06 02:12:03,140: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[f36ef034-6987-45d9-9fc4-bc10eb38d253] succeeded in 1.8159252690002177s: None 2024-04-06T02:12:03.158860566Z [2024-04-06 02:12:03,158: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:12:03.168218242Z [2024-04-06 02:12:03,167: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:12:03.199802220Z [2024-04-06 02:12:03,199: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:12:03.201298337Z [2024-04-06 02:12:03,201: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:12:03.201395697Z [2024-04-06 02:12:03,201: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:12:03.201559057Z [2024-04-06 02:12:03,201: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:12:03.201651313Z [2024-04-06 02:12:03,201: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:12:03.202018479Z [2024-04-06 02:12:03,201: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:12:03.202124065Z [2024-04-06 02:12:03,202: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:12:03.315663238Z [2024-04-06 02:12:03,315: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:12:03.371562623Z [2024-04-06 02:12:03,371: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T02:12:03.374855743Z [2024-04-06 02:12:03,374: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:12:03.392900824Z [2024-04-06 02:12:03,392: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T02:12:03.394217885Z [2024-04-06 02:12:03,394: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:12:03.394416228Z [2024-04-06 02:12:03,394: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:12:03.394636986Z [2024-04-06 02:12:03,394: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:12:03.394831022Z [2024-04-06 02:12:03,394: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T02:12:03.395153008Z [2024-04-06 02:12:03,395: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:12:03.395539410Z [2024-04-06 02:12:03,395: INFO/ForkPoolWorker-1] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:12:03.468577586Z [2024-04-06 02:12:03,468: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:12:05.721938745Z [2024-04-06 02:12:05,721: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[00364430-874d-4bb1-8c38-cf8ce8bd0b57] succeeded in 4.408297129000857s: None 2024-04-06T02:12:06.668615127Z [2024-04-06 02:12:06,668: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[37623b0e-227f-4d66-b748-46b8f14a5766] succeeded in 5.362720774999616s: None 2024-04-06T02:13:00.869501232Z [2024-04-06 02:13:00,869: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[951e6708-4afa-4fd1-bc10-e545a140d1b7] received 2024-04-06T02:13:00.872526909Z [2024-04-06 02:13:00,872: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8e445d09-6741-45f0-89c9-14ea06c19727] received 2024-04-06T02:13:00.877549409Z [2024-04-06 02:13:00,877: INFO/ForkPoolWorker-15] [951e6708-4afa-4fd1-bc10-e545a140d1b7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:13:00.880481647Z [2024-04-06 02:13:00,880: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[76026ddc-90c3-497a-9d11-99752c43afb9] received 2024-04-06T02:13:00.884560272Z [2024-04-06 02:13:00,884: INFO/ForkPoolWorker-16] [8e445d09-6741-45f0-89c9-14ea06c19727] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:13:00.897306985Z [2024-04-06 02:13:00,896: INFO/ForkPoolWorker-1] [76026ddc-90c3-497a-9d11-99752c43afb9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T02:13:01.307061379Z [2024-04-06 02:13:01,304: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:13:01.379709309Z [2024-04-06 02:13:01,372: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T02:13:01.538315074Z [2024-04-06 02:13:01,534: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:13:01.615073021Z [2024-04-06 02:13:01,614: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-06T02:13:01.619151383Z [2024-04-06 02:13:01,618: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:13:01.640408569Z [2024-04-06 02:13:01,640: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T02:13:01.641326382Z [2024-04-06 02:13:01,641: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T02:13:01.641402494Z [2024-04-06 02:13:01,641: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T02:13:01.641440463Z [2024-04-06 02:13:01,641: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-06T02:13:01.641609927Z [2024-04-06 02:13:01,641: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T02:13:01.731086995Z [2024-04-06 02:13:01,730: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:13:02.401596045Z [2024-04-06 02:13:02,401: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[76026ddc-90c3-497a-9d11-99752c43afb9] succeeded in 1.5168617090002954s: None 2024-04-06T02:13:02.544851534Z [2024-04-06 02:13:02,544: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:13:02.548595581Z [2024-04-06 02:13:02,548: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:13:02.569373870Z [2024-04-06 02:13:02,569: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:13:02.570745355Z [2024-04-06 02:13:02,570: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:13:02.570867513Z [2024-04-06 02:13:02,570: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:13:02.571050714Z [2024-04-06 02:13:02,570: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:13:02.571355026Z [2024-04-06 02:13:02,571: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:13:02.571655782Z [2024-04-06 02:13:02,571: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:13:02.571766608Z [2024-04-06 02:13:02,571: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:13:02.642896993Z [2024-04-06 02:13:02,642: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:13:02.792587492Z [2024-04-06 02:13:02,792: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:13:02.796036359Z [2024-04-06 02:13:02,795: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:13:02.812486897Z [2024-04-06 02:13:02,812: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:13:02.813764543Z [2024-04-06 02:13:02,813: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:13:02.813944713Z [2024-04-06 02:13:02,813: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:13:02.814130331Z [2024-04-06 02:13:02,813: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:13:02.814268808Z [2024-04-06 02:13:02,814: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:13:02.814550398Z [2024-04-06 02:13:02,814: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:13:02.814696456Z [2024-04-06 02:13:02,814: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:13:02.896399486Z [2024-04-06 02:13:02,896: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:13:04.173507724Z [2024-04-06 02:13:04,172: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8e445d09-6741-45f0-89c9-14ea06c19727] succeeded in 3.298748129998785s: None 2024-04-06T02:13:05.115991694Z [2024-04-06 02:13:05,114: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[951e6708-4afa-4fd1-bc10-e545a140d1b7] succeeded in 4.243794881000213s: None 2024-04-06T02:14:01.264045122Z [2024-04-06 02:14:01,263: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d179329c-507c-4c56-be86-9db63a34fda5] received 2024-04-06T02:14:01.270219610Z [2024-04-06 02:14:01,269: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e86924fe-d571-4262-9444-6a536ef65e6f] received 2024-04-06T02:14:01.276434773Z [2024-04-06 02:14:01,276: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[04b5ef77-ae15-4ddb-a170-4d251ac163dc] received 2024-04-06T02:14:01.285062608Z [2024-04-06 02:14:01,284: INFO/ForkPoolWorker-15] [d179329c-507c-4c56-be86-9db63a34fda5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:14:01.287995966Z [2024-04-06 02:14:01,287: INFO/ForkPoolWorker-16] [e86924fe-d571-4262-9444-6a536ef65e6f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T02:14:01.292070445Z [2024-04-06 02:14:01,291: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[14463753-cfd3-48ad-9334-a6ade3b78623] received 2024-04-06T02:14:01.299645438Z [2024-04-06 02:14:01,299: INFO/ForkPoolWorker-1] [04b5ef77-ae15-4ddb-a170-4d251ac163dc] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T02:14:01.311224111Z [2024-04-06 02:14:01,310: INFO/ForkPoolWorker-2] [14463753-cfd3-48ad-9334-a6ade3b78623] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:14:01.791115793Z [2024-04-06 02:14:01,786: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T02:14:01.861013174Z [2024-04-06 02:14:01,853: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:14:01.910585057Z [2024-04-06 02:14:01,905: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:14:01.913099054Z [2024-04-06 02:14:01,902: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T02:14:02.092324244Z [2024-04-06 02:14:02,091: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-06T02:14:02.104554926Z [2024-04-06 02:14:02,101: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:14:02.148383724Z [2024-04-06 02:14:02,148: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:14:02.151590678Z [2024-04-06 02:14:02,149: INFO/ForkPoolWorker-16] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T02:14:02.151876908Z [2024-04-06 02:14:02,151: INFO/ForkPoolWorker-16] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T02:14:02.152036102Z [2024-04-06 02:14:02,151: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-06T02:14:02.152326258Z [2024-04-06 02:14:02,152: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T02:14:02.272778580Z [2024-04-06 02:14:02,271: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:14:02.306347345Z [2024-04-06 02:14:02,306: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:14:03.154156415Z [2024-04-06 02:14:03,153: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[04b5ef77-ae15-4ddb-a170-4d251ac163dc] succeeded in 1.8739801049996458s: None 2024-04-06T02:14:03.245603717Z [2024-04-06 02:14:03,245: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e86924fe-d571-4262-9444-6a536ef65e6f] succeeded in 1.9733213060007984s: None 2024-04-06T02:14:03.362878615Z [2024-04-06 02:14:03,362: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-06T02:14:03.366324079Z [2024-04-06 02:14:03,365: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:14:03.389135232Z [2024-04-06 02:14:03,388: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T02:14:03.390571811Z [2024-04-06 02:14:03,390: INFO/ForkPoolWorker-2] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:14:03.390597721Z [2024-04-06 02:14:03,390: INFO/ForkPoolWorker-2] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:14:03.390881792Z [2024-04-06 02:14:03,390: INFO/ForkPoolWorker-2] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:14:03.390965620Z [2024-04-06 02:14:03,390: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-06T02:14:03.391843434Z [2024-04-06 02:14:03,391: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:14:03.391866062Z [2024-04-06 02:14:03,391: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:14:03.489813783Z [2024-04-06 02:14:03,489: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:14:03.543206618Z [2024-04-06 02:14:03,542: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:14:03.546443778Z [2024-04-06 02:14:03,546: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:14:03.565749819Z [2024-04-06 02:14:03,565: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:14:03.567094531Z [2024-04-06 02:14:03,566: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:14:03.567374690Z [2024-04-06 02:14:03,567: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:14:03.567561133Z [2024-04-06 02:14:03,567: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:14:03.567627708Z [2024-04-06 02:14:03,567: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:14:03.567866902Z [2024-04-06 02:14:03,567: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:14:03.567949141Z [2024-04-06 02:14:03,567: INFO/ForkPoolWorker-15] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:14:03.637419086Z [2024-04-06 02:14:03,637: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:14:05.289787384Z [2024-04-06 02:14:05,289: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d179329c-507c-4c56-be86-9db63a34fda5] succeeded in 4.021277754000039s: None 2024-04-06T02:14:05.587738989Z [2024-04-06 02:14:05,587: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[14463753-cfd3-48ad-9334-a6ade3b78623] succeeded in 4.2911758050013304s: None 2024-04-06T02:15:00.616403177Z [2024-04-06 02:15:00,616: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fe7a9a53-6717-4d45-8efb-50d3ce5b5138] received 2024-04-06T02:15:00.619773705Z [2024-04-06 02:15:00,619: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[500197f2-90b5-4bf7-b2dd-19dfe34a6233] received 2024-04-06T02:15:00.628855546Z [2024-04-06 02:15:00,628: INFO/ForkPoolWorker-15] [fe7a9a53-6717-4d45-8efb-50d3ce5b5138] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:15:00.630676333Z [2024-04-06 02:15:00,630: INFO/ForkPoolWorker-16] [500197f2-90b5-4bf7-b2dd-19dfe34a6233] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:15:00.631878861Z [2024-04-06 02:15:00,631: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5719066a-e294-4fdd-8155-31974413b09b] received 2024-04-06T02:15:00.636538602Z [2024-04-06 02:15:00,636: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[93911bce-26e0-44ba-bbd3-84227c768c92] received 2024-04-06T02:15:00.644895863Z [2024-04-06 02:15:00,644: INFO/ForkPoolWorker-1] [5719066a-e294-4fdd-8155-31974413b09b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:15:00.650859263Z [2024-04-06 02:15:00,650: INFO/ForkPoolWorker-2] [93911bce-26e0-44ba-bbd3-84227c768c92] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T02:15:00.958194539Z [2024-04-06 02:15:00,954: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:15:00.986425257Z [2024-04-06 02:15:00,983: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:15:01.028006226Z [2024-04-06 02:15:01,023: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T02:15:01.169482142Z [2024-04-06 02:15:01,165: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:15:01.210114408Z [2024-04-06 02:15:01,209: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-06T02:15:01.214470558Z [2024-04-06 02:15:01,213: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:15:01.240060418Z [2024-04-06 02:15:01,239: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T02:15:01.241308957Z [2024-04-06 02:15:01,241: INFO/ForkPoolWorker-2] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T02:15:01.241431210Z [2024-04-06 02:15:01,241: INFO/ForkPoolWorker-2] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T02:15:01.241481079Z [2024-04-06 02:15:01,241: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-06T02:15:01.242063685Z [2024-04-06 02:15:01,241: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T02:15:01.331742854Z [2024-04-06 02:15:01,331: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:15:01.987942639Z [2024-04-06 02:15:01,987: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[93911bce-26e0-44ba-bbd3-84227c768c92] succeeded in 1.3476008369998453s: None 2024-04-06T02:15:02.154008943Z [2024-04-06 02:15:02,153: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:15:02.157176610Z [2024-04-06 02:15:02,156: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:15:02.173961327Z [2024-04-06 02:15:02,173: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:15:02.175404650Z [2024-04-06 02:15:02,175: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:15:02.175422795Z [2024-04-06 02:15:02,175: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:15:02.175558518Z [2024-04-06 02:15:02,175: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:15:02.175584849Z [2024-04-06 02:15:02,175: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:15:02.175806592Z [2024-04-06 02:15:02,175: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:15:02.175864449Z [2024-04-06 02:15:02,175: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:15:02.255186536Z [2024-04-06 02:15:02,254: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:15:02.439270918Z [2024-04-06 02:15:02,438: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T02:15:02.442593754Z [2024-04-06 02:15:02,442: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:15:02.461058158Z [2024-04-06 02:15:02,460: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T02:15:02.464735919Z [2024-04-06 02:15:02,464: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:15:02.464862143Z [2024-04-06 02:15:02,464: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:15:02.465107855Z [2024-04-06 02:15:02,464: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:15:02.465162796Z [2024-04-06 02:15:02,465: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T02:15:02.465455084Z [2024-04-06 02:15:02,465: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:15:02.465572271Z [2024-04-06 02:15:02,465: INFO/ForkPoolWorker-1] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:15:02.572654058Z [2024-04-06 02:15:02,572: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:15:02.627633239Z [2024-04-06 02:15:02,627: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:15:02.631011604Z [2024-04-06 02:15:02,630: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:15:02.649670348Z [2024-04-06 02:15:02,649: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:15:02.651068794Z [2024-04-06 02:15:02,650: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:15:02.651486399Z [2024-04-06 02:15:02,651: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:15:02.651711716Z [2024-04-06 02:15:02,651: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:15:02.651747678Z [2024-04-06 02:15:02,651: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:15:02.652303427Z [2024-04-06 02:15:02,652: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:15:02.652325886Z [2024-04-06 02:15:02,652: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:15:02.739661055Z [2024-04-06 02:15:02,735: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:15:02.835930180Z [2024-04-06 02:15:02,835: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fe7a9a53-6717-4d45-8efb-50d3ce5b5138] succeeded in 2.216599477998898s: None 2024-04-06T02:15:03.350145415Z [2024-04-06 02:15:03,349: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[67efe7dc-954b-48a8-912d-2995ffd44f9c] received 2024-04-06T02:15:03.356192837Z [2024-04-06 02:15:03,355: INFO/ForkPoolWorker-15] [67efe7dc-954b-48a8-912d-2995ffd44f9c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'split_metrics', 'scheduled__2024-04-06T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:15:03.624061895Z [2024-04-06 02:15:03,621: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:15:04.288352005Z [2024-04-06 02:15:04,287: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5719066a-e294-4fdd-8155-31974413b09b] succeeded in 3.655083862000538s: None 2024-04-06T02:15:04.760918279Z [2024-04-06 02:15:04,760: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[500197f2-90b5-4bf7-b2dd-19dfe34a6233] succeeded in 4.138626771999043s: None 2024-04-06T02:15:04.867714771Z [2024-04-06 02:15:04,867: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:15:04.870818291Z [2024-04-06 02:15:04,870: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:15:04.887429072Z [2024-04-06 02:15:04,887: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:15:04.888705857Z [2024-04-06 02:15:04,888: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:15:04.888737104Z [2024-04-06 02:15:04,888: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:15:04.888820756Z [2024-04-06 02:15:04,888: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:15:04.888904378Z [2024-04-06 02:15:04,888: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:15:04.889092720Z [2024-04-06 02:15:04,888: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:15:04.889134931Z [2024-04-06 02:15:04,889: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:15:04.986167137Z [2024-04-06 02:15:04,985: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:15:05.601749729Z [2024-04-06 02:15:05,601: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[67efe7dc-954b-48a8-912d-2995ffd44f9c] succeeded in 2.249405378999654s: None 2024-04-06T02:15:05.782604579Z [2024-04-06 02:15:05,782: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b3bc7ce7-bcb2-4e46-b5d7-eaf723fa872f] received 2024-04-06T02:15:05.790871756Z [2024-04-06 02:15:05,790: INFO/ForkPoolWorker-15] [b3bc7ce7-bcb2-4e46-b5d7-eaf723fa872f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'collect_metrics', 'scheduled__2024-04-06T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T02:15:06.061954913Z [2024-04-06 02:15:06,058: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:15:07.147655821Z [2024-04-06 02:15:07,147: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:15:07.150951434Z [2024-04-06 02:15:07,150: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:15:07.170103438Z [2024-04-06 02:15:07,169: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:15:07.171714237Z [2024-04-06 02:15:07,171: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:15:07.171885641Z [2024-04-06 02:15:07,171: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:15:07.172084041Z [2024-04-06 02:15:07,171: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:15:07.172209646Z [2024-04-06 02:15:07,172: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:15:07.172490298Z [2024-04-06 02:15:07,172: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:15:07.172673704Z [2024-04-06 02:15:07,172: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:15:07.255073561Z [2024-04-06 02:15:07,254: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:15:09.093804139Z [2024-04-06 02:15:09,093: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b3bc7ce7-bcb2-4e46-b5d7-eaf723fa872f] succeeded in 3.3083345209997788s: None 2024-04-06T02:15:09.598337046Z [2024-04-06 02:15:09,598: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a74d694a-0338-46fb-831c-9518c8a95486] received 2024-04-06T02:15:09.605736322Z [2024-04-06 02:15:09,605: INFO/ForkPoolWorker-15] [a74d694a-0338-46fb-831c-9518c8a95486] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'send_prometheus', 'scheduled__2024-04-06T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:15:09.868938398Z [2024-04-06 02:15:09,865: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:15:10.972080996Z [2024-04-06 02:15:10,971: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:15:10.975312813Z [2024-04-06 02:15:10,974: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:15:10.998697075Z [2024-04-06 02:15:10,998: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:15:11.000924984Z [2024-04-06 02:15:11,000: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:15:11.000940439Z [2024-04-06 02:15:11,000: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:15:11.001097012Z [2024-04-06 02:15:11,000: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:15:11.001102089Z [2024-04-06 02:15:11,001: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:15:11.001929862Z [2024-04-06 02:15:11,001: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:15:11.001936749Z [2024-04-06 02:15:11,001: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:15:11.102594297Z [2024-04-06 02:15:11,102: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:15:11.693257144Z [2024-04-06 02:15:11,692: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a74d694a-0338-46fb-831c-9518c8a95486] succeeded in 2.0922792649998883s: None 2024-04-06T02:15:23.385759816Z [2024-04-06 02:15:23,384: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[83ee6167-2847-4c0e-912a-aeaef772758e] received 2024-04-06T02:15:23.401991564Z [2024-04-06 02:15:23,401: INFO/ForkPoolWorker-15] [83ee6167-2847-4c0e-912a-aeaef772758e] Executing command in Celery: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240406021522_593163', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-04-06T02:15:23.719419696Z [2024-04-06 02:15:23,716: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/scaleout_vdu.py 2024-04-06T02:15:24.032461473Z [2024-04-06 02:15:24,032: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:15:24.565428523Z [2024-04-06 02:15:24,564: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[83ee6167-2847-4c0e-912a-aeaef772758e] succeeded in 1.1689133899999433s: None 2024-04-06T02:16:00.583347258Z [2024-04-06 02:16:00,582: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0e223b5a-1563-4605-bc5f-5d4825a5442d] received 2024-04-06T02:16:00.586604352Z [2024-04-06 02:16:00,586: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2628d55b-d294-4f9c-bc0c-b41376062872] received 2024-04-06T02:16:00.589983449Z [2024-04-06 02:16:00,589: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d76e3b59-d3dc-4c1d-a6a7-46b17a3cf0c0] received 2024-04-06T02:16:00.593087854Z [2024-04-06 02:16:00,592: INFO/ForkPoolWorker-16] [2628d55b-d294-4f9c-bc0c-b41376062872] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:16:00.595308237Z [2024-04-06 02:16:00,595: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1bd5b545-d78c-4828-b6a0-5b8261120a2b] received 2024-04-06T02:16:00.604759891Z [2024-04-06 02:16:00,604: INFO/ForkPoolWorker-2] [1bd5b545-d78c-4828-b6a0-5b8261120a2b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T02:16:00.609565888Z [2024-04-06 02:16:00,609: INFO/ForkPoolWorker-1] [d76e3b59-d3dc-4c1d-a6a7-46b17a3cf0c0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:16:00.610243301Z [2024-04-06 02:16:00,610: INFO/ForkPoolWorker-15] [0e223b5a-1563-4605-bc5f-5d4825a5442d] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T02:16:00.906532414Z [2024-04-06 02:16:00,903: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:16:00.945019458Z [2024-04-06 02:16:00,940: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T02:16:00.971034180Z [2024-04-06 02:16:00,967: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:16:00.991843566Z [2024-04-06 02:16:00,987: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T02:16:01.200000049Z [2024-04-06 02:16:01,198: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-06T02:16:01.204253630Z [2024-04-06 02:16:01,203: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:16:01.258838504Z [2024-04-06 02:16:01,258: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T02:16:01.261286708Z [2024-04-06 02:16:01,260: INFO/ForkPoolWorker-2] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T02:16:01.261414755Z [2024-04-06 02:16:01,261: INFO/ForkPoolWorker-2] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T02:16:01.261478888Z [2024-04-06 02:16:01,261: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-06T02:16:01.261806133Z [2024-04-06 02:16:01,261: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T02:16:01.299619756Z [2024-04-06 02:16:01,299: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:16:01.370409435Z [2024-04-06 02:16:01,370: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:16:02.045540708Z [2024-04-06 02:16:02,045: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0e223b5a-1563-4605-bc5f-5d4825a5442d] succeeded in 1.4568682949993672s: None 2024-04-06T02:16:02.144474618Z [2024-04-06 02:16:02,144: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[1bd5b545-d78c-4828-b6a0-5b8261120a2b] succeeded in 1.5471054160007043s: None 2024-04-06T02:16:02.229561432Z [2024-04-06 02:16:02,229: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:16:02.233166028Z [2024-04-06 02:16:02,232: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:16:02.263022305Z [2024-04-06 02:16:02,262: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:16:02.265747520Z [2024-04-06 02:16:02,265: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:16:02.265798487Z [2024-04-06 02:16:02,265: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:16:02.265986050Z [2024-04-06 02:16:02,265: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:16:02.266068935Z [2024-04-06 02:16:02,265: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:16:02.266545344Z [2024-04-06 02:16:02,266: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:16:02.266680256Z [2024-04-06 02:16:02,266: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:16:02.352263871Z [2024-04-06 02:16:02,351: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:16:02.420091466Z [2024-04-06 02:16:02,419: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T02:16:02.423588741Z [2024-04-06 02:16:02,423: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:16:02.447415435Z [2024-04-06 02:16:02,447: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T02:16:02.448921100Z [2024-04-06 02:16:02,448: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:16:02.449031471Z [2024-04-06 02:16:02,448: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:16:02.449255617Z [2024-04-06 02:16:02,448: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:16:02.449407994Z [2024-04-06 02:16:02,449: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T02:16:02.449745308Z [2024-04-06 02:16:02,449: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:16:02.449754783Z [2024-04-06 02:16:02,449: INFO/ForkPoolWorker-1] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:16:02.565369815Z [2024-04-06 02:16:02,564: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:16:04.520263292Z [2024-04-06 02:16:04,516: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2628d55b-d294-4f9c-bc0c-b41376062872] succeeded in 3.9288913079999475s: None 2024-04-06T02:16:04.525159654Z [2024-04-06 02:16:04,524: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d76e3b59-d3dc-4c1d-a6a7-46b17a3cf0c0] succeeded in 3.93249324899989s: None 2024-04-06T02:17:00.274566753Z [2024-04-06 02:17:00,273: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6b7679af-e845-47d8-91ab-ce638d71d99c] received 2024-04-06T02:17:00.277266586Z [2024-04-06 02:17:00,277: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1cd317d7-276e-4bcb-9f3e-79d58ac9d5a8] received 2024-04-06T02:17:00.282847849Z [2024-04-06 02:17:00,282: INFO/ForkPoolWorker-15] [6b7679af-e845-47d8-91ab-ce638d71d99c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:17:00.288484238Z [2024-04-06 02:17:00,288: INFO/ForkPoolWorker-16] [1cd317d7-276e-4bcb-9f3e-79d58ac9d5a8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:17:00.300036173Z [2024-04-06 02:17:00,299: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3fff63f5-a785-4626-b63d-050c1f332b04] received 2024-04-06T02:17:00.312845747Z [2024-04-06 02:17:00,312: INFO/ForkPoolWorker-1] [3fff63f5-a785-4626-b63d-050c1f332b04] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T02:17:00.580419175Z [2024-04-06 02:17:00,576: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:17:00.588645461Z [2024-04-06 02:17:00,585: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:17:00.595709899Z [2024-04-06 02:17:00,592: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T02:17:00.756118599Z [2024-04-06 02:17:00,755: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-06T02:17:00.760156618Z [2024-04-06 02:17:00,759: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:17:00.802149513Z [2024-04-06 02:17:00,801: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T02:17:00.804423161Z [2024-04-06 02:17:00,804: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T02:17:00.804528126Z [2024-04-06 02:17:00,804: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T02:17:00.804606445Z [2024-04-06 02:17:00,804: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-06T02:17:00.804971261Z [2024-04-06 02:17:00,804: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T02:17:00.898011569Z [2024-04-06 02:17:00,897: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:17:01.487469588Z [2024-04-06 02:17:01,486: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3fff63f5-a785-4626-b63d-050c1f332b04] succeeded in 1.1839678150008695s: None 2024-04-06T02:17:01.749132752Z [2024-04-06 02:17:01,748: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:17:01.752777121Z [2024-04-06 02:17:01,752: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:17:01.769151806Z [2024-04-06 02:17:01,768: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:17:01.770422739Z [2024-04-06 02:17:01,770: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:17:01.770645025Z [2024-04-06 02:17:01,770: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:17:01.770818447Z [2024-04-06 02:17:01,770: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:17:01.770995711Z [2024-04-06 02:17:01,770: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:17:01.771627908Z [2024-04-06 02:17:01,771: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:17:01.771754776Z [2024-04-06 02:17:01,771: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:17:01.837293173Z [2024-04-06 02:17:01,836: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:17:01.841196254Z [2024-04-06 02:17:01,840: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:17:01.861034411Z [2024-04-06 02:17:01,860: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:17:01.861172226Z [2024-04-06 02:17:01,860: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:17:01.862857263Z [2024-04-06 02:17:01,862: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:17:01.863047945Z [2024-04-06 02:17:01,862: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:17:01.863668444Z [2024-04-06 02:17:01,863: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:17:01.863777625Z [2024-04-06 02:17:01,863: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:17:01.864079876Z [2024-04-06 02:17:01,863: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:17:01.864517674Z [2024-04-06 02:17:01,864: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:17:01.985843089Z [2024-04-06 02:17:01,985: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:17:03.354303275Z [2024-04-06 02:17:03,353: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1cd317d7-276e-4bcb-9f3e-79d58ac9d5a8] succeeded in 3.0737871969995467s: None 2024-04-06T02:17:03.906679727Z [2024-04-06 02:17:03,906: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6b7679af-e845-47d8-91ab-ce638d71d99c] succeeded in 3.629696772999523s: None 2024-04-06T02:18:00.675132795Z [2024-04-06 02:18:00,674: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9280894b-99f3-41c4-8a31-63316d092125] received 2024-04-06T02:18:00.677592464Z [2024-04-06 02:18:00,677: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ed8fa349-bb04-4ddc-a720-314ecca80ae2] received 2024-04-06T02:18:00.681324209Z [2024-04-06 02:18:00,679: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3f76b765-4541-44c3-a868-cebad26d3508] received 2024-04-06T02:18:00.683555374Z [2024-04-06 02:18:00,683: INFO/ForkPoolWorker-15] [9280894b-99f3-41c4-8a31-63316d092125] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:18:00.683570623Z [2024-04-06 02:18:00,683: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cb3891bc-2320-47a6-b3f4-627c8335c3fc] received 2024-04-06T02:18:00.688754989Z [2024-04-06 02:18:00,688: INFO/ForkPoolWorker-16] [ed8fa349-bb04-4ddc-a720-314ecca80ae2] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T02:18:00.696343225Z [2024-04-06 02:18:00,695: INFO/ForkPoolWorker-2] [cb3891bc-2320-47a6-b3f4-627c8335c3fc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:18:00.696876339Z [2024-04-06 02:18:00,696: INFO/ForkPoolWorker-1] [3f76b765-4541-44c3-a868-cebad26d3508] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T02:18:00.986569957Z [2024-04-06 02:18:00,983: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:18:01.010019725Z [2024-04-06 02:18:01,006: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:18:01.030093433Z [2024-04-06 02:18:01,026: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T02:18:01.097729215Z [2024-04-06 02:18:01,092: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T02:18:01.316391353Z [2024-04-06 02:18:01,316: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:18:01.372676618Z [2024-04-06 02:18:01,372: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-06T02:18:01.376651557Z [2024-04-06 02:18:01,376: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:18:01.414777062Z [2024-04-06 02:18:01,414: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T02:18:01.420491873Z [2024-04-06 02:18:01,420: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T02:18:01.420604011Z [2024-04-06 02:18:01,420: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T02:18:01.420674712Z [2024-04-06 02:18:01,420: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-06T02:18:01.421056715Z [2024-04-06 02:18:01,420: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T02:18:01.522040019Z [2024-04-06 02:18:01,521: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:18:01.844465175Z [2024-04-06 02:18:01,844: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ed8fa349-bb04-4ddc-a720-314ecca80ae2] succeeded in 1.1656958289986505s: None 2024-04-06T02:18:02.079299599Z [2024-04-06 02:18:02,078: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3f76b765-4541-44c3-a868-cebad26d3508] succeeded in 1.395677632001025s: None 2024-04-06T02:18:02.198325834Z [2024-04-06 02:18:02,197: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:18:02.201531795Z [2024-04-06 02:18:02,201: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:18:02.225773567Z [2024-04-06 02:18:02,225: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:18:02.228299930Z [2024-04-06 02:18:02,228: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:18:02.228314533Z [2024-04-06 02:18:02,228: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:18:02.228485163Z [2024-04-06 02:18:02,228: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:18:02.228494553Z [2024-04-06 02:18:02,228: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:18:02.228684090Z [2024-04-06 02:18:02,228: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:18:02.228693396Z [2024-04-06 02:18:02,228: INFO/ForkPoolWorker-15] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:18:02.238077498Z [2024-04-06 02:18:02,237: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-06T02:18:02.241437578Z [2024-04-06 02:18:02,240: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:18:02.265966601Z [2024-04-06 02:18:02,265: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T02:18:02.267648811Z [2024-04-06 02:18:02,267: INFO/ForkPoolWorker-2] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:18:02.267659105Z [2024-04-06 02:18:02,267: INFO/ForkPoolWorker-2] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:18:02.267854219Z [2024-04-06 02:18:02,267: INFO/ForkPoolWorker-2] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:18:02.267962310Z [2024-04-06 02:18:02,267: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-06T02:18:02.268526004Z [2024-04-06 02:18:02,268: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:18:02.268597077Z [2024-04-06 02:18:02,268: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:18:02.305995656Z [2024-04-06 02:18:02,305: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:18:02.389160991Z [2024-04-06 02:18:02,388: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:18:03.977217150Z [2024-04-06 02:18:03,976: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9280894b-99f3-41c4-8a31-63316d092125] succeeded in 3.298541546000706s: None 2024-04-06T02:18:04.378201318Z [2024-04-06 02:18:04,377: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[cb3891bc-2320-47a6-b3f4-627c8335c3fc] succeeded in 3.692084876000081s: None 2024-04-06T02:19:01.055646930Z [2024-04-06 02:19:01,055: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ab1101eb-f19d-4785-a64a-ae0b77cebe73] received 2024-04-06T02:19:01.060066843Z [2024-04-06 02:19:01,059: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c5bd9928-ce56-4e0f-8759-ab9a608156da] received 2024-04-06T02:19:01.062539781Z [2024-04-06 02:19:01,062: INFO/ForkPoolWorker-15] [ab1101eb-f19d-4785-a64a-ae0b77cebe73] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:19:01.068280496Z [2024-04-06 02:19:01,068: INFO/ForkPoolWorker-16] [c5bd9928-ce56-4e0f-8759-ab9a608156da] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:19:01.071884984Z [2024-04-06 02:19:01,071: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[71d97c4f-8fad-4723-8d85-677202d51db8] received 2024-04-06T02:19:01.082348692Z [2024-04-06 02:19:01,082: INFO/ForkPoolWorker-1] [71d97c4f-8fad-4723-8d85-677202d51db8] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T02:19:01.395803410Z [2024-04-06 02:19:01,392: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:19:01.398061684Z [2024-04-06 02:19:01,394: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:19:01.402084336Z [2024-04-06 02:19:01,399: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T02:19:01.558589775Z [2024-04-06 02:19:01,558: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-06T02:19:01.562627078Z [2024-04-06 02:19:01,562: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:19:01.593661256Z [2024-04-06 02:19:01,593: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T02:19:01.595071403Z [2024-04-06 02:19:01,594: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T02:19:01.595412371Z [2024-04-06 02:19:01,594: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T02:19:01.595425760Z [2024-04-06 02:19:01,595: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-06T02:19:01.596430541Z [2024-04-06 02:19:01,596: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T02:19:01.687326828Z [2024-04-06 02:19:01,687: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:19:02.344523971Z [2024-04-06 02:19:02,344: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[71d97c4f-8fad-4723-8d85-677202d51db8] succeeded in 1.2675682549997873s: None 2024-04-06T02:19:02.572966679Z [2024-04-06 02:19:02,572: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:19:02.576262656Z [2024-04-06 02:19:02,575: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:19:02.596038954Z [2024-04-06 02:19:02,595: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:19:02.597381235Z [2024-04-06 02:19:02,597: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:19:02.597429229Z [2024-04-06 02:19:02,597: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:19:02.597589392Z [2024-04-06 02:19:02,597: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:19:02.597634404Z [2024-04-06 02:19:02,597: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:19:02.597910842Z [2024-04-06 02:19:02,597: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:19:02.597953817Z [2024-04-06 02:19:02,597: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:19:02.663431935Z [2024-04-06 02:19:02,663: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:19:02.666807700Z [2024-04-06 02:19:02,666: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:19:02.684518697Z [2024-04-06 02:19:02,684: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:19:02.686492561Z [2024-04-06 02:19:02,686: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:19:02.686914502Z [2024-04-06 02:19:02,686: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:19:02.687147632Z [2024-04-06 02:19:02,686: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:19:02.687369394Z [2024-04-06 02:19:02,687: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:19:02.687951892Z [2024-04-06 02:19:02,687: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:19:02.688146673Z [2024-04-06 02:19:02,688: INFO/ForkPoolWorker-15] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:19:02.691608321Z [2024-04-06 02:19:02,691: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:19:02.768612830Z [2024-04-06 02:19:02,768: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:19:04.362971671Z [2024-04-06 02:19:04,362: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ab1101eb-f19d-4785-a64a-ae0b77cebe73] succeeded in 3.304993159999867s: None 2024-04-06T02:19:04.685566310Z [2024-04-06 02:19:04,685: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c5bd9928-ce56-4e0f-8759-ab9a608156da] succeeded in 3.6233615620003548s: None 2024-04-06T02:20:00.348886137Z [2024-04-06 02:20:00,348: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2341acc9-e491-4ada-9265-2d1a7e20a7ff] received 2024-04-06T02:20:00.352384181Z [2024-04-06 02:20:00,352: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b133d019-43f3-4c00-be5e-7ae1cfc4879d] received 2024-04-06T02:20:00.357728256Z [2024-04-06 02:20:00,357: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d516014f-b55f-4573-83ab-70fb220a2dec] received 2024-04-06T02:20:00.361120173Z [2024-04-06 02:20:00,360: INFO/ForkPoolWorker-16] [b133d019-43f3-4c00-be5e-7ae1cfc4879d] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T02:20:00.362558979Z [2024-04-06 02:20:00,362: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[566174a6-84c7-40f9-9db0-17444cc201d2] received 2024-04-06T02:20:00.364766084Z [2024-04-06 02:20:00,364: INFO/ForkPoolWorker-15] [2341acc9-e491-4ada-9265-2d1a7e20a7ff] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:20:00.369594506Z [2024-04-06 02:20:00,369: INFO/ForkPoolWorker-2] [566174a6-84c7-40f9-9db0-17444cc201d2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:20:00.375980258Z [2024-04-06 02:20:00,375: INFO/ForkPoolWorker-1] [d516014f-b55f-4573-83ab-70fb220a2dec] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T02:20:00.384340936Z [2024-04-06 02:20:00,383: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f898d7d4-ffd4-460d-9439-555ac66e614d] received 2024-04-06T02:20:00.397565893Z [2024-04-06 02:20:00,397: INFO/ForkPoolWorker-3] [f898d7d4-ffd4-460d-9439-555ac66e614d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:20:00.710832423Z [2024-04-06 02:20:00,699: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T02:20:00.726417852Z [2024-04-06 02:20:00,713: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T02:20:00.776277989Z [2024-04-06 02:20:00,772: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:20:00.843612869Z [2024-04-06 02:20:00,839: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:20:00.890235154Z [2024-04-06 02:20:00,886: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:20:00.906030356Z [2024-04-06 02:20:00,905: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-06T02:20:00.910238634Z [2024-04-06 02:20:00,909: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:20:00.977744383Z [2024-04-06 02:20:00,977: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T02:20:00.978949731Z [2024-04-06 02:20:00,978: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T02:20:00.979124361Z [2024-04-06 02:20:00,978: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T02:20:00.979147869Z [2024-04-06 02:20:00,979: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-06T02:20:00.979561939Z [2024-04-06 02:20:00,979: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T02:20:01.043410914Z [2024-04-06 02:20:01,043: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:20:01.133275037Z [2024-04-06 02:20:01,132: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:20:01.826260859Z [2024-04-06 02:20:01,825: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b133d019-43f3-4c00-be5e-7ae1cfc4879d] succeeded in 1.4716537479998806s: None 2024-04-06T02:20:01.877891218Z [2024-04-06 02:20:01,877: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d516014f-b55f-4573-83ab-70fb220a2dec] succeeded in 1.5168963380001514s: None 2024-04-06T02:20:02.502997901Z [2024-04-06 02:20:02,502: INFO/ForkPoolWorker-3] Getting VIM list 2024-04-06T02:20:02.506476043Z [2024-04-06 02:20:02,505: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:20:02.533625952Z [2024-04-06 02:20:02,533: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-06T02:20:02.537478395Z [2024-04-06 02:20:02,536: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:20:02.553717057Z [2024-04-06 02:20:02,553: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:20:02.558180377Z [2024-04-06 02:20:02,557: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:20:02.559471240Z [2024-04-06 02:20:02,559: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-06T02:20:02.563120715Z [2024-04-06 02:20:02,562: INFO/ForkPoolWorker-3] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:20:02.563329538Z [2024-04-06 02:20:02,563: INFO/ForkPoolWorker-3] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:20:02.563711023Z [2024-04-06 02:20:02,563: INFO/ForkPoolWorker-3] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:20:02.563868214Z [2024-04-06 02:20:02,563: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-04-06T02:20:02.564385620Z [2024-04-06 02:20:02,564: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:20:02.564675204Z [2024-04-06 02:20:02,564: INFO/ForkPoolWorker-3] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:20:02.567840578Z [2024-04-06 02:20:02,567: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T02:20:02.569325821Z [2024-04-06 02:20:02,569: INFO/ForkPoolWorker-2] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:20:02.569349503Z [2024-04-06 02:20:02,569: INFO/ForkPoolWorker-2] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:20:02.569497641Z [2024-04-06 02:20:02,569: INFO/ForkPoolWorker-2] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:20:02.569512288Z [2024-04-06 02:20:02,569: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-06T02:20:02.569726745Z [2024-04-06 02:20:02,569: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:20:02.569740663Z [2024-04-06 02:20:02,569: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:20:02.590153592Z [2024-04-06 02:20:02,589: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:20:02.591676515Z [2024-04-06 02:20:02,591: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:20:02.591768764Z [2024-04-06 02:20:02,591: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:20:02.592006381Z [2024-04-06 02:20:02,591: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:20:02.592146676Z [2024-04-06 02:20:02,591: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:20:02.592612327Z [2024-04-06 02:20:02,592: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:20:02.592753578Z [2024-04-06 02:20:02,592: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:20:02.673845892Z [2024-04-06 02:20:02,673: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:20:02.686555717Z [2024-04-06 02:20:02,686: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:20:02.701978771Z [2024-04-06 02:20:02,701: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:20:03.375214816Z [2024-04-06 02:20:03,374: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2341acc9-e491-4ada-9265-2d1a7e20a7ff] succeeded in 3.019806783000604s: None 2024-04-06T02:20:04.399895921Z [2024-04-06 02:20:04,399: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[350216d8-d9c9-4761-a3ca-a25f8f0b81a3] received 2024-04-06T02:20:04.412967898Z [2024-04-06 02:20:04,412: INFO/ForkPoolWorker-15] [350216d8-d9c9-4761-a3ca-a25f8f0b81a3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'split_metrics', 'scheduled__2024-04-06T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:20:04.752244562Z [2024-04-06 02:20:04,748: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:20:04.806291737Z [2024-04-06 02:20:04,805: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[566174a6-84c7-40f9-9db0-17444cc201d2] succeeded in 4.442129188999388s: None 2024-04-06T02:20:04.901887035Z [2024-04-06 02:20:04,901: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[f898d7d4-ffd4-460d-9439-555ac66e614d] succeeded in 4.512688004000665s: None 2024-04-06T02:20:06.086776794Z [2024-04-06 02:20:06,085: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:20:06.091134894Z [2024-04-06 02:20:06,090: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:20:06.112350283Z [2024-04-06 02:20:06,112: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:20:06.114519858Z [2024-04-06 02:20:06,114: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:20:06.114904944Z [2024-04-06 02:20:06,114: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:20:06.115377651Z [2024-04-06 02:20:06,114: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:20:06.115698788Z [2024-04-06 02:20:06,115: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:20:06.116079542Z [2024-04-06 02:20:06,115: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:20:06.116274603Z [2024-04-06 02:20:06,116: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:20:06.204741924Z [2024-04-06 02:20:06,204: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:20:06.768552903Z [2024-04-06 02:20:06,768: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[350216d8-d9c9-4761-a3ca-a25f8f0b81a3] succeeded in 2.3667683969997597s: None 2024-04-06T02:20:06.821057722Z [2024-04-06 02:20:06,820: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[831ce1ac-a054-42c0-82c3-7c19ecbfef29] received 2024-04-06T02:20:06.827418740Z [2024-04-06 02:20:06,827: INFO/ForkPoolWorker-15] [831ce1ac-a054-42c0-82c3-7c19ecbfef29] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'collect_metrics', 'scheduled__2024-04-06T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T02:20:07.137192380Z [2024-04-06 02:20:07,133: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:20:08.286781454Z [2024-04-06 02:20:08,286: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:20:08.290998583Z [2024-04-06 02:20:08,289: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:20:08.321518554Z [2024-04-06 02:20:08,321: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:20:08.325848433Z [2024-04-06 02:20:08,324: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:20:08.325863582Z [2024-04-06 02:20:08,324: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:20:08.325868585Z [2024-04-06 02:20:08,324: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:20:08.325873638Z [2024-04-06 02:20:08,325: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:20:08.325877801Z [2024-04-06 02:20:08,325: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:20:08.325882150Z [2024-04-06 02:20:08,325: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:20:08.413235722Z [2024-04-06 02:20:08,412: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:20:09.770857408Z [2024-04-06 02:20:09,770: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[831ce1ac-a054-42c0-82c3-7c19ecbfef29] succeeded in 2.9473322030007694s: None 2024-04-06T02:20:10.586022327Z [2024-04-06 02:20:10,585: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0ee8acc1-dadc-456b-a62c-44ff6c1e5d4b] received 2024-04-06T02:20:10.593906972Z [2024-04-06 02:20:10,593: INFO/ForkPoolWorker-15] [0ee8acc1-dadc-456b-a62c-44ff6c1e5d4b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'send_prometheus', 'scheduled__2024-04-06T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:20:10.886859813Z [2024-04-06 02:20:10,883: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:20:11.983356028Z [2024-04-06 02:20:11,982: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:20:11.986622427Z [2024-04-06 02:20:11,986: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:20:12.018436326Z [2024-04-06 02:20:12,018: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:20:12.019855919Z [2024-04-06 02:20:12,019: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:20:12.020043725Z [2024-04-06 02:20:12,019: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:20:12.020180756Z [2024-04-06 02:20:12,019: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:20:12.020333204Z [2024-04-06 02:20:12,020: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:20:12.020552827Z [2024-04-06 02:20:12,020: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:20:12.020695946Z [2024-04-06 02:20:12,020: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:20:12.112270377Z [2024-04-06 02:20:12,111: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:20:12.766915273Z [2024-04-06 02:20:12,766: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0ee8acc1-dadc-456b-a62c-44ff6c1e5d4b] succeeded in 2.178486586000872s: None 2024-04-06T02:21:00.302132191Z [2024-04-06 02:21:00,301: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d37bdfda-7702-454b-9a7a-fe013391ecc0] received 2024-04-06T02:21:00.304523109Z [2024-04-06 02:21:00,304: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5e1f338e-9369-4fc0-9459-013f25f71b08] received 2024-04-06T02:21:00.309983503Z [2024-04-06 02:21:00,309: INFO/ForkPoolWorker-15] [d37bdfda-7702-454b-9a7a-fe013391ecc0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:21:00.311670377Z [2024-04-06 02:21:00,311: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b4c681cc-3fa0-4a62-b01c-1b52d0208f3d] received 2024-04-06T02:21:00.313650587Z [2024-04-06 02:21:00,313: INFO/ForkPoolWorker-16] [5e1f338e-9369-4fc0-9459-013f25f71b08] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T02:21:00.327848477Z [2024-04-06 02:21:00,327: INFO/ForkPoolWorker-1] [b4c681cc-3fa0-4a62-b01c-1b52d0208f3d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:21:00.609125349Z [2024-04-06 02:21:00,605: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:21:00.621296834Z [2024-04-06 02:21:00,618: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T02:21:00.643194355Z [2024-04-06 02:21:00,639: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:21:00.788017998Z [2024-04-06 02:21:00,787: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-06T02:21:00.792161305Z [2024-04-06 02:21:00,791: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:21:00.831836337Z [2024-04-06 02:21:00,831: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:21:00.839779836Z [2024-04-06 02:21:00,839: INFO/ForkPoolWorker-16] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T02:21:00.843830311Z [2024-04-06 02:21:00,839: INFO/ForkPoolWorker-16] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T02:21:00.844020759Z [2024-04-06 02:21:00,843: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-06T02:21:00.844340482Z [2024-04-06 02:21:00,844: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T02:21:00.952008546Z [2024-04-06 02:21:00,951: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:21:01.539523174Z [2024-04-06 02:21:01,534: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5e1f338e-9369-4fc0-9459-013f25f71b08] succeeded in 1.2284060000001773s: None 2024-04-06T02:21:01.879228465Z [2024-04-06 02:21:01,878: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:21:01.882417358Z [2024-04-06 02:21:01,881: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:21:01.898339283Z [2024-04-06 02:21:01,898: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T02:21:01.902469097Z [2024-04-06 02:21:01,902: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:21:01.910913848Z [2024-04-06 02:21:01,910: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:21:01.912996453Z [2024-04-06 02:21:01,912: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:21:01.913039829Z [2024-04-06 02:21:01,912: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:21:01.913238393Z [2024-04-06 02:21:01,913: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:21:01.913350496Z [2024-04-06 02:21:01,913: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:21:01.913625430Z [2024-04-06 02:21:01,913: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:21:01.913705227Z [2024-04-06 02:21:01,913: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:21:01.923118228Z [2024-04-06 02:21:01,922: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T02:21:01.926324756Z [2024-04-06 02:21:01,926: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:21:01.926401586Z [2024-04-06 02:21:01,926: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:21:01.926542310Z [2024-04-06 02:21:01,926: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:21:01.926603603Z [2024-04-06 02:21:01,926: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T02:21:01.926903822Z [2024-04-06 02:21:01,926: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:21:01.926978742Z [2024-04-06 02:21:01,926: INFO/ForkPoolWorker-1] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:21:01.987496681Z [2024-04-06 02:21:01,987: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:21:02.021623457Z [2024-04-06 02:21:02,021: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:21:03.437019330Z [2024-04-06 02:21:03,435: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b4c681cc-3fa0-4a62-b01c-1b52d0208f3d] succeeded in 3.1201463760007755s: None 2024-04-06T02:21:04.030862053Z [2024-04-06 02:21:04,030: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d37bdfda-7702-454b-9a7a-fe013391ecc0] succeeded in 3.727254670999173s: None 2024-04-06T02:22:00.379871414Z [2024-04-06 02:22:00,379: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fcad8b9e-e741-4efc-82a6-d27d137aab36] received 2024-04-06T02:22:00.383928445Z [2024-04-06 02:22:00,383: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cc7383ab-74e1-47cc-a4de-9da755b4dded] received 2024-04-06T02:22:00.394427924Z [2024-04-06 02:22:00,394: INFO/ForkPoolWorker-16] [cc7383ab-74e1-47cc-a4de-9da755b4dded] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:22:00.394978270Z [2024-04-06 02:22:00,394: INFO/ForkPoolWorker-15] [fcad8b9e-e741-4efc-82a6-d27d137aab36] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T02:22:00.401294101Z [2024-04-06 02:22:00,401: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a4284393-8dc4-4239-bb81-b88070be67a5] received 2024-04-06T02:22:00.411343004Z [2024-04-06 02:22:00,410: INFO/ForkPoolWorker-1] [a4284393-8dc4-4239-bb81-b88070be67a5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:22:00.416029395Z [2024-04-06 02:22:00,415: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[10d01b71-b18a-4c94-9dac-d1de77057cd9] received 2024-04-06T02:22:00.444512368Z [2024-04-06 02:22:00,444: INFO/ForkPoolWorker-2] [10d01b71-b18a-4c94-9dac-d1de77057cd9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T02:22:00.734503743Z [2024-04-06 02:22:00,731: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T02:22:00.796055753Z [2024-04-06 02:22:00,792: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:22:00.876819428Z [2024-04-06 02:22:00,873: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T02:22:01.021633596Z [2024-04-06 02:22:01,021: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:22:01.048338456Z [2024-04-06 02:22:01,047: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-06T02:22:01.052259825Z [2024-04-06 02:22:01,051: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:22:01.084711224Z [2024-04-06 02:22:01,081: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:22:01.100509021Z [2024-04-06 02:22:01,100: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T02:22:01.104179994Z [2024-04-06 02:22:01,103: INFO/ForkPoolWorker-2] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T02:22:01.104352791Z [2024-04-06 02:22:01,104: INFO/ForkPoolWorker-2] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T02:22:01.104441899Z [2024-04-06 02:22:01,104: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-06T02:22:01.104665635Z [2024-04-06 02:22:01,104: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T02:22:01.231912920Z [2024-04-06 02:22:01,231: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:22:01.731398973Z [2024-04-06 02:22:01,730: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fcad8b9e-e741-4efc-82a6-d27d137aab36] succeeded in 1.3470036760008952s: None 2024-04-06T02:22:01.943868016Z [2024-04-06 02:22:01,943: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[10d01b71-b18a-4c94-9dac-d1de77057cd9] succeeded in 1.5255444979993626s: None 2024-04-06T02:22:02.133607440Z [2024-04-06 02:22:02,133: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:22:02.137015674Z [2024-04-06 02:22:02,136: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:22:02.156065258Z [2024-04-06 02:22:02,155: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:22:02.157206707Z [2024-04-06 02:22:02,156: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:22:02.157316909Z [2024-04-06 02:22:02,157: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:22:02.157498722Z [2024-04-06 02:22:02,157: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:22:02.157610545Z [2024-04-06 02:22:02,157: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:22:02.157970546Z [2024-04-06 02:22:02,157: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:22:02.158102917Z [2024-04-06 02:22:02,157: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:22:02.253818836Z [2024-04-06 02:22:02,253: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:22:02.304296700Z [2024-04-06 02:22:02,303: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T02:22:02.307424546Z [2024-04-06 02:22:02,306: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:22:02.328056161Z [2024-04-06 02:22:02,327: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T02:22:02.329185589Z [2024-04-06 02:22:02,328: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:22:02.329202725Z [2024-04-06 02:22:02,329: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:22:02.329328812Z [2024-04-06 02:22:02,329: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:22:02.329441960Z [2024-04-06 02:22:02,329: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T02:22:02.329804122Z [2024-04-06 02:22:02,329: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:22:02.329820818Z [2024-04-06 02:22:02,329: INFO/ForkPoolWorker-1] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:22:02.402010674Z [2024-04-06 02:22:02,401: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:22:03.959164638Z [2024-04-06 02:22:03,958: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a4284393-8dc4-4239-bb81-b88070be67a5] succeeded in 3.555386998999893s: None 2024-04-06T02:22:04.212594520Z [2024-04-06 02:22:04,211: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[cc7383ab-74e1-47cc-a4de-9da755b4dded] succeeded in 3.8265256310005498s: None 2024-04-06T02:23:01.024566938Z [2024-04-06 02:23:01,024: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e69bdec1-5453-4b80-9f2b-aec614209bab] received 2024-04-06T02:23:01.026960329Z [2024-04-06 02:23:01,026: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[204f9afa-d381-4483-9fe8-60879f407d3d] received 2024-04-06T02:23:01.034094388Z [2024-04-06 02:23:01,033: INFO/ForkPoolWorker-15] [e69bdec1-5453-4b80-9f2b-aec614209bab] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T02:23:01.034158973Z [2024-04-06 02:23:01,033: INFO/ForkPoolWorker-16] [204f9afa-d381-4483-9fe8-60879f407d3d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:23:01.041190451Z [2024-04-06 02:23:01,040: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cbc08d03-3a21-4ad8-ac94-77153048d18b] received 2024-04-06T02:23:01.052766223Z [2024-04-06 02:23:01,052: INFO/ForkPoolWorker-1] [cbc08d03-3a21-4ad8-ac94-77153048d18b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:23:01.380718910Z [2024-04-06 02:23:01,375: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T02:23:01.442078192Z [2024-04-06 02:23:01,435: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:23:01.533374771Z [2024-04-06 02:23:01,529: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:23:01.575166385Z [2024-04-06 02:23:01,574: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-06T02:23:01.581699920Z [2024-04-06 02:23:01,581: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:23:01.620722964Z [2024-04-06 02:23:01,620: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:23:01.621928705Z [2024-04-06 02:23:01,621: INFO/ForkPoolWorker-15] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T02:23:01.622095253Z [2024-04-06 02:23:01,621: INFO/ForkPoolWorker-15] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T02:23:01.622279576Z [2024-04-06 02:23:01,622: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-06T02:23:01.622652406Z [2024-04-06 02:23:01,622: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T02:23:01.735390719Z [2024-04-06 02:23:01,735: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:23:02.355058131Z [2024-04-06 02:23:02,354: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e69bdec1-5453-4b80-9f2b-aec614209bab] succeeded in 1.3271711809993576s: None 2024-04-06T02:23:02.701187497Z [2024-04-06 02:23:02,700: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T02:23:02.704276577Z [2024-04-06 02:23:02,703: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:23:02.733043951Z [2024-04-06 02:23:02,732: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:23:02.736100760Z [2024-04-06 02:23:02,735: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:23:02.736399097Z [2024-04-06 02:23:02,736: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T02:23:02.737718504Z [2024-04-06 02:23:02,737: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:23:02.737735345Z [2024-04-06 02:23:02,737: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:23:02.737895009Z [2024-04-06 02:23:02,737: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:23:02.737970532Z [2024-04-06 02:23:02,737: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T02:23:02.738296901Z [2024-04-06 02:23:02,738: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:23:02.738446705Z [2024-04-06 02:23:02,738: INFO/ForkPoolWorker-1] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:23:02.757653549Z [2024-04-06 02:23:02,757: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:23:02.759023643Z [2024-04-06 02:23:02,758: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:23:02.759228577Z [2024-04-06 02:23:02,759: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:23:02.759497047Z [2024-04-06 02:23:02,759: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:23:02.759677491Z [2024-04-06 02:23:02,759: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:23:02.760142312Z [2024-04-06 02:23:02,759: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:23:02.760323986Z [2024-04-06 02:23:02,760: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:23:02.817498129Z [2024-04-06 02:23:02,817: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:23:02.845177861Z [2024-04-06 02:23:02,844: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:23:04.342126920Z [2024-04-06 02:23:04,340: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[cbc08d03-3a21-4ad8-ac94-77153048d18b] succeeded in 3.2982128619987634s: None 2024-04-06T02:23:04.650640161Z [2024-04-06 02:23:04,650: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[204f9afa-d381-4483-9fe8-60879f407d3d] succeeded in 3.6218687250002404s: None 2024-04-06T02:24:01.072848705Z [2024-04-06 02:24:01,072: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b883dadd-18e0-47ed-81c8-9b8422a32910] received 2024-04-06T02:24:01.075012585Z [2024-04-06 02:24:01,074: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3ecaef29-321e-4522-90d4-b6ac38eed2e7] received 2024-04-06T02:24:01.080592780Z [2024-04-06 02:24:01,080: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b7cec4e1-e364-42f9-b20f-e9f7137d7bdf] received 2024-04-06T02:24:01.093665377Z [2024-04-06 02:24:01,093: INFO/ForkPoolWorker-16] [3ecaef29-321e-4522-90d4-b6ac38eed2e7] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T02:24:01.094020292Z [2024-04-06 02:24:01,093: INFO/ForkPoolWorker-1] [b7cec4e1-e364-42f9-b20f-e9f7137d7bdf] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T02:24:01.096670237Z [2024-04-06 02:24:01,096: INFO/ForkPoolWorker-15] [b883dadd-18e0-47ed-81c8-9b8422a32910] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:24:01.104603443Z [2024-04-06 02:24:01,104: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1dc7fdbc-dc42-43a8-9827-fe56128a94ab] received 2024-04-06T02:24:01.134479110Z [2024-04-06 02:24:01,134: INFO/ForkPoolWorker-2] [1dc7fdbc-dc42-43a8-9827-fe56128a94ab] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:24:01.403989814Z [2024-04-06 02:24:01,401: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T02:24:01.476768222Z [2024-04-06 02:24:01,472: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:24:01.482838730Z [2024-04-06 02:24:01,476: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T02:24:01.558091731Z [2024-04-06 02:24:01,553: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:24:01.570994771Z [2024-04-06 02:24:01,570: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-06T02:24:01.575083482Z [2024-04-06 02:24:01,574: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:24:01.600953423Z [2024-04-06 02:24:01,600: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T02:24:01.601957576Z [2024-04-06 02:24:01,601: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T02:24:01.602154202Z [2024-04-06 02:24:01,601: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T02:24:01.602280822Z [2024-04-06 02:24:01,602: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-06T02:24:01.602695165Z [2024-04-06 02:24:01,602: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T02:24:01.698026061Z [2024-04-06 02:24:01,697: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:24:01.841506659Z [2024-04-06 02:24:01,841: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:24:02.447986249Z [2024-04-06 02:24:02,447: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b7cec4e1-e364-42f9-b20f-e9f7137d7bdf] succeeded in 1.3635099999992235s: None 2024-04-06T02:24:02.511443780Z [2024-04-06 02:24:02,511: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3ecaef29-321e-4522-90d4-b6ac38eed2e7] succeeded in 1.4345720210003492s: None 2024-04-06T02:24:02.901580803Z [2024-04-06 02:24:02,901: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-06T02:24:02.904859005Z [2024-04-06 02:24:02,904: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:24:02.924646296Z [2024-04-06 02:24:02,923: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T02:24:02.926125429Z [2024-04-06 02:24:02,925: INFO/ForkPoolWorker-2] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:24:02.926142347Z [2024-04-06 02:24:02,926: INFO/ForkPoolWorker-2] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:24:02.926266130Z [2024-04-06 02:24:02,926: INFO/ForkPoolWorker-2] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:24:02.926296659Z [2024-04-06 02:24:02,926: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-06T02:24:02.926506307Z [2024-04-06 02:24:02,926: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:24:02.926532349Z [2024-04-06 02:24:02,926: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:24:03.004887463Z [2024-04-06 02:24:03,003: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:24:03.008200217Z [2024-04-06 02:24:03,007: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:24:03.023910652Z [2024-04-06 02:24:03,023: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:24:03.027434711Z [2024-04-06 02:24:03,027: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:24:03.028692235Z [2024-04-06 02:24:03,028: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:24:03.028798167Z [2024-04-06 02:24:03,028: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:24:03.028934061Z [2024-04-06 02:24:03,028: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:24:03.029063957Z [2024-04-06 02:24:03,028: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:24:03.029310056Z [2024-04-06 02:24:03,029: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:24:03.029674542Z [2024-04-06 02:24:03,029: INFO/ForkPoolWorker-15] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:24:03.104796048Z [2024-04-06 02:24:03,104: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:24:04.687214354Z [2024-04-06 02:24:04,686: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b883dadd-18e0-47ed-81c8-9b8422a32910] succeeded in 3.6078496070003894s: None 2024-04-06T02:24:05.017603275Z [2024-04-06 02:24:05,017: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[1dc7fdbc-dc42-43a8-9827-fe56128a94ab] succeeded in 3.910867839000275s: None 2024-04-06T02:25:00.937187480Z [2024-04-06 02:25:00,936: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0bfaca21-b84e-430e-a0c6-a5b159717319] received 2024-04-06T02:25:00.940613951Z [2024-04-06 02:25:00,940: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b96d8a0d-79d6-4a3c-9cf5-ec1ac86e9937] received 2024-04-06T02:25:00.945026740Z [2024-04-06 02:25:00,944: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[032e9e22-ebdc-4f7e-992e-b668f522e8ec] received 2024-04-06T02:25:00.955959916Z [2024-04-06 02:25:00,955: INFO/ForkPoolWorker-16] [b96d8a0d-79d6-4a3c-9cf5-ec1ac86e9937] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:25:00.956471927Z [2024-04-06 02:25:00,956: INFO/ForkPoolWorker-15] [0bfaca21-b84e-430e-a0c6-a5b159717319] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:25:00.964566043Z [2024-04-06 02:25:00,964: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6e835dcc-2c1b-4b1f-bac2-3338adb13c51] received 2024-04-06T02:25:00.966265410Z [2024-04-06 02:25:00,965: INFO/ForkPoolWorker-1] [032e9e22-ebdc-4f7e-992e-b668f522e8ec] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T02:25:00.972855736Z [2024-04-06 02:25:00,972: INFO/ForkPoolWorker-2] [6e835dcc-2c1b-4b1f-bac2-3338adb13c51] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:25:01.251384767Z [2024-04-06 02:25:01,247: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:25:01.298951917Z [2024-04-06 02:25:01,295: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:25:01.399245016Z [2024-04-06 02:25:01,393: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T02:25:01.412479630Z [2024-04-06 02:25:01,409: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:25:01.614016152Z [2024-04-06 02:25:01,613: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-06T02:25:01.618443912Z [2024-04-06 02:25:01,617: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:25:01.664211470Z [2024-04-06 02:25:01,663: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T02:25:01.666939996Z [2024-04-06 02:25:01,666: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T02:25:01.666999680Z [2024-04-06 02:25:01,666: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T02:25:01.667063129Z [2024-04-06 02:25:01,666: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-06T02:25:01.667316754Z [2024-04-06 02:25:01,667: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T02:25:01.801458963Z [2024-04-06 02:25:01,801: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:25:02.398864004Z [2024-04-06 02:25:02,398: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[032e9e22-ebdc-4f7e-992e-b668f522e8ec] succeeded in 1.449615793000703s: None 2024-04-06T02:25:02.495446768Z [2024-04-06 02:25:02,495: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:25:02.498768188Z [2024-04-06 02:25:02,498: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:25:02.532582579Z [2024-04-06 02:25:02,532: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:25:02.533790629Z [2024-04-06 02:25:02,533: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:25:02.533801743Z [2024-04-06 02:25:02,533: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:25:02.533954035Z [2024-04-06 02:25:02,533: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:25:02.533961053Z [2024-04-06 02:25:02,533: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:25:02.534161548Z [2024-04-06 02:25:02,534: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:25:02.534189517Z [2024-04-06 02:25:02,534: INFO/ForkPoolWorker-15] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:25:02.570449577Z [2024-04-06 02:25:02,566: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-06T02:25:02.573806399Z [2024-04-06 02:25:02,573: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:25:02.615417433Z [2024-04-06 02:25:02,615: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T02:25:02.616371560Z [2024-04-06 02:25:02,616: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:25:02.617099109Z [2024-04-06 02:25:02,616: INFO/ForkPoolWorker-2] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:25:02.617209069Z [2024-04-06 02:25:02,617: INFO/ForkPoolWorker-2] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:25:02.617450679Z [2024-04-06 02:25:02,617: INFO/ForkPoolWorker-2] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:25:02.617574770Z [2024-04-06 02:25:02,617: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-06T02:25:02.617856354Z [2024-04-06 02:25:02,617: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:25:02.617976814Z [2024-04-06 02:25:02,617: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:25:02.737489808Z [2024-04-06 02:25:02,737: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:25:02.816032802Z [2024-04-06 02:25:02,815: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:25:02.819641751Z [2024-04-06 02:25:02,819: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:25:02.848307557Z [2024-04-06 02:25:02,848: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:25:02.849902101Z [2024-04-06 02:25:02,849: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:25:02.850132937Z [2024-04-06 02:25:02,849: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:25:02.850345256Z [2024-04-06 02:25:02,850: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:25:02.850560254Z [2024-04-06 02:25:02,850: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:25:02.850887283Z [2024-04-06 02:25:02,850: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:25:02.851405804Z [2024-04-06 02:25:02,851: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:25:02.944438825Z [2024-04-06 02:25:02,944: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:25:03.592474213Z [2024-04-06 02:25:03,592: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9d266457-5870-44da-b043-edf3ad894b11] received 2024-04-06T02:25:03.601243806Z [2024-04-06 02:25:03,600: INFO/ForkPoolWorker-1] [9d266457-5870-44da-b043-edf3ad894b11] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'split_metrics', 'scheduled__2024-04-06T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:25:03.615691379Z [2024-04-06 02:25:03,615: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b96d8a0d-79d6-4a3c-9cf5-ec1ac86e9937] succeeded in 2.6706550319995586s: None 2024-04-06T02:25:03.971547940Z [2024-04-06 02:25:03,968: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:25:04.251603048Z [2024-04-06 02:25:04,250: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0bfaca21-b84e-430e-a0c6-a5b159717319] succeeded in 3.3109120989993244s: None 2024-04-06T02:25:05.179642494Z [2024-04-06 02:25:05,179: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T02:25:05.183941563Z [2024-04-06 02:25:05,183: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:25:05.207703193Z [2024-04-06 02:25:05,207: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T02:25:05.211170723Z [2024-04-06 02:25:05,210: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:25:05.211436083Z [2024-04-06 02:25:05,211: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:25:05.211860559Z [2024-04-06 02:25:05,211: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:25:05.212080678Z [2024-04-06 02:25:05,211: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T02:25:05.212783584Z [2024-04-06 02:25:05,212: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:25:05.212990134Z [2024-04-06 02:25:05,212: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:25:05.312221104Z [2024-04-06 02:25:05,311: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:25:05.365581347Z [2024-04-06 02:25:05,364: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[6e835dcc-2c1b-4b1f-bac2-3338adb13c51] succeeded in 4.398578398000609s: None 2024-04-06T02:25:06.044725603Z [2024-04-06 02:25:06,043: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9d266457-5870-44da-b043-edf3ad894b11] succeeded in 2.448496081000485s: None 2024-04-06T02:25:06.178243545Z [2024-04-06 02:25:06,177: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[63b4b4a2-527c-4a86-97ff-3ed2b7f8977d] received 2024-04-06T02:25:06.188955127Z [2024-04-06 02:25:06,188: INFO/ForkPoolWorker-15] [63b4b4a2-527c-4a86-97ff-3ed2b7f8977d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'collect_metrics', 'scheduled__2024-04-06T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T02:25:06.482546922Z [2024-04-06 02:25:06,479: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:25:07.511553738Z [2024-04-06 02:25:07,511: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:25:07.514649100Z [2024-04-06 02:25:07,514: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:25:07.537617785Z [2024-04-06 02:25:07,537: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:25:07.539351022Z [2024-04-06 02:25:07,539: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:25:07.539451745Z [2024-04-06 02:25:07,539: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:25:07.539629679Z [2024-04-06 02:25:07,539: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:25:07.539700356Z [2024-04-06 02:25:07,539: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:25:07.539963188Z [2024-04-06 02:25:07,539: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:25:07.540092071Z [2024-04-06 02:25:07,539: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:25:07.624683994Z [2024-04-06 02:25:07,624: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:25:08.885522934Z [2024-04-06 02:25:08,884: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[63b4b4a2-527c-4a86-97ff-3ed2b7f8977d] succeeded in 2.7045512789991335s: None 2024-04-06T02:25:09.875216608Z [2024-04-06 02:25:09,874: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4ec94559-339f-45f3-afbc-68ab2f7e676b] received 2024-04-06T02:25:09.884680067Z [2024-04-06 02:25:09,884: INFO/ForkPoolWorker-15] [4ec94559-339f-45f3-afbc-68ab2f7e676b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'send_prometheus', 'scheduled__2024-04-06T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:25:10.200905110Z [2024-04-06 02:25:10,197: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:25:11.349410472Z [2024-04-06 02:25:11,348: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:25:11.352566523Z [2024-04-06 02:25:11,352: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:25:11.370771038Z [2024-04-06 02:25:11,370: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:25:11.372649505Z [2024-04-06 02:25:11,372: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:25:11.372773444Z [2024-04-06 02:25:11,372: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:25:11.373053701Z [2024-04-06 02:25:11,372: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:25:11.373531091Z [2024-04-06 02:25:11,373: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:25:11.373891808Z [2024-04-06 02:25:11,373: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:25:11.374078530Z [2024-04-06 02:25:11,373: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:25:11.457312946Z [2024-04-06 02:25:11,456: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:25:12.033027041Z [2024-04-06 02:25:12,032: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4ec94559-339f-45f3-afbc-68ab2f7e676b] succeeded in 2.1553963809983543s: None 2024-04-06T02:26:00.646747972Z [2024-04-06 02:26:00,646: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f4e09cb5-6201-41c1-850c-50cecbeadedb] received 2024-04-06T02:26:00.650770760Z [2024-04-06 02:26:00,650: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8851be20-96c5-498f-bb1e-b139ae03b96c] received 2024-04-06T02:26:00.661698970Z [2024-04-06 02:26:00,661: INFO/ForkPoolWorker-15] [f4e09cb5-6201-41c1-850c-50cecbeadedb] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T02:26:00.666429799Z [2024-04-06 02:26:00,666: INFO/ForkPoolWorker-16] [8851be20-96c5-498f-bb1e-b139ae03b96c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:26:00.670489134Z [2024-04-06 02:26:00,670: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[56256050-a6b3-4b6e-af64-b3688b0b1f1a] received 2024-04-06T02:26:00.678970816Z [2024-04-06 02:26:00,678: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4c284846-9a96-4947-8816-5d04832ec88c] received 2024-04-06T02:26:00.683655993Z [2024-04-06 02:26:00,683: INFO/ForkPoolWorker-1] [56256050-a6b3-4b6e-af64-b3688b0b1f1a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:26:00.701935109Z [2024-04-06 02:26:00,699: INFO/ForkPoolWorker-2] [4c284846-9a96-4947-8816-5d04832ec88c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T02:26:00.966787278Z [2024-04-06 02:26:00,963: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T02:26:00.994240136Z [2024-04-06 02:26:00,991: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T02:26:01.056272012Z [2024-04-06 02:26:01,052: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:26:01.076344069Z [2024-04-06 02:26:01,072: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:26:01.167284516Z [2024-04-06 02:26:01,166: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-06T02:26:01.171686688Z [2024-04-06 02:26:01,171: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:26:01.197040107Z [2024-04-06 02:26:01,196: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T02:26:01.198459090Z [2024-04-06 02:26:01,198: INFO/ForkPoolWorker-2] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T02:26:01.198513845Z [2024-04-06 02:26:01,198: INFO/ForkPoolWorker-2] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T02:26:01.198572152Z [2024-04-06 02:26:01,198: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-06T02:26:01.198849840Z [2024-04-06 02:26:01,198: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T02:26:01.278042871Z [2024-04-06 02:26:01,277: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:26:01.291121251Z [2024-04-06 02:26:01,290: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:26:01.824014298Z [2024-04-06 02:26:01,823: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[4c284846-9a96-4947-8816-5d04832ec88c] succeeded in 1.1417238129997713s: None 2024-04-06T02:26:01.953178056Z [2024-04-06 02:26:01,952: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f4e09cb5-6201-41c1-850c-50cecbeadedb] succeeded in 1.3011469960001705s: None 2024-04-06T02:26:02.305448299Z [2024-04-06 02:26:02,305: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:26:02.308969614Z [2024-04-06 02:26:02,308: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:26:02.330465434Z [2024-04-06 02:26:02,330: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:26:02.331865260Z [2024-04-06 02:26:02,331: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:26:02.331934616Z [2024-04-06 02:26:02,331: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:26:02.332208597Z [2024-04-06 02:26:02,331: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:26:02.332349680Z [2024-04-06 02:26:02,332: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:26:02.332814345Z [2024-04-06 02:26:02,332: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:26:02.332830776Z [2024-04-06 02:26:02,332: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:26:02.409543710Z [2024-04-06 02:26:02,409: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T02:26:02.411005393Z [2024-04-06 02:26:02,410: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:26:02.413290413Z [2024-04-06 02:26:02,412: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:26:02.434426927Z [2024-04-06 02:26:02,434: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T02:26:02.439924731Z [2024-04-06 02:26:02,439: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:26:02.440003380Z [2024-04-06 02:26:02,439: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:26:02.440254913Z [2024-04-06 02:26:02,439: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:26:02.440434307Z [2024-04-06 02:26:02,440: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T02:26:02.440773431Z [2024-04-06 02:26:02,440: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:26:02.440917163Z [2024-04-06 02:26:02,440: INFO/ForkPoolWorker-1] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:26:02.537256060Z [2024-04-06 02:26:02,536: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:26:04.014064454Z [2024-04-06 02:26:04,013: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[56256050-a6b3-4b6e-af64-b3688b0b1f1a] succeeded in 3.3415957289998914s: None 2024-04-06T02:26:05.081202825Z [2024-04-06 02:26:05,080: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8851be20-96c5-498f-bb1e-b139ae03b96c] succeeded in 4.426037064000411s: None 2024-04-06T02:26:27.867637829Z [2024-04-06 02:26:27,867: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9a6d8f7a-a4d1-46c1-8202-c5dd02486209] received 2024-04-06T02:26:27.879750896Z [2024-04-06 02:26:27,879: INFO/ForkPoolWorker-15] [9a6d8f7a-a4d1-46c1-8202-c5dd02486209] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_alarm', 'main_task', 'vdu_alarm_20240406022627_920016', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_alarm.py'] 2024-04-06T02:26:28.164247991Z [2024-04-06 02:26:28,161: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_alarm.py 2024-04-06T02:26:28.418442276Z [2024-04-06 02:26:28,417: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:26:28.975978640Z [2024-04-06 02:26:28,975: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9a6d8f7a-a4d1-46c1-8202-c5dd02486209] succeeded in 1.1055889950002893s: None 2024-04-06T02:27:00.425112595Z [2024-04-06 02:27:00,424: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2675c202-c8a3-42f9-bfc6-8339ddb25b7a] received 2024-04-06T02:27:00.428840626Z [2024-04-06 02:27:00,428: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c265a146-fed1-4103-9e7e-155f08ec57f0] received 2024-04-06T02:27:00.433789816Z [2024-04-06 02:27:00,432: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c5d957f4-fe37-4f8b-8a1c-7d03f29e7257] received 2024-04-06T02:27:00.434682773Z [2024-04-06 02:27:00,434: INFO/ForkPoolWorker-15] [2675c202-c8a3-42f9-bfc6-8339ddb25b7a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:27:00.435447489Z [2024-04-06 02:27:00,435: INFO/ForkPoolWorker-16] [c265a146-fed1-4103-9e7e-155f08ec57f0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:27:00.446375839Z [2024-04-06 02:27:00,445: INFO/ForkPoolWorker-1] [c5d957f4-fe37-4f8b-8a1c-7d03f29e7257] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T02:27:00.737674798Z [2024-04-06 02:27:00,734: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:27:00.757130210Z [2024-04-06 02:27:00,753: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:27:00.791127194Z [2024-04-06 02:27:00,787: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T02:27:00.954539590Z [2024-04-06 02:27:00,954: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-06T02:27:00.958664571Z [2024-04-06 02:27:00,958: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:27:00.989899012Z [2024-04-06 02:27:00,989: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T02:27:00.991762602Z [2024-04-06 02:27:00,991: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T02:27:00.991953108Z [2024-04-06 02:27:00,991: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T02:27:00.992091678Z [2024-04-06 02:27:00,991: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-06T02:27:00.992500206Z [2024-04-06 02:27:00,992: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T02:27:01.118369878Z [2024-04-06 02:27:01,118: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:27:01.733045850Z [2024-04-06 02:27:01,732: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c5d957f4-fe37-4f8b-8a1c-7d03f29e7257] succeeded in 1.2957378909995896s: None 2024-04-06T02:27:01.977990871Z [2024-04-06 02:27:01,977: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:27:01.981347870Z [2024-04-06 02:27:01,980: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:27:01.999067865Z [2024-04-06 02:27:01,998: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:27:02.000896462Z [2024-04-06 02:27:02,000: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:27:02.000925688Z [2024-04-06 02:27:02,000: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:27:02.001102301Z [2024-04-06 02:27:02,000: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:27:02.001124843Z [2024-04-06 02:27:02,001: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:27:02.001442496Z [2024-04-06 02:27:02,001: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:27:02.001459657Z [2024-04-06 02:27:02,001: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:27:02.026585869Z [2024-04-06 02:27:02,026: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:27:02.030340837Z [2024-04-06 02:27:02,029: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:27:02.067558708Z [2024-04-06 02:27:02,067: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:27:02.070395657Z [2024-04-06 02:27:02,069: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:27:02.070539663Z [2024-04-06 02:27:02,070: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:27:02.070815782Z [2024-04-06 02:27:02,070: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:27:02.071038621Z [2024-04-06 02:27:02,070: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:27:02.072535717Z [2024-04-06 02:27:02,072: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:27:02.072761670Z [2024-04-06 02:27:02,072: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:27:02.077971443Z [2024-04-06 02:27:02,077: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:27:02.172693026Z [2024-04-06 02:27:02,172: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:27:03.850188434Z [2024-04-06 02:27:03,849: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c265a146-fed1-4103-9e7e-155f08ec57f0] succeeded in 3.419316716999674s: None 2024-04-06T02:27:04.016970883Z [2024-04-06 02:27:04,016: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2675c202-c8a3-42f9-bfc6-8339ddb25b7a] succeeded in 3.5888360050012125s: None 2024-04-06T02:28:00.935105697Z [2024-04-06 02:28:00,934: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4c0b770f-ec55-4666-a474-fba6053c7786] received 2024-04-06T02:28:00.939123906Z [2024-04-06 02:28:00,938: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c56e8a53-0b1a-4cbb-870c-8d1aa6132986] received 2024-04-06T02:28:00.941909031Z [2024-04-06 02:28:00,941: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[38ba86a4-f58c-4272-8568-641d9aee0d92] received 2024-04-06T02:28:00.951361772Z [2024-04-06 02:28:00,951: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1fe71927-fd29-4acc-b685-023b65da4be7] received 2024-04-06T02:28:00.952329845Z [2024-04-06 02:28:00,952: INFO/ForkPoolWorker-1] [38ba86a4-f58c-4272-8568-641d9aee0d92] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:28:00.957646998Z [2024-04-06 02:28:00,957: INFO/ForkPoolWorker-15] [4c0b770f-ec55-4666-a474-fba6053c7786] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T02:28:00.970997068Z [2024-04-06 02:28:00,970: INFO/ForkPoolWorker-16] [c56e8a53-0b1a-4cbb-870c-8d1aa6132986] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:28:00.973552841Z [2024-04-06 02:28:00,973: INFO/ForkPoolWorker-2] [1fe71927-fd29-4acc-b685-023b65da4be7] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T02:28:01.381913928Z [2024-04-06 02:28:01,378: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T02:28:01.382992943Z [2024-04-06 02:28:01,379: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:28:01.562653521Z [2024-04-06 02:28:01,562: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-06T02:28:01.566571361Z [2024-04-06 02:28:01,566: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:28:01.617612220Z [2024-04-06 02:28:01,617: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T02:28:01.627658945Z [2024-04-06 02:28:01,627: INFO/ForkPoolWorker-2] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T02:28:01.627823682Z [2024-04-06 02:28:01,627: INFO/ForkPoolWorker-2] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T02:28:01.627935997Z [2024-04-06 02:28:01,627: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-06T02:28:01.628199556Z [2024-04-06 02:28:01,628: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T02:28:01.673710829Z [2024-04-06 02:28:01,657: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:28:01.709776445Z [2024-04-06 02:28:01,706: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T02:28:01.732598300Z [2024-04-06 02:28:01,732: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:28:02.050530136Z [2024-04-06 02:28:02,050: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:28:02.468942293Z [2024-04-06 02:28:02,468: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[1fe71927-fd29-4acc-b685-023b65da4be7] succeeded in 1.5065430829999968s: None 2024-04-06T02:28:02.665813427Z [2024-04-06 02:28:02,665: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4c0b770f-ec55-4666-a474-fba6053c7786] succeeded in 1.7266657599993778s: None 2024-04-06T02:28:03.035060104Z [2024-04-06 02:28:03,034: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:28:03.038492902Z [2024-04-06 02:28:03,038: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:28:03.076500537Z [2024-04-06 02:28:03,076: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:28:03.078578651Z [2024-04-06 02:28:03,078: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:28:03.078804151Z [2024-04-06 02:28:03,078: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:28:03.079042843Z [2024-04-06 02:28:03,078: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:28:03.079182896Z [2024-04-06 02:28:03,079: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:28:03.079611139Z [2024-04-06 02:28:03,079: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:28:03.079627746Z [2024-04-06 02:28:03,079: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:28:03.161237846Z [2024-04-06 02:28:03,160: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T02:28:03.165026495Z [2024-04-06 02:28:03,164: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:28:03.169847824Z [2024-04-06 02:28:03,169: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:28:03.198540655Z [2024-04-06 02:28:03,198: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T02:28:03.200208905Z [2024-04-06 02:28:03,199: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:28:03.200366616Z [2024-04-06 02:28:03,200: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:28:03.200595027Z [2024-04-06 02:28:03,200: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:28:03.200746152Z [2024-04-06 02:28:03,200: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T02:28:03.201086493Z [2024-04-06 02:28:03,200: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:28:03.201262235Z [2024-04-06 02:28:03,201: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:28:03.298736647Z [2024-04-06 02:28:03,297: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:28:04.765739868Z [2024-04-06 02:28:04,765: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c56e8a53-0b1a-4cbb-870c-8d1aa6132986] succeeded in 3.8242334420010593s: None 2024-04-06T02:28:05.694856051Z [2024-04-06 02:28:05,694: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[38ba86a4-f58c-4272-8568-641d9aee0d92] succeeded in 4.750490607999382s: None 2024-04-06T02:29:00.882019852Z [2024-04-06 02:29:00,881: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[463e9e40-db3d-4b48-b909-9574a77f6fcf] received 2024-04-06T02:29:00.885905575Z [2024-04-06 02:29:00,885: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b96b6170-28d9-4e71-b592-488c90405c67] received 2024-04-06T02:29:00.889479591Z [2024-04-06 02:29:00,889: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7e5cfac3-3045-4b52-ba85-7f2aea0601dc] received 2024-04-06T02:29:00.899816973Z [2024-04-06 02:29:00,899: INFO/ForkPoolWorker-15] [463e9e40-db3d-4b48-b909-9574a77f6fcf] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T02:29:00.900377177Z [2024-04-06 02:29:00,900: INFO/ForkPoolWorker-16] [b96b6170-28d9-4e71-b592-488c90405c67] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:29:00.902934879Z [2024-04-06 02:29:00,902: INFO/ForkPoolWorker-1] [7e5cfac3-3045-4b52-ba85-7f2aea0601dc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:29:01.200032007Z [2024-04-06 02:29:01,196: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T02:29:01.212142602Z [2024-04-06 02:29:01,208: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:29:01.312429867Z [2024-04-06 02:29:01,308: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:29:01.357958730Z [2024-04-06 02:29:01,357: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-06T02:29:01.361937214Z [2024-04-06 02:29:01,361: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:29:01.382959047Z [2024-04-06 02:29:01,382: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:29:01.384864001Z [2024-04-06 02:29:01,384: INFO/ForkPoolWorker-15] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T02:29:01.384999646Z [2024-04-06 02:29:01,384: INFO/ForkPoolWorker-15] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T02:29:01.385108490Z [2024-04-06 02:29:01,384: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-06T02:29:01.385670577Z [2024-04-06 02:29:01,385: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T02:29:01.486809813Z [2024-04-06 02:29:01,486: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:29:02.060763213Z [2024-04-06 02:29:02,060: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[463e9e40-db3d-4b48-b909-9574a77f6fcf] succeeded in 1.176331188000404s: None 2024-04-06T02:29:02.400393619Z [2024-04-06 02:29:02,399: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:29:02.403543407Z [2024-04-06 02:29:02,403: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:29:02.405087494Z [2024-04-06 02:29:02,404: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T02:29:02.408294831Z [2024-04-06 02:29:02,407: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:29:02.423904754Z [2024-04-06 02:29:02,423: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:29:02.426470354Z [2024-04-06 02:29:02,426: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:29:02.426562719Z [2024-04-06 02:29:02,426: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:29:02.426729851Z [2024-04-06 02:29:02,426: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:29:02.426924313Z [2024-04-06 02:29:02,426: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:29:02.427358007Z [2024-04-06 02:29:02,427: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:29:02.427441030Z [2024-04-06 02:29:02,427: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:29:02.433648574Z [2024-04-06 02:29:02,433: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T02:29:02.435014514Z [2024-04-06 02:29:02,434: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:29:02.435103261Z [2024-04-06 02:29:02,435: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:29:02.435318826Z [2024-04-06 02:29:02,435: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:29:02.435443646Z [2024-04-06 02:29:02,435: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T02:29:02.436106028Z [2024-04-06 02:29:02,435: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:29:02.436112070Z [2024-04-06 02:29:02,436: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:29:02.522444789Z [2024-04-06 02:29:02,522: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:29:02.562742050Z [2024-04-06 02:29:02,562: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:29:04.477377798Z [2024-04-06 02:29:04,476: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b96b6170-28d9-4e71-b592-488c90405c67] succeeded in 3.5886611139994784s: None 2024-04-06T02:29:04.885807773Z [2024-04-06 02:29:04,885: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7e5cfac3-3045-4b52-ba85-7f2aea0601dc] succeeded in 3.9935231840008782s: None 2024-04-06T02:30:00.802093456Z [2024-04-06 02:30:00,801: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f5e496f8-3b40-48bf-b8de-5913b2978720] received 2024-04-06T02:30:00.806718685Z [2024-04-06 02:30:00,805: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[319f16ed-7ed5-4f13-972e-15fa02987ade] received 2024-04-06T02:30:00.809431273Z [2024-04-06 02:30:00,809: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5856df06-9716-45e3-96b6-6c5f24b5bae6] received 2024-04-06T02:30:00.813737829Z [2024-04-06 02:30:00,813: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[10add935-9164-48f5-888c-335aea3ff877] received 2024-04-06T02:30:00.817201664Z [2024-04-06 02:30:00,816: INFO/ForkPoolWorker-16] [319f16ed-7ed5-4f13-972e-15fa02987ade] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:30:00.824268684Z [2024-04-06 02:30:00,823: INFO/ForkPoolWorker-15] [f5e496f8-3b40-48bf-b8de-5913b2978720] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:30:00.831598431Z [2024-04-06 02:30:00,831: INFO/ForkPoolWorker-1] [5856df06-9716-45e3-96b6-6c5f24b5bae6] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T02:30:00.832338713Z [2024-04-06 02:30:00,832: INFO/ForkPoolWorker-2] [10add935-9164-48f5-888c-335aea3ff877] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:30:00.846443949Z [2024-04-06 02:30:00,846: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[75595d68-0107-4231-873b-20ae0408ebdd] received 2024-04-06T02:30:00.868709331Z [2024-04-06 02:30:00,868: INFO/ForkPoolWorker-3] [75595d68-0107-4231-873b-20ae0408ebdd] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T02:30:01.169160414Z [2024-04-06 02:30:01,166: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:30:01.169666118Z [2024-04-06 02:30:01,166: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:30:01.246077705Z [2024-04-06 02:30:01,242: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T02:30:01.458392692Z [2024-04-06 02:30:01,457: INFO/ForkPoolWorker-3] Getting SDNC list 2024-04-06T02:30:01.462377622Z [2024-04-06 02:30:01,461: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:30:01.511374369Z [2024-04-06 02:30:01,511: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-06T02:30:01.516346933Z [2024-04-06 02:30:01,516: INFO/ForkPoolWorker-3] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T02:30:01.516513073Z [2024-04-06 02:30:01,516: INFO/ForkPoolWorker-3] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T02:30:01.516642384Z [2024-04-06 02:30:01,516: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-04-06T02:30:01.516884478Z [2024-04-06 02:30:01,516: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T02:30:01.619931920Z [2024-04-06 02:30:01,619: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:30:01.622739630Z [2024-04-06 02:30:01,618: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T02:30:01.626757329Z [2024-04-06 02:30:01,615: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:30:02.073562087Z [2024-04-06 02:30:02,073: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:30:02.328526614Z [2024-04-06 02:30:02,328: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[75595d68-0107-4231-873b-20ae0408ebdd] succeeded in 1.479725232000419s: None 2024-04-06T02:30:02.600887613Z [2024-04-06 02:30:02,600: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5856df06-9716-45e3-96b6-6c5f24b5bae6] succeeded in 1.7900114849999227s: None 2024-04-06T02:30:02.662434101Z [2024-04-06 02:30:02,662: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:30:02.665903814Z [2024-04-06 02:30:02,665: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:30:02.681740188Z [2024-04-06 02:30:02,681: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:30:02.683373055Z [2024-04-06 02:30:02,683: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:30:02.683550331Z [2024-04-06 02:30:02,683: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:30:02.683753685Z [2024-04-06 02:30:02,683: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:30:02.683884998Z [2024-04-06 02:30:02,683: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:30:02.684249355Z [2024-04-06 02:30:02,684: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:30:02.684402193Z [2024-04-06 02:30:02,684: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:30:02.786105123Z [2024-04-06 02:30:02,785: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:30:02.828050532Z [2024-04-06 02:30:02,827: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:30:02.831168064Z [2024-04-06 02:30:02,830: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:30:02.855810002Z [2024-04-06 02:30:02,855: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:30:02.857045489Z [2024-04-06 02:30:02,856: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:30:02.857058737Z [2024-04-06 02:30:02,856: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:30:02.857183542Z [2024-04-06 02:30:02,857: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:30:02.857263128Z [2024-04-06 02:30:02,857: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:30:02.857541784Z [2024-04-06 02:30:02,857: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:30:02.857568490Z [2024-04-06 02:30:02,857: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:30:02.962954608Z [2024-04-06 02:30:02,962: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:30:03.109234947Z [2024-04-06 02:30:03,108: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-06T02:30:03.112706339Z [2024-04-06 02:30:03,112: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:30:03.140110450Z [2024-04-06 02:30:03,139: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T02:30:03.141654969Z [2024-04-06 02:30:03,141: INFO/ForkPoolWorker-2] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:30:03.141836550Z [2024-04-06 02:30:03,141: INFO/ForkPoolWorker-2] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:30:03.142106792Z [2024-04-06 02:30:03,141: INFO/ForkPoolWorker-2] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:30:03.142342048Z [2024-04-06 02:30:03,142: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-06T02:30:03.142696571Z [2024-04-06 02:30:03,142: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:30:03.142943370Z [2024-04-06 02:30:03,142: INFO/ForkPoolWorker-2] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:30:03.274090675Z [2024-04-06 02:30:03,273: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:30:03.441419589Z [2024-04-06 02:30:03,440: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f5e496f8-3b40-48bf-b8de-5913b2978720] succeeded in 2.629633851998733s: None 2024-04-06T02:30:03.576112872Z [2024-04-06 02:30:03,575: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[61f6569b-3111-41aa-baf3-4effa26fdd4b] received 2024-04-06T02:30:03.582819307Z [2024-04-06 02:30:03,582: INFO/ForkPoolWorker-15] [61f6569b-3111-41aa-baf3-4effa26fdd4b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'split_metrics', 'scheduled__2024-04-06T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:30:03.937214371Z [2024-04-06 02:30:03,934: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:30:04.833897756Z [2024-04-06 02:30:04,833: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[10add935-9164-48f5-888c-335aea3ff877] succeeded in 4.0165032599998085s: None 2024-04-06T02:30:05.003687101Z [2024-04-06 02:30:05,003: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[319f16ed-7ed5-4f13-972e-15fa02987ade] succeeded in 4.192188871000326s: None 2024-04-06T02:30:05.116843777Z [2024-04-06 02:30:05,116: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:30:05.120076065Z [2024-04-06 02:30:05,119: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:30:05.139169338Z [2024-04-06 02:30:05,138: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:30:05.140424209Z [2024-04-06 02:30:05,140: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:30:05.140440478Z [2024-04-06 02:30:05,140: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:30:05.140623635Z [2024-04-06 02:30:05,140: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:30:05.140647020Z [2024-04-06 02:30:05,140: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:30:05.140902196Z [2024-04-06 02:30:05,140: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:30:05.141043295Z [2024-04-06 02:30:05,140: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:30:05.218674262Z [2024-04-06 02:30:05,218: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:30:05.811198766Z [2024-04-06 02:30:05,810: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[61f6569b-3111-41aa-baf3-4effa26fdd4b] succeeded in 2.233173425000132s: None 2024-04-06T02:30:05.916556572Z [2024-04-06 02:30:05,916: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[65e5c566-50a8-43fa-ac37-2d69b122d9a5] received 2024-04-06T02:30:05.943841060Z [2024-04-06 02:30:05,943: INFO/ForkPoolWorker-15] [65e5c566-50a8-43fa-ac37-2d69b122d9a5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'collect_metrics', 'scheduled__2024-04-06T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T02:30:06.241684500Z [2024-04-06 02:30:06,238: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:30:07.323996847Z [2024-04-06 02:30:07,323: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:30:07.330957056Z [2024-04-06 02:30:07,326: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:30:07.345789346Z [2024-04-06 02:30:07,345: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:30:07.347449424Z [2024-04-06 02:30:07,346: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:30:07.347477600Z [2024-04-06 02:30:07,347: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:30:07.347498328Z [2024-04-06 02:30:07,347: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:30:07.347508140Z [2024-04-06 02:30:07,347: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:30:07.347609431Z [2024-04-06 02:30:07,347: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:30:07.347631509Z [2024-04-06 02:30:07,347: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:30:07.445508037Z [2024-04-06 02:30:07,445: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:30:08.000378093Z [2024-04-06 02:30:07,999: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[65e5c566-50a8-43fa-ac37-2d69b122d9a5] succeeded in 2.079614528000093s: None 2024-04-06T02:30:08.270335295Z [2024-04-06 02:30:08,270: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7dc5fb8b-3b5f-46ba-b294-793cc67253aa] received 2024-04-06T02:30:08.277815701Z [2024-04-06 02:30:08,277: INFO/ForkPoolWorker-15] [7dc5fb8b-3b5f-46ba-b294-793cc67253aa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'send_prometheus', 'scheduled__2024-04-06T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:30:08.604731294Z [2024-04-06 02:30:08,601: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:30:09.783466438Z [2024-04-06 02:30:09,782: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:30:09.786740792Z [2024-04-06 02:30:09,786: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:30:09.827829288Z [2024-04-06 02:30:09,827: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:30:09.830382425Z [2024-04-06 02:30:09,830: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:30:09.830485964Z [2024-04-06 02:30:09,830: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:30:09.830748475Z [2024-04-06 02:30:09,830: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:30:09.830900386Z [2024-04-06 02:30:09,830: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:30:09.831206231Z [2024-04-06 02:30:09,831: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:30:09.831311567Z [2024-04-06 02:30:09,831: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:30:09.939035645Z [2024-04-06 02:30:09,938: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:30:10.490401068Z [2024-04-06 02:30:10,490: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7dc5fb8b-3b5f-46ba-b294-793cc67253aa] succeeded in 2.2179091689995403s: None 2024-04-06T02:30:28.310848886Z [2024-04-06 02:30:28,310: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f6f77f9b-d93d-47a5-8689-d320d2b0efc9] received 2024-04-06T02:30:28.320333126Z [2024-04-06 02:30:28,319: INFO/ForkPoolWorker-15] [f6f77f9b-d93d-47a5-8689-d320d2b0efc9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_alarm', 'main_task', 'vdu_alarm_20240406023027_721632', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_alarm.py'] 2024-04-06T02:30:28.609775488Z [2024-04-06 02:30:28,606: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_alarm.py 2024-04-06T02:30:28.961468773Z [2024-04-06 02:30:28,960: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:30:29.550079652Z [2024-04-06 02:30:29,549: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f6f77f9b-d93d-47a5-8689-d320d2b0efc9] succeeded in 1.237368535999849s: None 2024-04-06T02:31:00.715202177Z [2024-04-06 02:31:00,714: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bbbfcd5a-7cb6-44f6-93a4-becf9f7ea839] received 2024-04-06T02:31:00.731104975Z [2024-04-06 02:31:00,730: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3be4b198-7c34-4b45-95bd-c0d2a769c7af] received 2024-04-06T02:31:00.732970127Z [2024-04-06 02:31:00,732: INFO/ForkPoolWorker-15] [bbbfcd5a-7cb6-44f6-93a4-becf9f7ea839] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:31:00.743814563Z [2024-04-06 02:31:00,743: INFO/ForkPoolWorker-16] [3be4b198-7c34-4b45-95bd-c0d2a769c7af] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:31:00.748315450Z [2024-04-06 02:31:00,747: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8f644dab-d50e-4d45-8119-3e060d1597ec] received 2024-04-06T02:31:00.769825931Z [2024-04-06 02:31:00,769: INFO/ForkPoolWorker-1] [8f644dab-d50e-4d45-8119-3e060d1597ec] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T02:31:01.072475295Z [2024-04-06 02:31:01,068: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:31:01.091199662Z [2024-04-06 02:31:01,087: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T02:31:01.127705524Z [2024-04-06 02:31:01,119: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:31:01.274316171Z [2024-04-06 02:31:01,273: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-06T02:31:01.278750465Z [2024-04-06 02:31:01,278: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:31:01.317362857Z [2024-04-06 02:31:01,316: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T02:31:01.320534168Z [2024-04-06 02:31:01,320: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T02:31:01.320973353Z [2024-04-06 02:31:01,320: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T02:31:01.321317566Z [2024-04-06 02:31:01,321: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-06T02:31:01.322278889Z [2024-04-06 02:31:01,321: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T02:31:01.437568175Z [2024-04-06 02:31:01,437: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:31:02.095994658Z [2024-04-06 02:31:02,095: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8f644dab-d50e-4d45-8119-3e060d1597ec] succeeded in 1.3423031980000815s: None 2024-04-06T02:31:02.359069922Z [2024-04-06 02:31:02,358: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:31:02.363332692Z [2024-04-06 02:31:02,362: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:31:02.390744152Z [2024-04-06 02:31:02,390: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:31:02.392510162Z [2024-04-06 02:31:02,392: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:31:02.392531627Z [2024-04-06 02:31:02,392: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:31:02.392751552Z [2024-04-06 02:31:02,392: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:31:02.392830484Z [2024-04-06 02:31:02,392: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:31:02.393359968Z [2024-04-06 02:31:02,393: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:31:02.393375479Z [2024-04-06 02:31:02,393: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:31:02.478938983Z [2024-04-06 02:31:02,478: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:31:02.587629071Z [2024-04-06 02:31:02,587: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:31:02.591132018Z [2024-04-06 02:31:02,590: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:31:02.619810463Z [2024-04-06 02:31:02,619: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:31:02.621826494Z [2024-04-06 02:31:02,621: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:31:02.622041616Z [2024-04-06 02:31:02,621: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:31:02.622447276Z [2024-04-06 02:31:02,621: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:31:02.622621958Z [2024-04-06 02:31:02,622: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:31:02.623087223Z [2024-04-06 02:31:02,622: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:31:02.623494647Z [2024-04-06 02:31:02,623: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:31:02.722777772Z [2024-04-06 02:31:02,722: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:31:04.901068654Z [2024-04-06 02:31:04,900: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3be4b198-7c34-4b45-95bd-c0d2a769c7af] succeeded in 4.166706287000125s: None 2024-04-06T02:31:07.646842793Z [2024-04-06 02:31:07,646: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bbbfcd5a-7cb6-44f6-93a4-becf9f7ea839] succeeded in 6.924514085001647s: None 2024-04-06T02:32:00.528753515Z [2024-04-06 02:32:00,527: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4923d678-30fe-4fdc-91b2-f9e0741c3c0f] received 2024-04-06T02:32:00.532502021Z [2024-04-06 02:32:00,532: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9fd7c96e-e863-4954-8ece-59df742a74db] received 2024-04-06T02:32:00.538719278Z [2024-04-06 02:32:00,537: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b0e9c28a-6c65-4d59-aca3-f035589207ba] received 2024-04-06T02:32:00.545400965Z [2024-04-06 02:32:00,543: INFO/ForkPoolWorker-15] [4923d678-30fe-4fdc-91b2-f9e0741c3c0f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:32:00.545420650Z [2024-04-06 02:32:00,544: INFO/ForkPoolWorker-16] [9fd7c96e-e863-4954-8ece-59df742a74db] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T02:32:00.562664172Z [2024-04-06 02:32:00,562: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e8bb62a6-8c8e-4460-bc69-632693c30e29] received 2024-04-06T02:32:00.573343388Z [2024-04-06 02:32:00,563: INFO/ForkPoolWorker-1] [b0e9c28a-6c65-4d59-aca3-f035589207ba] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T02:32:00.582121444Z [2024-04-06 02:32:00,577: INFO/ForkPoolWorker-2] [e8bb62a6-8c8e-4460-bc69-632693c30e29] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:32:00.869254425Z [2024-04-06 02:32:00,865: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T02:32:00.897653534Z [2024-04-06 02:32:00,894: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:32:00.928146165Z [2024-04-06 02:32:00,924: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:32:00.961278595Z [2024-04-06 02:32:00,958: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T02:32:01.129734540Z [2024-04-06 02:32:01,129: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-06T02:32:01.133599631Z [2024-04-06 02:32:01,133: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:32:01.159567297Z [2024-04-06 02:32:01,159: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:32:01.160658714Z [2024-04-06 02:32:01,160: INFO/ForkPoolWorker-16] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T02:32:01.160761038Z [2024-04-06 02:32:01,160: INFO/ForkPoolWorker-16] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T02:32:01.160893667Z [2024-04-06 02:32:01,160: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-06T02:32:01.161165235Z [2024-04-06 02:32:01,161: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T02:32:01.278104542Z [2024-04-06 02:32:01,277: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:32:01.328835225Z [2024-04-06 02:32:01,328: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:32:01.909258648Z [2024-04-06 02:32:01,908: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b0e9c28a-6c65-4d59-aca3-f035589207ba] succeeded in 1.3690105410005344s: None 2024-04-06T02:32:01.962216565Z [2024-04-06 02:32:01,961: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9fd7c96e-e863-4954-8ece-59df742a74db] succeeded in 1.4277735689993278s: None 2024-04-06T02:32:02.195188322Z [2024-04-06 02:32:02,194: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:32:02.200159674Z [2024-04-06 02:32:02,199: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:32:02.225343757Z [2024-04-06 02:32:02,224: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:32:02.227462876Z [2024-04-06 02:32:02,227: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:32:02.227624002Z [2024-04-06 02:32:02,227: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:32:02.227856508Z [2024-04-06 02:32:02,227: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:32:02.227995587Z [2024-04-06 02:32:02,227: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:32:02.228389749Z [2024-04-06 02:32:02,228: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:32:02.228540027Z [2024-04-06 02:32:02,228: INFO/ForkPoolWorker-15] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:32:02.362591094Z [2024-04-06 02:32:02,362: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:32:02.482718091Z [2024-04-06 02:32:02,482: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-06T02:32:02.486131791Z [2024-04-06 02:32:02,485: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:32:02.505806747Z [2024-04-06 02:32:02,505: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T02:32:02.506948370Z [2024-04-06 02:32:02,506: INFO/ForkPoolWorker-2] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:32:02.507007189Z [2024-04-06 02:32:02,506: INFO/ForkPoolWorker-2] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:32:02.507222442Z [2024-04-06 02:32:02,507: INFO/ForkPoolWorker-2] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:32:02.507241569Z [2024-04-06 02:32:02,507: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-06T02:32:02.507699582Z [2024-04-06 02:32:02,507: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:32:02.507709385Z [2024-04-06 02:32:02,507: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:32:02.608700316Z [2024-04-06 02:32:02,608: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:32:03.872644765Z [2024-04-06 02:32:03,871: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4923d678-30fe-4fdc-91b2-f9e0741c3c0f] succeeded in 3.3372650380006235s: None 2024-04-06T02:32:04.647065094Z [2024-04-06 02:32:04,646: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[e8bb62a6-8c8e-4460-bc69-632693c30e29] succeeded in 4.077703459999611s: None 2024-04-06T02:33:00.583182731Z [2024-04-06 02:33:00,582: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[98be5bc4-18b8-446e-a85d-abab1c1593ea] received 2024-04-06T02:33:00.591417110Z [2024-04-06 02:33:00,591: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[21ebfb16-00a7-45d8-ab64-f0f9332154c0] received 2024-04-06T02:33:00.592607272Z [2024-04-06 02:33:00,592: INFO/ForkPoolWorker-15] [98be5bc4-18b8-446e-a85d-abab1c1593ea] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:33:00.602712298Z [2024-04-06 02:33:00,602: INFO/ForkPoolWorker-16] [21ebfb16-00a7-45d8-ab64-f0f9332154c0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:33:00.608812375Z [2024-04-06 02:33:00,608: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[76e78fee-8d13-4e11-9da7-cd86bbb6c692] received 2024-04-06T02:33:00.625570381Z [2024-04-06 02:33:00,625: INFO/ForkPoolWorker-1] [76e78fee-8d13-4e11-9da7-cd86bbb6c692] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T02:33:00.888632077Z [2024-04-06 02:33:00,885: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:33:00.888660276Z [2024-04-06 02:33:00,885: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:33:00.941174586Z [2024-04-06 02:33:00,938: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T02:33:01.164699873Z [2024-04-06 02:33:01,164: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-06T02:33:01.169541914Z [2024-04-06 02:33:01,169: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:33:01.226432260Z [2024-04-06 02:33:01,226: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T02:33:01.232059171Z [2024-04-06 02:33:01,231: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T02:33:01.232573125Z [2024-04-06 02:33:01,231: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T02:33:01.232767629Z [2024-04-06 02:33:01,232: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-06T02:33:01.234943075Z [2024-04-06 02:33:01,234: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T02:33:01.363411919Z [2024-04-06 02:33:01,363: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:33:01.964929867Z [2024-04-06 02:33:01,964: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[76e78fee-8d13-4e11-9da7-cd86bbb6c692] succeeded in 1.3526867470009165s: None 2024-04-06T02:33:02.116868943Z [2024-04-06 02:33:02,116: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:33:02.119980308Z [2024-04-06 02:33:02,119: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:33:02.121567346Z [2024-04-06 02:33:02,121: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:33:02.126000358Z [2024-04-06 02:33:02,125: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:33:02.138002161Z [2024-04-06 02:33:02,137: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:33:02.141009122Z [2024-04-06 02:33:02,140: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:33:02.141023279Z [2024-04-06 02:33:02,140: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:33:02.141104551Z [2024-04-06 02:33:02,140: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:33:02.141134472Z [2024-04-06 02:33:02,141: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:33:02.141433912Z [2024-04-06 02:33:02,141: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:33:02.141513111Z [2024-04-06 02:33:02,141: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:33:02.167132135Z [2024-04-06 02:33:02,166: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:33:02.168669016Z [2024-04-06 02:33:02,168: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:33:02.168911622Z [2024-04-06 02:33:02,168: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:33:02.169302456Z [2024-04-06 02:33:02,168: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:33:02.169528028Z [2024-04-06 02:33:02,169: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:33:02.170185918Z [2024-04-06 02:33:02,169: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:33:02.170434053Z [2024-04-06 02:33:02,170: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:33:02.247101301Z [2024-04-06 02:33:02,246: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:33:02.266301960Z [2024-04-06 02:33:02,265: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:33:03.932982381Z [2024-04-06 02:33:03,932: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[21ebfb16-00a7-45d8-ab64-f0f9332154c0] succeeded in 3.339142312999684s: None 2024-04-06T02:33:04.348651147Z [2024-04-06 02:33:04,348: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[98be5bc4-18b8-446e-a85d-abab1c1593ea] succeeded in 3.7628772299995035s: None 2024-04-06T02:34:01.119589279Z [2024-04-06 02:34:01,119: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[50fd3fcd-e7c7-49af-854d-b52b2bf62bd7] received 2024-04-06T02:34:01.123148907Z [2024-04-06 02:34:01,122: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[86bf2c1a-00e7-42c9-a8f6-79746cdd89db] received 2024-04-06T02:34:01.133117305Z [2024-04-06 02:34:01,132: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e18be075-2b3f-4c5d-9355-be9a18ab8e24] received 2024-04-06T02:34:01.136004140Z [2024-04-06 02:34:01,135: INFO/ForkPoolWorker-16] [86bf2c1a-00e7-42c9-a8f6-79746cdd89db] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T02:34:01.137031285Z [2024-04-06 02:34:01,136: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a1e39f54-2698-4f1e-af2d-a6052be9e255] received 2024-04-06T02:34:01.143245302Z [2024-04-06 02:34:01,142: INFO/ForkPoolWorker-1] [e18be075-2b3f-4c5d-9355-be9a18ab8e24] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T02:34:01.147874415Z [2024-04-06 02:34:01,147: INFO/ForkPoolWorker-2] [a1e39f54-2698-4f1e-af2d-a6052be9e255] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:34:01.155814056Z [2024-04-06 02:34:01,152: INFO/ForkPoolWorker-15] [50fd3fcd-e7c7-49af-854d-b52b2bf62bd7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:34:01.491041946Z [2024-04-06 02:34:01,486: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T02:34:01.496990093Z [2024-04-06 02:34:01,493: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:34:01.604839636Z [2024-04-06 02:34:01,601: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T02:34:01.649136347Z [2024-04-06 02:34:01,644: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:34:01.787067417Z [2024-04-06 02:34:01,786: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-06T02:34:01.793015339Z [2024-04-06 02:34:01,790: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:34:01.814768349Z [2024-04-06 02:34:01,814: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:34:01.836034618Z [2024-04-06 02:34:01,834: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T02:34:01.840173442Z [2024-04-06 02:34:01,839: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T02:34:01.840229940Z [2024-04-06 02:34:01,840: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T02:34:01.840311149Z [2024-04-06 02:34:01,840: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-06T02:34:01.840613102Z [2024-04-06 02:34:01,840: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T02:34:01.924711938Z [2024-04-06 02:34:01,924: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:34:02.420705430Z [2024-04-06 02:34:02,420: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[86bf2c1a-00e7-42c9-a8f6-79746cdd89db] succeeded in 1.2958099090010364s: None 2024-04-06T02:34:02.521757233Z [2024-04-06 02:34:02,521: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e18be075-2b3f-4c5d-9355-be9a18ab8e24] succeeded in 1.386992907999229s: None 2024-04-06T02:34:02.864113196Z [2024-04-06 02:34:02,863: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-06T02:34:02.867656166Z [2024-04-06 02:34:02,867: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:34:02.910983832Z [2024-04-06 02:34:02,910: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T02:34:02.916150729Z [2024-04-06 02:34:02,915: INFO/ForkPoolWorker-2] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:34:02.916264236Z [2024-04-06 02:34:02,916: INFO/ForkPoolWorker-2] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:34:02.916295625Z [2024-04-06 02:34:02,916: INFO/ForkPoolWorker-2] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:34:02.916304478Z [2024-04-06 02:34:02,916: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-06T02:34:02.916675057Z [2024-04-06 02:34:02,916: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:34:02.916744001Z [2024-04-06 02:34:02,916: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:34:03.034483399Z [2024-04-06 02:34:03,034: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:34:03.181050834Z [2024-04-06 02:34:03,180: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:34:03.184590102Z [2024-04-06 02:34:03,183: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:34:03.222423946Z [2024-04-06 02:34:03,221: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:34:03.225258318Z [2024-04-06 02:34:03,224: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:34:03.225323763Z [2024-04-06 02:34:03,225: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:34:03.225474477Z [2024-04-06 02:34:03,225: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:34:03.225537075Z [2024-04-06 02:34:03,225: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:34:03.225838898Z [2024-04-06 02:34:03,225: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:34:03.226160301Z [2024-04-06 02:34:03,226: INFO/ForkPoolWorker-15] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:34:03.356468635Z [2024-04-06 02:34:03,356: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:34:05.505700301Z [2024-04-06 02:34:05,505: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[50fd3fcd-e7c7-49af-854d-b52b2bf62bd7] succeeded in 4.3834653760004585s: None 2024-04-06T02:34:05.839834096Z [2024-04-06 02:34:05,839: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a1e39f54-2698-4f1e-af2d-a6052be9e255] succeeded in 4.70113724300063s: None 2024-04-06T02:35:00.836982643Z [2024-04-06 02:35:00,836: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[101b15fb-4439-425f-a6d2-600cd57408e2] received 2024-04-06T02:35:00.842594555Z [2024-04-06 02:35:00,842: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[58ecb1b0-5ec5-4ab1-b0fe-cb221e5db411] received 2024-04-06T02:35:00.852793162Z [2024-04-06 02:35:00,852: INFO/ForkPoolWorker-15] [101b15fb-4439-425f-a6d2-600cd57408e2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:35:00.854357428Z [2024-04-06 02:35:00,854: INFO/ForkPoolWorker-16] [58ecb1b0-5ec5-4ab1-b0fe-cb221e5db411] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:35:00.875206815Z [2024-04-06 02:35:00,874: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0a0e6a9b-eae3-4545-bfb9-8532832da92e] received 2024-04-06T02:35:00.879848750Z [2024-04-06 02:35:00,879: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[244e0c62-e20a-4aa2-9c2e-300633f646fa] received 2024-04-06T02:35:00.892477807Z [2024-04-06 02:35:00,892: INFO/ForkPoolWorker-1] [0a0e6a9b-eae3-4545-bfb9-8532832da92e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:35:00.896085466Z [2024-04-06 02:35:00,895: INFO/ForkPoolWorker-2] [244e0c62-e20a-4aa2-9c2e-300633f646fa] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T02:35:01.158515365Z [2024-04-06 02:35:01,155: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:35:01.165474485Z [2024-04-06 02:35:01,162: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:35:01.202267083Z [2024-04-06 02:35:01,199: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T02:35:01.239213240Z [2024-04-06 02:35:01,236: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:35:01.381604332Z [2024-04-06 02:35:01,381: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-06T02:35:01.390048991Z [2024-04-06 02:35:01,389: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:35:01.429196118Z [2024-04-06 02:35:01,428: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T02:35:01.430415314Z [2024-04-06 02:35:01,430: INFO/ForkPoolWorker-2] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T02:35:01.430624851Z [2024-04-06 02:35:01,430: INFO/ForkPoolWorker-2] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T02:35:01.430686060Z [2024-04-06 02:35:01,430: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-06T02:35:01.430947615Z [2024-04-06 02:35:01,430: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T02:35:01.563751358Z [2024-04-06 02:35:01,563: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:35:02.261305083Z [2024-04-06 02:35:02,260: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[244e0c62-e20a-4aa2-9c2e-300633f646fa] succeeded in 1.3796932580007706s: None 2024-04-06T02:35:02.418955525Z [2024-04-06 02:35:02,418: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:35:02.422146264Z [2024-04-06 02:35:02,421: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:35:02.444456564Z [2024-04-06 02:35:02,444: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:35:02.445606613Z [2024-04-06 02:35:02,445: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:35:02.445623054Z [2024-04-06 02:35:02,445: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:35:02.445714432Z [2024-04-06 02:35:02,445: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:35:02.445772784Z [2024-04-06 02:35:02,445: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:35:02.445970509Z [2024-04-06 02:35:02,445: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:35:02.446008005Z [2024-04-06 02:35:02,445: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:35:02.454615708Z [2024-04-06 02:35:02,454: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:35:02.458098123Z [2024-04-06 02:35:02,457: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:35:02.480661418Z [2024-04-06 02:35:02,480: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:35:02.481964739Z [2024-04-06 02:35:02,481: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:35:02.482044509Z [2024-04-06 02:35:02,481: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:35:02.482206205Z [2024-04-06 02:35:02,482: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:35:02.482336034Z [2024-04-06 02:35:02,482: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:35:02.482617944Z [2024-04-06 02:35:02,482: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:35:02.483032336Z [2024-04-06 02:35:02,482: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:35:02.530011646Z [2024-04-06 02:35:02,529: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:35:02.561349766Z [2024-04-06 02:35:02,561: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:35:02.603782021Z [2024-04-06 02:35:02,603: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T02:35:02.607874843Z [2024-04-06 02:35:02,607: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:35:02.636559582Z [2024-04-06 02:35:02,636: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T02:35:02.638295229Z [2024-04-06 02:35:02,638: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:35:02.638461449Z [2024-04-06 02:35:02,638: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:35:02.638708532Z [2024-04-06 02:35:02,638: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:35:02.638845161Z [2024-04-06 02:35:02,638: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T02:35:02.639283457Z [2024-04-06 02:35:02,639: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:35:02.639728725Z [2024-04-06 02:35:02,639: INFO/ForkPoolWorker-1] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:35:02.732872854Z [2024-04-06 02:35:02,730: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:35:03.109305172Z [2024-04-06 02:35:03,108: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[101b15fb-4439-425f-a6d2-600cd57408e2] succeeded in 2.2649490750009136s: None 2024-04-06T02:35:03.699660399Z [2024-04-06 02:35:03,699: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6ad06674-bb8d-400d-97ca-ad5a37675bbd] received 2024-04-06T02:35:03.732935403Z [2024-04-06 02:35:03,732: INFO/ForkPoolWorker-15] [6ad06674-bb8d-400d-97ca-ad5a37675bbd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'split_metrics', 'scheduled__2024-04-06T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:35:04.059013619Z [2024-04-06 02:35:04,056: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:35:04.179981301Z [2024-04-06 02:35:04,179: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0a0e6a9b-eae3-4545-bfb9-8532832da92e] succeeded in 3.302595041999666s: None 2024-04-06T02:35:04.566210338Z [2024-04-06 02:35:04,565: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[58ecb1b0-5ec5-4ab1-b0fe-cb221e5db411] succeeded in 3.7217453940011183s: None 2024-04-06T02:35:05.227117599Z [2024-04-06 02:35:05,226: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:35:05.230316188Z [2024-04-06 02:35:05,229: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:35:05.253850582Z [2024-04-06 02:35:05,253: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:35:05.256150162Z [2024-04-06 02:35:05,255: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:35:05.256183280Z [2024-04-06 02:35:05,255: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:35:05.256319578Z [2024-04-06 02:35:05,256: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:35:05.256506857Z [2024-04-06 02:35:05,256: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:35:05.257745398Z [2024-04-06 02:35:05,256: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:35:05.257766770Z [2024-04-06 02:35:05,257: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:35:05.334104293Z [2024-04-06 02:35:05,333: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:35:05.993556501Z [2024-04-06 02:35:05,993: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6ad06674-bb8d-400d-97ca-ad5a37675bbd] succeeded in 2.291456550001385s: None 2024-04-06T02:35:06.189556942Z [2024-04-06 02:35:06,189: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dbb39984-7576-4219-8353-5bc398ecda21] received 2024-04-06T02:35:06.202099278Z [2024-04-06 02:35:06,201: INFO/ForkPoolWorker-15] [dbb39984-7576-4219-8353-5bc398ecda21] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'collect_metrics', 'scheduled__2024-04-06T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T02:35:06.487237588Z [2024-04-06 02:35:06,483: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:35:07.590907758Z [2024-04-06 02:35:07,590: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:35:07.594176464Z [2024-04-06 02:35:07,593: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:35:07.615877611Z [2024-04-06 02:35:07,615: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:35:07.617230725Z [2024-04-06 02:35:07,616: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:35:07.617298102Z [2024-04-06 02:35:07,617: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:35:07.617388040Z [2024-04-06 02:35:07,617: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:35:07.617415605Z [2024-04-06 02:35:07,617: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:35:07.617684722Z [2024-04-06 02:35:07,617: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:35:07.617835417Z [2024-04-06 02:35:07,617: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:35:07.697496662Z [2024-04-06 02:35:07,697: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:35:08.294833023Z [2024-04-06 02:35:08,294: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[dbb39984-7576-4219-8353-5bc398ecda21] succeeded in 2.1007595659993967s: None 2024-04-06T02:35:08.916347283Z [2024-04-06 02:35:08,915: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2d1e5dbd-b3fa-4e6f-bf00-6838ea147b3c] received 2024-04-06T02:35:08.929659248Z [2024-04-06 02:35:08,929: INFO/ForkPoolWorker-15] [2d1e5dbd-b3fa-4e6f-bf00-6838ea147b3c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'send_prometheus', 'scheduled__2024-04-06T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:35:09.198664218Z [2024-04-06 02:35:09,195: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:35:10.304046786Z [2024-04-06 02:35:10,303: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:35:10.308293075Z [2024-04-06 02:35:10,307: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:35:10.332017934Z [2024-04-06 02:35:10,331: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:35:10.333464200Z [2024-04-06 02:35:10,333: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:35:10.333596384Z [2024-04-06 02:35:10,333: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:35:10.333774309Z [2024-04-06 02:35:10,333: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:35:10.333879925Z [2024-04-06 02:35:10,333: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:35:10.334397304Z [2024-04-06 02:35:10,334: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:35:10.334420099Z [2024-04-06 02:35:10,334: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:35:10.412096879Z [2024-04-06 02:35:10,411: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:35:11.028120826Z [2024-04-06 02:35:11,027: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2d1e5dbd-b3fa-4e6f-bf00-6838ea147b3c] succeeded in 2.108993809000822s: None 2024-04-06T02:36:00.939812707Z [2024-04-06 02:36:00,939: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b062b32d-b442-483f-8a5d-2783f4ddada5] received 2024-04-06T02:36:00.953268350Z [2024-04-06 02:36:00,952: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3ae4e4ee-ca99-4f3c-9971-ae15bc90e656] received 2024-04-06T02:36:00.965931728Z [2024-04-06 02:36:00,965: INFO/ForkPoolWorker-15] [b062b32d-b442-483f-8a5d-2783f4ddada5] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T02:36:00.965951836Z [2024-04-06 02:36:00,965: INFO/ForkPoolWorker-16] [3ae4e4ee-ca99-4f3c-9971-ae15bc90e656] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:36:00.967107866Z [2024-04-06 02:36:00,966: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3f3fd562-bea4-46d5-a04c-6d3bdba3dec6] received 2024-04-06T02:36:00.971995452Z [2024-04-06 02:36:00,971: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c42c20bb-d446-46c6-b270-24c983c7c149] received 2024-04-06T02:36:00.981397171Z [2024-04-06 02:36:00,981: INFO/ForkPoolWorker-1] [3f3fd562-bea4-46d5-a04c-6d3bdba3dec6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:36:00.984077595Z [2024-04-06 02:36:00,983: INFO/ForkPoolWorker-2] [c42c20bb-d446-46c6-b270-24c983c7c149] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T02:36:01.359433562Z [2024-04-06 02:36:01,356: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T02:36:01.374224250Z [2024-04-06 02:36:01,370: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T02:36:01.416694574Z [2024-04-06 02:36:01,412: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:36:01.579105052Z [2024-04-06 02:36:01,575: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:36:01.643806705Z [2024-04-06 02:36:01,643: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:36:01.670232612Z [2024-04-06 02:36:01,668: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-06T02:36:01.680151295Z [2024-04-06 02:36:01,679: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:36:01.728602793Z [2024-04-06 02:36:01,728: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T02:36:01.729956397Z [2024-04-06 02:36:01,729: INFO/ForkPoolWorker-2] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T02:36:01.730049227Z [2024-04-06 02:36:01,729: INFO/ForkPoolWorker-2] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T02:36:01.730054687Z [2024-04-06 02:36:01,729: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-06T02:36:01.730240932Z [2024-04-06 02:36:01,730: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T02:36:01.843146312Z [2024-04-06 02:36:01,842: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:36:02.251068514Z [2024-04-06 02:36:02,250: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b062b32d-b442-483f-8a5d-2783f4ddada5] succeeded in 1.304797470000267s: None 2024-04-06T02:36:02.419028181Z [2024-04-06 02:36:02,418: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[c42c20bb-d446-46c6-b270-24c983c7c149] succeeded in 1.444630246000088s: None 2024-04-06T02:36:02.752747105Z [2024-04-06 02:36:02,752: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:36:02.755968022Z [2024-04-06 02:36:02,755: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:36:02.776763842Z [2024-04-06 02:36:02,776: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:36:02.778340285Z [2024-04-06 02:36:02,778: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:36:02.778668617Z [2024-04-06 02:36:02,778: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:36:02.778900364Z [2024-04-06 02:36:02,778: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:36:02.779035130Z [2024-04-06 02:36:02,778: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:36:02.779959565Z [2024-04-06 02:36:02,779: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:36:02.780110908Z [2024-04-06 02:36:02,779: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:36:02.864953056Z [2024-04-06 02:36:02,864: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:36:02.872053478Z [2024-04-06 02:36:02,871: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T02:36:02.875449299Z [2024-04-06 02:36:02,874: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:36:02.894510922Z [2024-04-06 02:36:02,894: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T02:36:02.896192530Z [2024-04-06 02:36:02,895: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:36:02.896484210Z [2024-04-06 02:36:02,896: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:36:02.896693130Z [2024-04-06 02:36:02,896: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:36:02.896824017Z [2024-04-06 02:36:02,896: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T02:36:02.897078859Z [2024-04-06 02:36:02,896: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:36:02.897165356Z [2024-04-06 02:36:02,897: INFO/ForkPoolWorker-1] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:36:02.981374039Z [2024-04-06 02:36:02,981: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:36:04.645592472Z [2024-04-06 02:36:04,644: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3f3fd562-bea4-46d5-a04c-6d3bdba3dec6] succeeded in 3.6706050650009274s: None 2024-04-06T02:36:05.827762055Z [2024-04-06 02:36:05,827: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3ae4e4ee-ca99-4f3c-9971-ae15bc90e656] succeeded in 4.870153494999613s: None 2024-04-06T02:37:00.839801786Z [2024-04-06 02:37:00,839: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[411f2422-8e4d-44bf-9add-13d71d0a6df2] received 2024-04-06T02:37:00.848296067Z [2024-04-06 02:37:00,848: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[de528444-8d75-4c02-ba60-1b224df8e020] received 2024-04-06T02:37:00.849773648Z [2024-04-06 02:37:00,849: INFO/ForkPoolWorker-15] [411f2422-8e4d-44bf-9add-13d71d0a6df2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:37:00.850018918Z [2024-04-06 02:37:00,849: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[50cbde02-d99c-441b-afd4-05903b322d48] received 2024-04-06T02:37:00.856913143Z [2024-04-06 02:37:00,856: INFO/ForkPoolWorker-1] [50cbde02-d99c-441b-afd4-05903b322d48] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:37:00.862111385Z [2024-04-06 02:37:00,861: INFO/ForkPoolWorker-16] [de528444-8d75-4c02-ba60-1b224df8e020] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T02:37:01.163829264Z [2024-04-06 02:37:01,160: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:37:01.226531872Z [2024-04-06 02:37:01,222: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:37:01.241760541Z [2024-04-06 02:37:01,238: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T02:37:01.404333996Z [2024-04-06 02:37:01,403: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-06T02:37:01.408621359Z [2024-04-06 02:37:01,408: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:37:01.451157980Z [2024-04-06 02:37:01,450: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:37:01.452694032Z [2024-04-06 02:37:01,452: INFO/ForkPoolWorker-16] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T02:37:01.452993964Z [2024-04-06 02:37:01,452: INFO/ForkPoolWorker-16] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T02:37:01.453188437Z [2024-04-06 02:37:01,453: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-06T02:37:01.453647808Z [2024-04-06 02:37:01,453: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T02:37:01.549651964Z [2024-04-06 02:37:01,549: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:37:02.164117288Z [2024-04-06 02:37:02,163: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[de528444-8d75-4c02-ba60-1b224df8e020] succeeded in 1.3108595109988528s: None 2024-04-06T02:37:02.360086196Z [2024-04-06 02:37:02,359: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:37:02.363240077Z [2024-04-06 02:37:02,362: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:37:02.363362439Z [2024-04-06 02:37:02,363: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T02:37:02.366626589Z [2024-04-06 02:37:02,366: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:37:02.387227165Z [2024-04-06 02:37:02,386: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:37:02.388691660Z [2024-04-06 02:37:02,388: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:37:02.388703086Z [2024-04-06 02:37:02,388: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:37:02.388888196Z [2024-04-06 02:37:02,388: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:37:02.388946363Z [2024-04-06 02:37:02,388: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:37:02.389093315Z [2024-04-06 02:37:02,388: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:37:02.389134820Z [2024-04-06 02:37:02,389: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:37:02.389277882Z [2024-04-06 02:37:02,389: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T02:37:02.390573334Z [2024-04-06 02:37:02,390: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:37:02.390590030Z [2024-04-06 02:37:02,390: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:37:02.390809706Z [2024-04-06 02:37:02,390: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:37:02.390945474Z [2024-04-06 02:37:02,390: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T02:37:02.391131881Z [2024-04-06 02:37:02,390: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:37:02.391141253Z [2024-04-06 02:37:02,391: INFO/ForkPoolWorker-1] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:37:02.470983210Z [2024-04-06 02:37:02,470: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:37:02.472192534Z [2024-04-06 02:37:02,471: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:37:04.089651181Z [2024-04-06 02:37:04,089: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[50cbde02-d99c-441b-afd4-05903b322d48] succeeded in 3.2384151160003967s: None 2024-04-06T02:37:04.804277857Z [2024-04-06 02:37:04,803: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[411f2422-8e4d-44bf-9add-13d71d0a6df2] succeeded in 3.9617714720006916s: None 2024-04-06T02:38:00.381279866Z [2024-04-06 02:38:00,380: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cc30d771-9158-4946-85aa-9338b9b05241] received 2024-04-06T02:38:00.383976340Z [2024-04-06 02:38:00,383: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8450d1bc-2ac0-49d3-a7bc-fef750442211] received 2024-04-06T02:38:00.385387847Z [2024-04-06 02:38:00,385: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8a619e07-3250-44f4-8252-fc4c4c0885e7] received 2024-04-06T02:38:00.392007642Z [2024-04-06 02:38:00,391: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[caa7508e-5336-4dab-bc7d-e032daa1e46b] received 2024-04-06T02:38:00.393258101Z [2024-04-06 02:38:00,393: INFO/ForkPoolWorker-15] [cc30d771-9158-4946-85aa-9338b9b05241] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T02:38:00.402768729Z [2024-04-06 02:38:00,401: INFO/ForkPoolWorker-16] [8450d1bc-2ac0-49d3-a7bc-fef750442211] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:38:00.408999602Z [2024-04-06 02:38:00,408: INFO/ForkPoolWorker-2] [caa7508e-5336-4dab-bc7d-e032daa1e46b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T02:38:00.414404325Z [2024-04-06 02:38:00,414: INFO/ForkPoolWorker-1] [8a619e07-3250-44f4-8252-fc4c4c0885e7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:38:00.740690524Z [2024-04-06 02:38:00,737: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:38:00.744057188Z [2024-04-06 02:38:00,740: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:38:00.844335257Z [2024-04-06 02:38:00,840: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T02:38:00.855058502Z [2024-04-06 02:38:00,852: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T02:38:01.022562713Z [2024-04-06 02:38:01,022: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-06T02:38:01.028121660Z [2024-04-06 02:38:01,027: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:38:01.064010404Z [2024-04-06 02:38:01,063: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T02:38:01.065538778Z [2024-04-06 02:38:01,065: INFO/ForkPoolWorker-2] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T02:38:01.065708652Z [2024-04-06 02:38:01,065: INFO/ForkPoolWorker-2] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T02:38:01.065815317Z [2024-04-06 02:38:01,065: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-06T02:38:01.066095615Z [2024-04-06 02:38:01,065: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T02:38:01.174310560Z [2024-04-06 02:38:01,173: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:38:01.184829545Z [2024-04-06 02:38:01,184: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:38:01.841007155Z [2024-04-06 02:38:01,840: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cc30d771-9158-4946-85aa-9338b9b05241] succeeded in 1.4569313849988248s: None 2024-04-06T02:38:01.962910098Z [2024-04-06 02:38:01,962: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[caa7508e-5336-4dab-bc7d-e032daa1e46b] succeeded in 1.5656214009995892s: None 2024-04-06T02:38:02.017098560Z [2024-04-06 02:38:02,012: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:38:02.017138710Z [2024-04-06 02:38:02,016: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:38:02.040539962Z [2024-04-06 02:38:02,040: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:38:02.042007610Z [2024-04-06 02:38:02,041: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:38:02.042149997Z [2024-04-06 02:38:02,041: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:38:02.042421403Z [2024-04-06 02:38:02,042: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:38:02.042531987Z [2024-04-06 02:38:02,042: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:38:02.042993173Z [2024-04-06 02:38:02,042: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:38:02.043504465Z [2024-04-06 02:38:02,043: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:38:02.133046042Z [2024-04-06 02:38:02,132: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T02:38:02.133997806Z [2024-04-06 02:38:02,133: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:38:02.136369666Z [2024-04-06 02:38:02,135: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:38:02.163838039Z [2024-04-06 02:38:02,163: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T02:38:02.166248233Z [2024-04-06 02:38:02,165: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:38:02.166406639Z [2024-04-06 02:38:02,166: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:38:02.166633164Z [2024-04-06 02:38:02,166: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:38:02.166770118Z [2024-04-06 02:38:02,166: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T02:38:02.167166570Z [2024-04-06 02:38:02,166: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:38:02.167422674Z [2024-04-06 02:38:02,167: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:38:02.269740640Z [2024-04-06 02:38:02,269: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:38:03.918572410Z [2024-04-06 02:38:03,917: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8450d1bc-2ac0-49d3-a7bc-fef750442211] succeeded in 3.53024264799933s: None 2024-04-06T02:38:04.580592893Z [2024-04-06 02:38:04,580: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8a619e07-3250-44f4-8252-fc4c4c0885e7] succeeded in 4.191150827000456s: None 2024-04-06T02:39:00.796527394Z [2024-04-06 02:39:00,796: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5af05365-dc62-42d6-9139-142964ecf3a7] received 2024-04-06T02:39:00.798291907Z [2024-04-06 02:39:00,798: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2b1dc9a8-a4f7-48a0-aa72-a08e979b7cd3] received 2024-04-06T02:39:00.805757411Z [2024-04-06 02:39:00,805: INFO/ForkPoolWorker-15] [5af05365-dc62-42d6-9139-142964ecf3a7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:39:00.808032467Z [2024-04-06 02:39:00,807: INFO/ForkPoolWorker-16] [2b1dc9a8-a4f7-48a0-aa72-a08e979b7cd3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:39:00.822004525Z [2024-04-06 02:39:00,821: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a699493a-ebfe-4d14-891e-811885637c1a] received 2024-04-06T02:39:00.834306292Z [2024-04-06 02:39:00,833: INFO/ForkPoolWorker-1] [a699493a-ebfe-4d14-891e-811885637c1a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T02:39:01.103006677Z [2024-04-06 02:39:01,099: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:39:01.109072358Z [2024-04-06 02:39:01,105: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:39:01.192233715Z [2024-04-06 02:39:01,187: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T02:39:01.369674526Z [2024-04-06 02:39:01,369: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-06T02:39:01.374376064Z [2024-04-06 02:39:01,373: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:39:01.411516295Z [2024-04-06 02:39:01,411: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T02:39:01.412816562Z [2024-04-06 02:39:01,412: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T02:39:01.412865213Z [2024-04-06 02:39:01,412: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T02:39:01.412916724Z [2024-04-06 02:39:01,412: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-06T02:39:01.413162787Z [2024-04-06 02:39:01,413: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T02:39:01.521568006Z [2024-04-06 02:39:01,521: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:39:02.175224020Z [2024-04-06 02:39:02,174: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a699493a-ebfe-4d14-891e-811885637c1a] succeeded in 1.3504966319997038s: None 2024-04-06T02:39:02.301488879Z [2024-04-06 02:39:02,301: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:39:02.304943335Z [2024-04-06 02:39:02,304: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:39:02.326705850Z [2024-04-06 02:39:02,326: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:39:02.328170375Z [2024-04-06 02:39:02,327: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:39:02.328215102Z [2024-04-06 02:39:02,328: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:39:02.328441878Z [2024-04-06 02:39:02,328: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:39:02.328519351Z [2024-04-06 02:39:02,328: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:39:02.328885157Z [2024-04-06 02:39:02,328: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:39:02.329028409Z [2024-04-06 02:39:02,328: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:39:02.412570449Z [2024-04-06 02:39:02,412: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:39:02.424239193Z [2024-04-06 02:39:02,423: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:39:02.427695307Z [2024-04-06 02:39:02,427: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:39:02.455487681Z [2024-04-06 02:39:02,455: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:39:02.458715011Z [2024-04-06 02:39:02,458: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:39:02.458935326Z [2024-04-06 02:39:02,458: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:39:02.459290547Z [2024-04-06 02:39:02,458: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:39:02.459583317Z [2024-04-06 02:39:02,459: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:39:02.460120808Z [2024-04-06 02:39:02,459: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:39:02.460367983Z [2024-04-06 02:39:02,460: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:39:02.581475746Z [2024-04-06 02:39:02,581: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:39:04.754757210Z [2024-04-06 02:39:04,754: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5af05365-dc62-42d6-9139-142964ecf3a7] succeeded in 3.954384687000129s: None 2024-04-06T02:39:05.088075784Z [2024-04-06 02:39:05,087: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2b1dc9a8-a4f7-48a0-aa72-a08e979b7cd3] succeeded in 4.287974458000463s: None 2024-04-06T02:40:01.214689277Z [2024-04-06 02:40:01,212: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a1e9658e-177f-4e54-8855-b5c106b51302] received 2024-04-06T02:40:01.221277034Z [2024-04-06 02:40:01,220: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4d766515-df5a-4b33-8835-c2edefef78cb] received 2024-04-06T02:40:01.230276248Z [2024-04-06 02:40:01,229: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[86810db6-1119-4db9-99b1-95f2ec2629d8] received 2024-04-06T02:40:01.231216867Z [2024-04-06 02:40:01,231: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[99eb0875-7ddd-4eb3-bae6-9895a297fc5c] received 2024-04-06T02:40:01.232248487Z [2024-04-06 02:40:01,231: INFO/ForkPoolWorker-16] [4d766515-df5a-4b33-8835-c2edefef78cb] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T02:40:01.238071093Z [2024-04-06 02:40:01,237: INFO/ForkPoolWorker-1] [86810db6-1119-4db9-99b1-95f2ec2629d8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:40:01.241199471Z [2024-04-06 02:40:01,240: INFO/ForkPoolWorker-15] [a1e9658e-177f-4e54-8855-b5c106b51302] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:40:01.241516572Z [2024-04-06 02:40:01,241: INFO/ForkPoolWorker-2] [99eb0875-7ddd-4eb3-bae6-9895a297fc5c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:40:01.263879822Z [2024-04-06 02:40:01,262: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[86c21f42-3eea-4423-8998-2c0070ddea5c] received 2024-04-06T02:40:01.286659001Z [2024-04-06 02:40:01,286: INFO/ForkPoolWorker-3] [86c21f42-3eea-4423-8998-2c0070ddea5c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T02:40:01.609773373Z [2024-04-06 02:40:01,601: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:40:01.641280132Z [2024-04-06 02:40:01,633: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T02:40:01.729329476Z [2024-04-06 02:40:01,724: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:40:01.741209605Z [2024-04-06 02:40:01,737: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T02:40:01.773929189Z [2024-04-06 02:40:01,754: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:40:02.018394383Z [2024-04-06 02:40:02,018: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:40:02.053241792Z [2024-04-06 02:40:02,052: INFO/ForkPoolWorker-3] Getting SDNC list 2024-04-06T02:40:02.063168637Z [2024-04-06 02:40:02,062: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:40:02.121202625Z [2024-04-06 02:40:02,120: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-06T02:40:02.122175131Z [2024-04-06 02:40:02,121: INFO/ForkPoolWorker-3] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T02:40:02.122308433Z [2024-04-06 02:40:02,122: INFO/ForkPoolWorker-3] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T02:40:02.122388880Z [2024-04-06 02:40:02,122: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-04-06T02:40:02.122638923Z [2024-04-06 02:40:02,122: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T02:40:02.249497723Z [2024-04-06 02:40:02,249: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:40:02.599384771Z [2024-04-06 02:40:02,598: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4d766515-df5a-4b33-8835-c2edefef78cb] succeeded in 1.3758561499998905s: None 2024-04-06T02:40:02.855784299Z [2024-04-06 02:40:02,855: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[86c21f42-3eea-4423-8998-2c0070ddea5c] succeeded in 1.5853840480012877s: None 2024-04-06T02:40:03.090327663Z [2024-04-06 02:40:03,089: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-06T02:40:03.093805249Z [2024-04-06 02:40:03,093: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:40:03.117911260Z [2024-04-06 02:40:03,117: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T02:40:03.119443470Z [2024-04-06 02:40:03,119: INFO/ForkPoolWorker-2] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:40:03.119507399Z [2024-04-06 02:40:03,119: INFO/ForkPoolWorker-2] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:40:03.119644838Z [2024-04-06 02:40:03,119: INFO/ForkPoolWorker-2] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:40:03.119793196Z [2024-04-06 02:40:03,119: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-06T02:40:03.120128003Z [2024-04-06 02:40:03,119: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:40:03.120328097Z [2024-04-06 02:40:03,120: INFO/ForkPoolWorker-2] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:40:03.202689065Z [2024-04-06 02:40:03,202: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:40:03.264996496Z [2024-04-06 02:40:03,264: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:40:03.280096812Z [2024-04-06 02:40:03,279: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:40:03.321626147Z [2024-04-06 02:40:03,321: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:40:03.325962612Z [2024-04-06 02:40:03,325: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:40:03.326243637Z [2024-04-06 02:40:03,325: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:40:03.326497643Z [2024-04-06 02:40:03,326: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:40:03.326664634Z [2024-04-06 02:40:03,326: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:40:03.327120515Z [2024-04-06 02:40:03,326: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:40:03.327332983Z [2024-04-06 02:40:03,327: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:40:03.374285918Z [2024-04-06 02:40:03,373: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T02:40:03.381526598Z [2024-04-06 02:40:03,381: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:40:03.414462939Z [2024-04-06 02:40:03,414: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T02:40:03.417731551Z [2024-04-06 02:40:03,417: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:40:03.417955128Z [2024-04-06 02:40:03,417: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:40:03.418283931Z [2024-04-06 02:40:03,417: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:40:03.418484517Z [2024-04-06 02:40:03,418: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T02:40:03.418834036Z [2024-04-06 02:40:03,418: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:40:03.419903640Z [2024-04-06 02:40:03,419: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:40:03.420165814Z [2024-04-06 02:40:03,419: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:40:03.523088636Z [2024-04-06 02:40:03,522: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:40:04.062357039Z [2024-04-06 02:40:04,062: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a772dfd0-8af2-48ec-8013-198cff8eeb82] received 2024-04-06T02:40:04.084771908Z [2024-04-06 02:40:04,084: INFO/ForkPoolWorker-16] [a772dfd0-8af2-48ec-8013-198cff8eeb82] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'split_metrics', 'scheduled__2024-04-06T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:40:04.131468884Z [2024-04-06 02:40:04,130: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a1e9658e-177f-4e54-8855-b5c106b51302] succeeded in 2.905678977000207s: None 2024-04-06T02:40:04.392162290Z [2024-04-06 02:40:04,386: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:40:04.767218175Z [2024-04-06 02:40:04,766: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[99eb0875-7ddd-4eb3-bae6-9895a297fc5c] succeeded in 3.533757393999622s: None 2024-04-06T02:40:05.654215973Z [2024-04-06 02:40:05,653: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:40:05.657538789Z [2024-04-06 02:40:05,657: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:40:05.676687369Z [2024-04-06 02:40:05,676: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:40:05.678717227Z [2024-04-06 02:40:05,678: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:40:05.678735596Z [2024-04-06 02:40:05,678: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:40:05.679355556Z [2024-04-06 02:40:05,678: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:40:05.679618433Z [2024-04-06 02:40:05,679: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:40:05.680326431Z [2024-04-06 02:40:05,680: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:40:05.680342949Z [2024-04-06 02:40:05,680: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:40:05.702366434Z [2024-04-06 02:40:05,701: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[86810db6-1119-4db9-99b1-95f2ec2629d8] succeeded in 4.470522451998477s: None 2024-04-06T02:40:05.772142217Z [2024-04-06 02:40:05,771: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:40:06.463834002Z [2024-04-06 02:40:06,462: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a772dfd0-8af2-48ec-8013-198cff8eeb82] succeeded in 2.398664620999625s: None 2024-04-06T02:40:06.545352637Z [2024-04-06 02:40:06,544: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3ab35086-cc50-472c-b3fa-31e6873386f2] received 2024-04-06T02:40:06.559228816Z [2024-04-06 02:40:06,558: INFO/ForkPoolWorker-15] [3ab35086-cc50-472c-b3fa-31e6873386f2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'collect_metrics', 'scheduled__2024-04-06T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T02:40:06.859126092Z [2024-04-06 02:40:06,855: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:40:07.934967310Z [2024-04-06 02:40:07,934: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:40:07.938314761Z [2024-04-06 02:40:07,937: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:40:07.956823787Z [2024-04-06 02:40:07,956: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:40:07.958099741Z [2024-04-06 02:40:07,957: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:40:07.958265530Z [2024-04-06 02:40:07,958: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:40:07.958533470Z [2024-04-06 02:40:07,958: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:40:07.958692731Z [2024-04-06 02:40:07,958: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:40:07.959086359Z [2024-04-06 02:40:07,958: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:40:07.959206683Z [2024-04-06 02:40:07,958: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:40:08.044547849Z [2024-04-06 02:40:08,044: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:40:08.640846053Z [2024-04-06 02:40:08,640: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3ab35086-cc50-472c-b3fa-31e6873386f2] succeeded in 2.091211340000882s: None 2024-04-06T02:40:08.901815893Z [2024-04-06 02:40:08,901: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5640bb78-effa-4106-b125-bacb4028c129] received 2024-04-06T02:40:08.912008833Z [2024-04-06 02:40:08,911: INFO/ForkPoolWorker-15] [5640bb78-effa-4106-b125-bacb4028c129] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'send_prometheus', 'scheduled__2024-04-06T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:40:09.206796309Z [2024-04-06 02:40:09,199: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:40:10.339214631Z [2024-04-06 02:40:10,338: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:40:10.342281916Z [2024-04-06 02:40:10,341: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:40:10.368899044Z [2024-04-06 02:40:10,368: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:40:10.370243455Z [2024-04-06 02:40:10,369: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:40:10.370264056Z [2024-04-06 02:40:10,370: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:40:10.370456058Z [2024-04-06 02:40:10,370: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:40:10.370469884Z [2024-04-06 02:40:10,370: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:40:10.370745850Z [2024-04-06 02:40:10,370: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:40:10.370759926Z [2024-04-06 02:40:10,370: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:40:10.477626852Z [2024-04-06 02:40:10,477: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:40:11.113237975Z [2024-04-06 02:40:11,112: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5640bb78-effa-4106-b125-bacb4028c129] succeeded in 2.209121130999847s: None 2024-04-06T02:41:00.230982304Z [2024-04-06 02:41:00,230: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[caafaf27-5986-4727-a504-becccf801c88] received 2024-04-06T02:41:00.233216564Z [2024-04-06 02:41:00,233: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d1cb41cc-7285-4582-8781-a32fd8be7e8e] received 2024-04-06T02:41:00.238285963Z [2024-04-06 02:41:00,237: INFO/ForkPoolWorker-15] [caafaf27-5986-4727-a504-becccf801c88] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:41:00.238868854Z [2024-04-06 02:41:00,238: INFO/ForkPoolWorker-16] [d1cb41cc-7285-4582-8781-a32fd8be7e8e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:41:00.255952041Z [2024-04-06 02:41:00,255: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cb2ca79b-6a89-4e28-a704-bf792dabe4b0] received 2024-04-06T02:41:00.268957552Z [2024-04-06 02:41:00,268: INFO/ForkPoolWorker-1] [cb2ca79b-6a89-4e28-a704-bf792dabe4b0] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T02:41:00.518399621Z [2024-04-06 02:41:00,515: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:41:00.571166378Z [2024-04-06 02:41:00,566: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:41:00.640171165Z [2024-04-06 02:41:00,633: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T02:41:00.821193645Z [2024-04-06 02:41:00,820: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-06T02:41:00.825902006Z [2024-04-06 02:41:00,825: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:41:00.869815910Z [2024-04-06 02:41:00,869: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T02:41:00.871232624Z [2024-04-06 02:41:00,871: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T02:41:00.871662179Z [2024-04-06 02:41:00,871: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T02:41:00.871879506Z [2024-04-06 02:41:00,871: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-06T02:41:00.872391494Z [2024-04-06 02:41:00,872: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T02:41:00.983335570Z [2024-04-06 02:41:00,983: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:41:01.644798814Z [2024-04-06 02:41:01,644: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[cb2ca79b-6a89-4e28-a704-bf792dabe4b0] succeeded in 1.387300017000598s: None 2024-04-06T02:41:01.701267786Z [2024-04-06 02:41:01,700: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:41:01.704597916Z [2024-04-06 02:41:01,704: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:41:01.734823915Z [2024-04-06 02:41:01,734: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:41:01.740064487Z [2024-04-06 02:41:01,739: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:41:01.740409544Z [2024-04-06 02:41:01,739: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:41:01.740751103Z [2024-04-06 02:41:01,740: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:41:01.740947742Z [2024-04-06 02:41:01,740: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:41:01.741806843Z [2024-04-06 02:41:01,741: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:41:01.742334583Z [2024-04-06 02:41:01,741: INFO/ForkPoolWorker-15] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:41:01.836651594Z [2024-04-06 02:41:01,836: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:41:01.840453727Z [2024-04-06 02:41:01,840: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:41:01.846063207Z [2024-04-06 02:41:01,845: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:41:01.873474912Z [2024-04-06 02:41:01,873: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:41:01.874861594Z [2024-04-06 02:41:01,874: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:41:01.874874997Z [2024-04-06 02:41:01,874: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:41:01.875028002Z [2024-04-06 02:41:01,874: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:41:01.875064655Z [2024-04-06 02:41:01,874: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:41:01.875427015Z [2024-04-06 02:41:01,875: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:41:01.875592732Z [2024-04-06 02:41:01,875: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:41:02.002907396Z [2024-04-06 02:41:02,002: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:41:03.338941036Z [2024-04-06 02:41:03,338: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[caafaf27-5986-4727-a504-becccf801c88] succeeded in 3.105424438001137s: None 2024-04-06T02:41:03.863400647Z [2024-04-06 02:41:03,862: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d1cb41cc-7285-4582-8781-a32fd8be7e8e] succeeded in 3.628371397999217s: None 2024-04-06T02:42:01.223165842Z [2024-04-06 02:42:01,222: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[154bb73d-eda9-45d2-a9b3-51d75038f477] received 2024-04-06T02:42:01.229306144Z [2024-04-06 02:42:01,228: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1e209114-c315-442d-be29-1892e72cfa7e] received 2024-04-06T02:42:01.247548730Z [2024-04-06 02:42:01,247: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[31dc2612-1c53-42cb-a390-35fbfc8a5ee0] received 2024-04-06T02:42:01.248677349Z [2024-04-06 02:42:01,248: INFO/ForkPoolWorker-15] [154bb73d-eda9-45d2-a9b3-51d75038f477] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:42:01.250563387Z [2024-04-06 02:42:01,250: INFO/ForkPoolWorker-16] [1e209114-c315-442d-be29-1892e72cfa7e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T02:42:01.269821928Z [2024-04-06 02:42:01,269: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9a1eead2-c1c8-451d-8733-2799d907eb94] received 2024-04-06T02:42:01.279388420Z [2024-04-06 02:42:01,278: INFO/ForkPoolWorker-2] [9a1eead2-c1c8-451d-8733-2799d907eb94] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:42:01.284310574Z [2024-04-06 02:42:01,283: INFO/ForkPoolWorker-1] [31dc2612-1c53-42cb-a390-35fbfc8a5ee0] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T02:42:01.693308068Z [2024-04-06 02:42:01,688: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:42:01.712744149Z [2024-04-06 02:42:01,709: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T02:42:01.720583149Z [2024-04-06 02:42:01,717: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T02:42:01.862319762Z [2024-04-06 02:42:01,859: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:42:01.901074062Z [2024-04-06 02:42:01,900: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-06T02:42:01.905199113Z [2024-04-06 02:42:01,904: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:42:01.941022692Z [2024-04-06 02:42:01,940: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:42:01.943725569Z [2024-04-06 02:42:01,943: INFO/ForkPoolWorker-16] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T02:42:01.944949879Z [2024-04-06 02:42:01,944: INFO/ForkPoolWorker-16] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T02:42:01.946501348Z [2024-04-06 02:42:01,946: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-06T02:42:01.947338668Z [2024-04-06 02:42:01,947: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T02:42:01.996674539Z [2024-04-06 02:42:01,996: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:42:02.036333938Z [2024-04-06 02:42:02,036: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:42:02.639881261Z [2024-04-06 02:42:02,639: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1e209114-c315-442d-be29-1892e72cfa7e] succeeded in 1.4075725290003902s: None 2024-04-06T02:42:02.647967434Z [2024-04-06 02:42:02,647: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[31dc2612-1c53-42cb-a390-35fbfc8a5ee0] succeeded in 1.3863952519986924s: None 2024-04-06T02:42:03.124758060Z [2024-04-06 02:42:03,124: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:42:03.127824056Z [2024-04-06 02:42:03,127: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:42:03.155767398Z [2024-04-06 02:42:03,155: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:42:03.157589869Z [2024-04-06 02:42:03,157: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:42:03.157634815Z [2024-04-06 02:42:03,157: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:42:03.157642663Z [2024-04-06 02:42:03,157: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:42:03.157685544Z [2024-04-06 02:42:03,157: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:42:03.158045518Z [2024-04-06 02:42:03,157: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:42:03.158057932Z [2024-04-06 02:42:03,157: INFO/ForkPoolWorker-15] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:42:03.227241927Z [2024-04-06 02:42:03,226: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-06T02:42:03.230462123Z [2024-04-06 02:42:03,229: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:42:03.241160396Z [2024-04-06 02:42:03,240: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:42:03.259102327Z [2024-04-06 02:42:03,258: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T02:42:03.260339360Z [2024-04-06 02:42:03,260: INFO/ForkPoolWorker-2] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:42:03.260387137Z [2024-04-06 02:42:03,260: INFO/ForkPoolWorker-2] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:42:03.260448397Z [2024-04-06 02:42:03,260: INFO/ForkPoolWorker-2] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:42:03.260463502Z [2024-04-06 02:42:03,260: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-06T02:42:03.260790085Z [2024-04-06 02:42:03,260: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:42:03.260804584Z [2024-04-06 02:42:03,260: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:42:03.393195921Z [2024-04-06 02:42:03,392: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:42:05.067159186Z [2024-04-06 02:42:05,066: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[154bb73d-eda9-45d2-a9b3-51d75038f477] succeeded in 3.838639379000597s: None 2024-04-06T02:42:06.288981108Z [2024-04-06 02:42:06,288: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[9a1eead2-c1c8-451d-8733-2799d907eb94] succeeded in 5.016748558000472s: None 2024-04-06T02:43:00.372275225Z [2024-04-06 02:43:00,371: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e8420f89-6f9b-4dad-9b74-0fd82eaa887a] received 2024-04-06T02:43:00.376714413Z [2024-04-06 02:43:00,376: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2e053c72-f266-4d58-aaba-9882e324db6e] received 2024-04-06T02:43:00.383604823Z [2024-04-06 02:43:00,382: INFO/ForkPoolWorker-15] [e8420f89-6f9b-4dad-9b74-0fd82eaa887a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:43:00.387385985Z [2024-04-06 02:43:00,386: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cd0290b1-173a-421b-ab94-238eef6bd384] received 2024-04-06T02:43:00.392100331Z [2024-04-06 02:43:00,391: INFO/ForkPoolWorker-16] [2e053c72-f266-4d58-aaba-9882e324db6e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:43:00.403134445Z [2024-04-06 02:43:00,402: INFO/ForkPoolWorker-1] [cd0290b1-173a-421b-ab94-238eef6bd384] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T02:43:00.676000904Z [2024-04-06 02:43:00,672: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T02:43:00.676911490Z [2024-04-06 02:43:00,673: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:43:00.726734326Z [2024-04-06 02:43:00,723: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:43:00.843870761Z [2024-04-06 02:43:00,843: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-06T02:43:00.859375208Z [2024-04-06 02:43:00,858: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:43:00.886748192Z [2024-04-06 02:43:00,886: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T02:43:00.888017826Z [2024-04-06 02:43:00,887: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T02:43:00.888241604Z [2024-04-06 02:43:00,887: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T02:43:00.888386915Z [2024-04-06 02:43:00,888: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-06T02:43:00.889181922Z [2024-04-06 02:43:00,888: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T02:43:01.010361951Z [2024-04-06 02:43:01,010: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:43:01.605686767Z [2024-04-06 02:43:01,605: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[cd0290b1-173a-421b-ab94-238eef6bd384] succeeded in 1.215192871999534s: None 2024-04-06T02:43:01.837345978Z [2024-04-06 02:43:01,836: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:43:01.842975674Z [2024-04-06 02:43:01,840: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:43:01.887545078Z [2024-04-06 02:43:01,882: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:43:01.887572047Z [2024-04-06 02:43:01,883: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:43:01.887578876Z [2024-04-06 02:43:01,883: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:43:01.887584149Z [2024-04-06 02:43:01,883: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:43:01.887604191Z [2024-04-06 02:43:01,884: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:43:01.887608561Z [2024-04-06 02:43:01,884: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:43:01.887612699Z [2024-04-06 02:43:01,884: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:43:01.954451392Z [2024-04-06 02:43:01,954: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:43:01.958480337Z [2024-04-06 02:43:01,957: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:43:01.984477864Z [2024-04-06 02:43:01,984: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:43:01.985946506Z [2024-04-06 02:43:01,985: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:43:01.986019807Z [2024-04-06 02:43:01,985: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:43:01.986269738Z [2024-04-06 02:43:01,985: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:43:01.986333326Z [2024-04-06 02:43:01,986: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:43:01.986797680Z [2024-04-06 02:43:01,986: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:43:01.986992626Z [2024-04-06 02:43:01,986: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:43:01.993652617Z [2024-04-06 02:43:01,993: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:43:02.096816017Z [2024-04-06 02:43:02,096: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:43:03.922246120Z [2024-04-06 02:43:03,921: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2e053c72-f266-4d58-aaba-9882e324db6e] succeeded in 3.543282819000524s: None 2024-04-06T02:43:04.945919243Z [2024-04-06 02:43:04,945: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e8420f89-6f9b-4dad-9b74-0fd82eaa887a] succeeded in 4.57071895899935s: None 2024-04-06T02:44:00.866209054Z [2024-04-06 02:44:00,865: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e4fa5df4-2067-424d-a4a3-61fec9693d44] received 2024-04-06T02:44:00.870008176Z [2024-04-06 02:44:00,869: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d70e1b78-2d19-4067-a331-c73381eb6985] received 2024-04-06T02:44:00.874465058Z [2024-04-06 02:44:00,874: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b066e3af-4652-44bd-abdc-80b38cd2d2fe] received 2024-04-06T02:44:00.878841868Z [2024-04-06 02:44:00,878: INFO/ForkPoolWorker-15] [e4fa5df4-2067-424d-a4a3-61fec9693d44] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T02:44:00.879433158Z [2024-04-06 02:44:00,879: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e0ce3686-50f9-423b-891e-446516567286] received 2024-04-06T02:44:00.884059056Z [2024-04-06 02:44:00,883: INFO/ForkPoolWorker-16] [d70e1b78-2d19-4067-a331-c73381eb6985] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:44:00.888360404Z [2024-04-06 02:44:00,888: INFO/ForkPoolWorker-1] [b066e3af-4652-44bd-abdc-80b38cd2d2fe] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:44:00.893015335Z [2024-04-06 02:44:00,892: INFO/ForkPoolWorker-2] [e0ce3686-50f9-423b-891e-446516567286] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T02:44:01.230177063Z [2024-04-06 02:44:01,226: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T02:44:01.344698129Z [2024-04-06 02:44:01,331: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:44:01.352057653Z [2024-04-06 02:44:01,348: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T02:44:01.398331358Z [2024-04-06 02:44:01,388: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:44:01.529874641Z [2024-04-06 02:44:01,529: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:44:01.564721145Z [2024-04-06 02:44:01,564: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-06T02:44:01.569322863Z [2024-04-06 02:44:01,568: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:44:01.597101810Z [2024-04-06 02:44:01,596: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T02:44:01.598110072Z [2024-04-06 02:44:01,597: INFO/ForkPoolWorker-2] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T02:44:01.598319381Z [2024-04-06 02:44:01,598: INFO/ForkPoolWorker-2] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T02:44:01.598398002Z [2024-04-06 02:44:01,598: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-06T02:44:01.598769330Z [2024-04-06 02:44:01,598: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T02:44:01.689462950Z [2024-04-06 02:44:01,689: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:44:02.058700594Z [2024-04-06 02:44:02,058: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e4fa5df4-2067-424d-a4a3-61fec9693d44] succeeded in 1.186605201999555s: None 2024-04-06T02:44:02.293474913Z [2024-04-06 02:44:02,293: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[e0ce3686-50f9-423b-891e-446516567286] succeeded in 1.411282201999711s: None 2024-04-06T02:44:02.644770058Z [2024-04-06 02:44:02,644: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T02:44:02.648631649Z [2024-04-06 02:44:02,648: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:44:02.671122345Z [2024-04-06 02:44:02,670: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T02:44:02.672405617Z [2024-04-06 02:44:02,672: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:44:02.672466862Z [2024-04-06 02:44:02,672: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:44:02.672642006Z [2024-04-06 02:44:02,672: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:44:02.672761925Z [2024-04-06 02:44:02,672: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T02:44:02.673077111Z [2024-04-06 02:44:02,672: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:44:02.673217140Z [2024-04-06 02:44:02,673: INFO/ForkPoolWorker-1] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:44:02.784746211Z [2024-04-06 02:44:02,784: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:44:02.971576994Z [2024-04-06 02:44:02,971: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:44:02.975022938Z [2024-04-06 02:44:02,974: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:44:02.989037701Z [2024-04-06 02:44:02,988: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:44:02.991655809Z [2024-04-06 02:44:02,989: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:44:02.991669320Z [2024-04-06 02:44:02,989: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:44:02.991677740Z [2024-04-06 02:44:02,990: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:44:02.991681664Z [2024-04-06 02:44:02,990: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:44:02.991685648Z [2024-04-06 02:44:02,990: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:44:02.991689053Z [2024-04-06 02:44:02,990: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:44:03.083862000Z [2024-04-06 02:44:03,083: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:44:04.399888433Z [2024-04-06 02:44:04,399: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b066e3af-4652-44bd-abdc-80b38cd2d2fe] succeeded in 3.5204900949993316s: None 2024-04-06T02:44:05.045297785Z [2024-04-06 02:44:05,044: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d70e1b78-2d19-4067-a331-c73381eb6985] succeeded in 4.172785595001187s: None 2024-04-06T02:45:00.793470123Z [2024-04-06 02:45:00,793: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[80bbbd89-c568-4e91-9e7f-4ed680ebfd87] received 2024-04-06T02:45:00.801150958Z [2024-04-06 02:45:00,800: INFO/ForkPoolWorker-15] [80bbbd89-c568-4e91-9e7f-4ed680ebfd87] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:45:00.801524091Z [2024-04-06 02:45:00,801: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[37ebd35f-5713-4ff7-bac9-cdce725ec724] received 2024-04-06T02:45:00.804187821Z [2024-04-06 02:45:00,803: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b1ebb2e0-4846-4ed3-b718-df4f4f4c0eb2] received 2024-04-06T02:45:00.814293352Z [2024-04-06 02:45:00,813: INFO/ForkPoolWorker-16] [37ebd35f-5713-4ff7-bac9-cdce725ec724] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:45:00.815017501Z [2024-04-06 02:45:00,814: INFO/ForkPoolWorker-1] [b1ebb2e0-4846-4ed3-b718-df4f4f4c0eb2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:45:00.816524971Z [2024-04-06 02:45:00,816: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e4b5fb32-f578-44b7-9dad-3b1bc502d694] received 2024-04-06T02:45:00.824635009Z [2024-04-06 02:45:00,824: INFO/ForkPoolWorker-2] [e4b5fb32-f578-44b7-9dad-3b1bc502d694] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T02:45:01.139444089Z [2024-04-06 02:45:01,136: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:45:01.141071721Z [2024-04-06 02:45:01,137: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:45:01.154877553Z [2024-04-06 02:45:01,151: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T02:45:01.232916876Z [2024-04-06 02:45:01,229: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:45:01.364310072Z [2024-04-06 02:45:01,363: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-06T02:45:01.368269737Z [2024-04-06 02:45:01,367: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:45:01.407778325Z [2024-04-06 02:45:01,407: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T02:45:01.409392981Z [2024-04-06 02:45:01,408: INFO/ForkPoolWorker-2] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T02:45:01.409572909Z [2024-04-06 02:45:01,409: INFO/ForkPoolWorker-2] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T02:45:01.409685518Z [2024-04-06 02:45:01,409: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-06T02:45:01.409942655Z [2024-04-06 02:45:01,409: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T02:45:01.538077183Z [2024-04-06 02:45:01,537: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:45:02.143628601Z [2024-04-06 02:45:02,143: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[e4b5fb32-f578-44b7-9dad-3b1bc502d694] succeeded in 1.3253472950000287s: None 2024-04-06T02:45:02.522730944Z [2024-04-06 02:45:02,522: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:45:02.526903676Z [2024-04-06 02:45:02,526: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:45:02.548786114Z [2024-04-06 02:45:02,548: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T02:45:02.553000415Z [2024-04-06 02:45:02,552: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:45:02.553133415Z [2024-04-06 02:45:02,552: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:45:02.553705985Z [2024-04-06 02:45:02,553: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:45:02.554670699Z [2024-04-06 02:45:02,554: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:45:02.554811440Z [2024-04-06 02:45:02,554: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:45:02.555009585Z [2024-04-06 02:45:02,554: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:45:02.555109402Z [2024-04-06 02:45:02,554: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:45:02.555532734Z [2024-04-06 02:45:02,555: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:45:02.555628794Z [2024-04-06 02:45:02,555: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:45:02.557674460Z [2024-04-06 02:45:02,557: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:45:02.576309908Z [2024-04-06 02:45:02,576: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T02:45:02.577875020Z [2024-04-06 02:45:02,577: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:45:02.577945880Z [2024-04-06 02:45:02,577: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:45:02.578090506Z [2024-04-06 02:45:02,577: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:45:02.578101304Z [2024-04-06 02:45:02,578: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T02:45:02.578381700Z [2024-04-06 02:45:02,578: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:45:02.578390601Z [2024-04-06 02:45:02,578: INFO/ForkPoolWorker-1] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:45:02.591581402Z [2024-04-06 02:45:02,591: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:45:02.596001659Z [2024-04-06 02:45:02,595: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:45:02.596116794Z [2024-04-06 02:45:02,595: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:45:02.596332373Z [2024-04-06 02:45:02,596: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:45:02.596448383Z [2024-04-06 02:45:02,596: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:45:02.596929386Z [2024-04-06 02:45:02,596: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:45:02.597105335Z [2024-04-06 02:45:02,596: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:45:02.671769060Z [2024-04-06 02:45:02,671: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:45:02.690291834Z [2024-04-06 02:45:02,690: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:45:02.778280313Z [2024-04-06 02:45:02,777: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:45:03.455687971Z [2024-04-06 02:45:03,454: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[80bbbd89-c568-4e91-9e7f-4ed680ebfd87] succeeded in 2.660116504999678s: None 2024-04-06T02:45:04.111323514Z [2024-04-06 02:45:04,110: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b1ebb2e0-4846-4ed3-b718-df4f4f4c0eb2] succeeded in 3.305200902001161s: None 2024-04-06T02:45:04.275325497Z [2024-04-06 02:45:04,274: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c564ddf6-4139-4fae-b66e-878dc4250126] received 2024-04-06T02:45:04.285927586Z [2024-04-06 02:45:04,285: INFO/ForkPoolWorker-15] [c564ddf6-4139-4fae-b66e-878dc4250126] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'split_metrics', 'scheduled__2024-04-06T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:45:04.599565347Z [2024-04-06 02:45:04,599: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[37ebd35f-5713-4ff7-bac9-cdce725ec724] succeeded in 3.7939555760003714s: None 2024-04-06T02:45:04.660576455Z [2024-04-06 02:45:04,657: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:45:05.742363542Z [2024-04-06 02:45:05,741: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:45:05.744881059Z [2024-04-06 02:45:05,744: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:45:05.769105253Z [2024-04-06 02:45:05,768: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:45:05.770386384Z [2024-04-06 02:45:05,770: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:45:05.770433291Z [2024-04-06 02:45:05,770: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:45:05.770555516Z [2024-04-06 02:45:05,770: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:45:05.770598259Z [2024-04-06 02:45:05,770: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:45:05.770815075Z [2024-04-06 02:45:05,770: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:45:05.770829557Z [2024-04-06 02:45:05,770: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:45:05.858352936Z [2024-04-06 02:45:05,857: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:45:06.543518839Z [2024-04-06 02:45:06,542: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c564ddf6-4139-4fae-b66e-878dc4250126] succeeded in 2.26597258000038s: None 2024-04-06T02:45:06.885928049Z [2024-04-06 02:45:06,884: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[35789fbe-d60a-4b25-8e07-a39ac497ff72] received 2024-04-06T02:45:06.893936059Z [2024-04-06 02:45:06,893: INFO/ForkPoolWorker-15] [35789fbe-d60a-4b25-8e07-a39ac497ff72] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'collect_metrics', 'scheduled__2024-04-06T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T02:45:07.217806157Z [2024-04-06 02:45:07,214: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:45:08.278021346Z [2024-04-06 02:45:08,277: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:45:08.281098316Z [2024-04-06 02:45:08,280: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:45:08.307508352Z [2024-04-06 02:45:08,307: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:45:08.309446639Z [2024-04-06 02:45:08,309: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:45:08.309524981Z [2024-04-06 02:45:08,309: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:45:08.309784198Z [2024-04-06 02:45:08,309: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:45:08.309850414Z [2024-04-06 02:45:08,309: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:45:08.310629106Z [2024-04-06 02:45:08,310: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:45:08.310705247Z [2024-04-06 02:45:08,310: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:45:08.403509196Z [2024-04-06 02:45:08,403: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:45:09.015442137Z [2024-04-06 02:45:09,014: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[35789fbe-d60a-4b25-8e07-a39ac497ff72] succeeded in 2.1268006859991146s: None 2024-04-06T02:45:09.284724086Z [2024-04-06 02:45:09,284: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[deef7c04-6f34-47bd-817f-d97d5e02ecb6] received 2024-04-06T02:45:09.298098370Z [2024-04-06 02:45:09,297: INFO/ForkPoolWorker-15] [deef7c04-6f34-47bd-817f-d97d5e02ecb6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'send_prometheus', 'scheduled__2024-04-06T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:45:09.618830230Z [2024-04-06 02:45:09,615: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-06T02:45:10.762040216Z [2024-04-06 02:45:10,761: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:45:10.765373629Z [2024-04-06 02:45:10,764: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:45:10.787088384Z [2024-04-06 02:45:10,786: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:45:10.788405220Z [2024-04-06 02:45:10,788: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:45:10.788459655Z [2024-04-06 02:45:10,788: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:45:10.788596319Z [2024-04-06 02:45:10,788: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:45:10.788683258Z [2024-04-06 02:45:10,788: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:45:10.788920852Z [2024-04-06 02:45:10,788: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-06T02:45:10.788988629Z [2024-04-06 02:45:10,788: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:45:10.869691088Z [2024-04-06 02:45:10,869: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:45:11.372673315Z [2024-04-06 02:45:11,372: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[deef7c04-6f34-47bd-817f-d97d5e02ecb6] succeeded in 2.085838506000073s: None 2024-04-06T02:46:00.673749161Z [2024-04-06 02:46:00,673: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5cae3eeb-413c-4946-8b4d-1ab1dd7e3f2b] received 2024-04-06T02:46:00.680868992Z [2024-04-06 02:46:00,680: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[23205d81-6ed1-474a-b2fa-26beaeebd8bb] received 2024-04-06T02:46:00.685616249Z [2024-04-06 02:46:00,685: INFO/ForkPoolWorker-15] [5cae3eeb-413c-4946-8b4d-1ab1dd7e3f2b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T02:46:00.696002894Z [2024-04-06 02:46:00,695: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[05a86a68-f5a6-4501-b118-a4cd262e01e8] received 2024-04-06T02:46:00.696710450Z [2024-04-06 02:46:00,696: INFO/ForkPoolWorker-16] [23205d81-6ed1-474a-b2fa-26beaeebd8bb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:46:00.699319287Z [2024-04-06 02:46:00,698: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[24da711b-8430-4aa4-bfbb-845571c679ba] received 2024-04-06T02:46:00.716503186Z [2024-04-06 02:46:00,715: INFO/ForkPoolWorker-1] [05a86a68-f5a6-4501-b118-a4cd262e01e8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:46:00.719609972Z [2024-04-06 02:46:00,718: INFO/ForkPoolWorker-2] [24da711b-8430-4aa4-bfbb-845571c679ba] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T02:46:01.040337636Z [2024-04-06 02:46:01,037: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T02:46:01.079274877Z [2024-04-06 02:46:01,073: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:46:01.182875542Z [2024-04-06 02:46:01,179: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T02:46:01.232054824Z [2024-04-06 02:46:01,228: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:46:01.295785327Z [2024-04-06 02:46:01,295: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:46:01.396061396Z [2024-04-06 02:46:01,395: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-06T02:46:01.400264416Z [2024-04-06 02:46:01,399: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:46:01.430047236Z [2024-04-06 02:46:01,429: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T02:46:01.431609083Z [2024-04-06 02:46:01,431: INFO/ForkPoolWorker-2] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T02:46:01.432245936Z [2024-04-06 02:46:01,432: INFO/ForkPoolWorker-2] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T02:46:01.432433648Z [2024-04-06 02:46:01,432: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-06T02:46:01.432708619Z [2024-04-06 02:46:01,432: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T02:46:01.539687074Z [2024-04-06 02:46:01,539: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:46:01.897143936Z [2024-04-06 02:46:01,896: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5cae3eeb-413c-4946-8b4d-1ab1dd7e3f2b] succeeded in 1.2193370810000488s: None 2024-04-06T02:46:02.125159264Z [2024-04-06 02:46:02,124: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[24da711b-8430-4aa4-bfbb-845571c679ba] succeeded in 1.4132461160006642s: None 2024-04-06T02:46:02.447942593Z [2024-04-06 02:46:02,447: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:46:02.451531018Z [2024-04-06 02:46:02,451: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:46:02.476106372Z [2024-04-06 02:46:02,475: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T02:46:02.479089882Z [2024-04-06 02:46:02,478: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:46:02.482708519Z [2024-04-06 02:46:02,482: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:46:02.484788630Z [2024-04-06 02:46:02,484: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:46:02.485082986Z [2024-04-06 02:46:02,484: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:46:02.485376420Z [2024-04-06 02:46:02,485: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:46:02.485568750Z [2024-04-06 02:46:02,485: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:46:02.486191645Z [2024-04-06 02:46:02,485: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:46:02.486973865Z [2024-04-06 02:46:02,486: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:46:02.497459104Z [2024-04-06 02:46:02,497: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T02:46:02.498928797Z [2024-04-06 02:46:02,498: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:46:02.498940570Z [2024-04-06 02:46:02,498: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:46:02.499109793Z [2024-04-06 02:46:02,498: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:46:02.499331331Z [2024-04-06 02:46:02,499: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T02:46:02.499820186Z [2024-04-06 02:46:02,499: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:46:02.499962089Z [2024-04-06 02:46:02,499: INFO/ForkPoolWorker-1] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:46:02.578922047Z [2024-04-06 02:46:02,578: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:46:02.581718986Z [2024-04-06 02:46:02,581: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:46:04.084990939Z [2024-04-06 02:46:04,084: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[05a86a68-f5a6-4501-b118-a4cd262e01e8] succeeded in 3.3802886710000166s: None 2024-04-06T02:46:04.482970932Z [2024-04-06 02:46:04,482: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[23205d81-6ed1-474a-b2fa-26beaeebd8bb] succeeded in 3.7971568339999067s: None 2024-04-06T02:47:00.294494882Z [2024-04-06 02:47:00,294: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[157969ea-544d-4e97-8671-aeb2c7c60961] received 2024-04-06T02:47:00.302291623Z [2024-04-06 02:47:00,302: INFO/ForkPoolWorker-15] [157969ea-544d-4e97-8671-aeb2c7c60961] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:47:00.307892867Z [2024-04-06 02:47:00,307: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8b41a1cf-954b-4816-9fea-534d68fa1639] received 2024-04-06T02:47:00.311337717Z [2024-04-06 02:47:00,311: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[54c2ed87-e665-4f31-a772-3f1da4ec32ed] received 2024-04-06T02:47:00.316077394Z [2024-04-06 02:47:00,315: INFO/ForkPoolWorker-16] [8b41a1cf-954b-4816-9fea-534d68fa1639] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:47:00.324884279Z [2024-04-06 02:47:00,324: INFO/ForkPoolWorker-1] [54c2ed87-e665-4f31-a772-3f1da4ec32ed] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T02:47:00.578832905Z [2024-04-06 02:47:00,575: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:47:00.612844504Z [2024-04-06 02:47:00,609: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T02:47:00.681524213Z [2024-04-06 02:47:00,678: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:47:00.777752971Z [2024-04-06 02:47:00,777: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-06T02:47:00.782085003Z [2024-04-06 02:47:00,781: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:47:00.813815375Z [2024-04-06 02:47:00,813: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T02:47:00.814928626Z [2024-04-06 02:47:00,814: INFO/ForkPoolWorker-1] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T02:47:00.815379920Z [2024-04-06 02:47:00,814: INFO/ForkPoolWorker-1] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T02:47:00.815400067Z [2024-04-06 02:47:00,815: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-06T02:47:00.815920439Z [2024-04-06 02:47:00,815: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T02:47:00.903863750Z [2024-04-06 02:47:00,903: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:47:01.448955788Z [2024-04-06 02:47:01,448: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[54c2ed87-e665-4f31-a772-3f1da4ec32ed] succeeded in 1.1356470760001685s: None 2024-04-06T02:47:01.703070867Z [2024-04-06 02:47:01,702: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-06T02:47:01.706267559Z [2024-04-06 02:47:01,705: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:47:01.729909595Z [2024-04-06 02:47:01,729: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:47:01.731347017Z [2024-04-06 02:47:01,731: INFO/ForkPoolWorker-15] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:47:01.731415225Z [2024-04-06 02:47:01,731: INFO/ForkPoolWorker-15] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:47:01.731710084Z [2024-04-06 02:47:01,731: INFO/ForkPoolWorker-15] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:47:01.731758980Z [2024-04-06 02:47:01,731: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-06T02:47:01.732459227Z [2024-04-06 02:47:01,732: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:47:01.732469676Z [2024-04-06 02:47:01,732: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:47:01.804139685Z [2024-04-06 02:47:01,803: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:47:01.808098045Z [2024-04-06 02:47:01,807: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:47:01.823436089Z [2024-04-06 02:47:01,823: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:47:01.823770206Z [2024-04-06 02:47:01,823: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:47:01.824529117Z [2024-04-06 02:47:01,824: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:47:01.824577317Z [2024-04-06 02:47:01,824: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:47:01.824695803Z [2024-04-06 02:47:01,824: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:47:01.824736591Z [2024-04-06 02:47:01,824: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:47:01.824906425Z [2024-04-06 02:47:01,824: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:47:01.824942541Z [2024-04-06 02:47:01,824: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:47:01.909298702Z [2024-04-06 02:47:01,909: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:47:03.446905637Z [2024-04-06 02:47:03,446: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8b41a1cf-954b-4816-9fea-534d68fa1639] succeeded in 3.136980807999862s: None 2024-04-06T02:47:03.725797880Z [2024-04-06 02:47:03,724: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[157969ea-544d-4e97-8671-aeb2c7c60961] succeeded in 3.4287148589992285s: None 2024-04-06T02:48:00.529131263Z [2024-04-06 02:48:00,528: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2d456e7d-e3b2-4b13-a6c8-49da808505df] received 2024-04-06T02:48:00.535616425Z [2024-04-06 02:48:00,534: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f5f00429-87c7-4554-a2d4-163eac69c466] received 2024-04-06T02:48:00.538020400Z [2024-04-06 02:48:00,537: INFO/ForkPoolWorker-15] [2d456e7d-e3b2-4b13-a6c8-49da808505df] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T02:48:00.542359168Z [2024-04-06 02:48:00,542: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bb5f29e3-36c5-4f14-b43b-556e494e5f90] received 2024-04-06T02:48:00.546335891Z [2024-04-06 02:48:00,546: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7dfca4b5-4657-4816-b1d5-81d33ef275cf] received 2024-04-06T02:48:00.549996223Z [2024-04-06 02:48:00,549: INFO/ForkPoolWorker-16] [f5f00429-87c7-4554-a2d4-163eac69c466] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:48:00.557344458Z [2024-04-06 02:48:00,556: INFO/ForkPoolWorker-2] [7dfca4b5-4657-4816-b1d5-81d33ef275cf] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T02:48:00.573393918Z [2024-04-06 02:48:00,570: INFO/ForkPoolWorker-1] [bb5f29e3-36c5-4f14-b43b-556e494e5f90] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:48:00.870353887Z [2024-04-06 02:48:00,866: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-06T02:48:00.932701157Z [2024-04-06 02:48:00,929: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:48:00.953451754Z [2024-04-06 02:48:00,950: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T02:48:00.970610577Z [2024-04-06 02:48:00,966: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:48:01.128980194Z [2024-04-06 02:48:01,128: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:48:01.157356032Z [2024-04-06 02:48:01,156: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-06T02:48:01.162657956Z [2024-04-06 02:48:01,162: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:48:01.192293975Z [2024-04-06 02:48:01,192: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-06T02:48:01.196221458Z [2024-04-06 02:48:01,195: INFO/ForkPoolWorker-2] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T02:48:01.196449733Z [2024-04-06 02:48:01,196: INFO/ForkPoolWorker-2] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T02:48:01.196627725Z [2024-04-06 02:48:01,196: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-06T02:48:01.197021997Z [2024-04-06 02:48:01,196: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T02:48:01.314913713Z [2024-04-06 02:48:01,314: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:48:01.658902469Z [2024-04-06 02:48:01,658: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2d456e7d-e3b2-4b13-a6c8-49da808505df] succeeded in 1.126391589999912s: None 2024-04-06T02:48:01.836986364Z [2024-04-06 02:48:01,836: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[7dfca4b5-4657-4816-b1d5-81d33ef275cf] succeeded in 1.286226769001587s: None 2024-04-06T02:48:02.228649095Z [2024-04-06 02:48:02,228: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T02:48:02.232089471Z [2024-04-06 02:48:02,231: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:48:02.254550868Z [2024-04-06 02:48:02,254: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T02:48:02.256019869Z [2024-04-06 02:48:02,255: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:48:02.256304788Z [2024-04-06 02:48:02,256: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:48:02.256388939Z [2024-04-06 02:48:02,256: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:48:02.256596347Z [2024-04-06 02:48:02,256: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T02:48:02.256918493Z [2024-04-06 02:48:02,256: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:48:02.257429464Z [2024-04-06 02:48:02,257: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:48:02.327618584Z [2024-04-06 02:48:02,327: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:48:02.330841588Z [2024-04-06 02:48:02,330: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:48:02.340171794Z [2024-04-06 02:48:02,339: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:48:02.355803068Z [2024-04-06 02:48:02,355: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:48:02.359047657Z [2024-04-06 02:48:02,358: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:48:02.359073852Z [2024-04-06 02:48:02,358: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:48:02.359114666Z [2024-04-06 02:48:02,358: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:48:02.359217090Z [2024-04-06 02:48:02,359: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:48:02.359637295Z [2024-04-06 02:48:02,359: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:48:02.359672096Z [2024-04-06 02:48:02,359: INFO/ForkPoolWorker-16] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:48:02.440822941Z [2024-04-06 02:48:02,440: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:48:04.032381819Z [2024-04-06 02:48:04,031: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f5f00429-87c7-4554-a2d4-163eac69c466] succeeded in 3.492912425999748s: None 2024-04-06T02:48:05.031686837Z [2024-04-06 02:48:05,031: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[bb5f29e3-36c5-4f14-b43b-556e494e5f90] succeeded in 4.483700322000004s: None 2024-04-06T02:49:00.807451315Z [2024-04-06 02:49:00,807: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4a5ca93d-fde8-412f-b5e5-85684537cae1] received 2024-04-06T02:49:00.813451530Z [2024-04-06 02:49:00,813: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b0ca931f-94c5-45ae-a1f0-157801a11b8c] received 2024-04-06T02:49:00.818879522Z [2024-04-06 02:49:00,818: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c2c22bd0-db23-4667-950e-27ba9359873a] received 2024-04-06T02:49:00.824520140Z [2024-04-06 02:49:00,824: INFO/ForkPoolWorker-15] [4a5ca93d-fde8-412f-b5e5-85684537cae1] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T02:49:00.825945780Z [2024-04-06 02:49:00,825: INFO/ForkPoolWorker-16] [b0ca931f-94c5-45ae-a1f0-157801a11b8c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:49:00.829113754Z [2024-04-06 02:49:00,828: INFO/ForkPoolWorker-1] [c2c22bd0-db23-4667-950e-27ba9359873a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:49:01.235534063Z [2024-04-06 02:49:01,231: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-06T02:49:01.340749435Z [2024-04-06 02:49:01,337: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-06T02:49:01.342026585Z [2024-04-06 02:49:01,338: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-06T02:49:01.511199845Z [2024-04-06 02:49:01,510: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-06T02:49:01.515195739Z [2024-04-06 02:49:01,514: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:49:01.545565092Z [2024-04-06 02:49:01,545: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-06T02:49:01.546881146Z [2024-04-06 02:49:01,546: INFO/ForkPoolWorker-15] Read SDNC a578e73a-a85d-487f-9bdd-c0d80b52b896 (sdnc-osm) 2024-04-06T02:49:01.547031039Z [2024-04-06 02:49:01,546: INFO/ForkPoolWorker-15] [{'_id': 'a578e73a-a85d-487f-9bdd-c0d80b52b896', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-06T02:49:01.547336718Z [2024-04-06 02:49:01,546: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-06T02:49:01.547630567Z [2024-04-06 02:49:01,547: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_a578e73a-a85d-487f-9bdd-c0d80b52b896 2024-04-06T02:49:01.647943469Z [2024-04-06 02:49:01,647: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:49:02.291662795Z [2024-04-06 02:49:02,291: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4a5ca93d-fde8-412f-b5e5-85684537cae1] succeeded in 1.4818550550007785s: None 2024-04-06T02:49:02.610728107Z [2024-04-06 02:49:02,610: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-06T02:49:02.614077416Z [2024-04-06 02:49:02,613: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:49:02.643186837Z [2024-04-06 02:49:02,642: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-06T02:49:02.644726950Z [2024-04-06 02:49:02,644: INFO/ForkPoolWorker-16] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:49:02.644755498Z [2024-04-06 02:49:02,644: INFO/ForkPoolWorker-16] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:49:02.644941828Z [2024-04-06 02:49:02,644: INFO/ForkPoolWorker-16] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:49:02.645079234Z [2024-04-06 02:49:02,644: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-06T02:49:02.645674142Z [2024-04-06 02:49:02,645: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-06T02:49:02.645911093Z [2024-04-06 02:49:02,645: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:49:02.738637218Z [2024-04-06 02:49:02,738: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:49:02.763563971Z [2024-04-06 02:49:02,762: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-06T02:49:02.767043302Z [2024-04-06 02:49:02,766: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'uw4ujPCfzvQJCfftr5u2PbJPoqRwz9G8'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-06T02:49:02.795917310Z [2024-04-06 02:49:02,795: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-06T02:49:02.798475507Z [2024-04-06 02:49:02,798: INFO/ForkPoolWorker-1] Read VIM 28f48db5-722f-4da1-8015-6d10f79ea8bb (_system-osm-vim) 2024-04-06T02:49:02.798679573Z [2024-04-06 02:49:02,798: INFO/ForkPoolWorker-1] Read VIM bc1e39f2-14a5-40bc-924b-7e422df2f287 (osm) 2024-04-06T02:49:02.798915431Z [2024-04-06 02:49:02,798: INFO/ForkPoolWorker-1] [{'_id': '28f48db5-722f-4da1-8015-6d10f79ea8bb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'bc1e39f2-14a5-40bc-924b-7e422df2f287', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-06T02:49:02.799102638Z [2024-04-06 02:49:02,798: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-06T02:49:02.799504953Z [2024-04-06 02:49:02,799: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-06T02:49:02.799710633Z [2024-04-06 02:49:02,799: INFO/ForkPoolWorker-1] Creating DAG vim_status_bc1e39f2-14a5-40bc-924b-7e422df2f287 2024-04-06T02:49:02.895028367Z [2024-04-06 02:49:02,894: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-06T02:49:04.927838129Z [2024-04-06 02:49:04,927: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c2c22bd0-db23-4667-950e-27ba9359873a] succeeded in 4.104219949998878s: None 2024-04-06T02:49:05.175824973Z [2024-04-06 02:49:05,175: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b0ca931f-94c5-45ae-a1f0-157801a11b8c] succeeded in 4.359361438000633s: None 2024-04-05T22:31:01.245393530Z 2024-04-05T22:31:01.251641318Z Cleaning logs every 900 seconds 2024-04-05T22:31:01.251662796Z Trimming airflow logs to 15 days. 2024-04-05T22:45:00.288879347Z Trimming airflow logs to 15 days. 2024-04-05T22:45:01.324139056Z Trimming airflow logs to 15 days. 2024-04-05T23:00:00.369643708Z Trimming airflow logs to 15 days. 2024-04-05T23:00:01.418844431Z Trimming airflow logs to 15 days. 2024-04-05T23:15:00.456109824Z Trimming airflow logs to 15 days. 2024-04-05T23:15:01.523691234Z Trimming airflow logs to 15 days. 2024-04-05T23:30:00.575925496Z Trimming airflow logs to 15 days. 2024-04-05T23:30:01.619961238Z Trimming airflow logs to 15 days. 2024-04-05T23:45:00.679584555Z Trimming airflow logs to 15 days. 2024-04-05T23:45:01.738576655Z Trimming airflow logs to 15 days. 2024-04-06T00:00:00.821355981Z Trimming airflow logs to 15 days. 2024-04-06T00:00:01.891399372Z Trimming airflow logs to 15 days. 2024-04-06T00:15:00.961233012Z Trimming airflow logs to 15 days. 2024-04-06T00:30:00.020490033Z Trimming airflow logs to 15 days. 2024-04-06T00:30:01.083787863Z Trimming airflow logs to 15 days. 2024-04-06T00:45:00.150488654Z Trimming airflow logs to 15 days. 2024-04-06T00:45:01.216738983Z Trimming airflow logs to 15 days. 2024-04-06T01:00:00.337619533Z Trimming airflow logs to 15 days. 2024-04-06T01:00:01.395480453Z Trimming airflow logs to 15 days. 2024-04-06T01:15:00.482889484Z Trimming airflow logs to 15 days. 2024-04-06T01:15:01.563616485Z Trimming airflow logs to 15 days. 2024-04-06T01:30:00.667562464Z Trimming airflow logs to 15 days. 2024-04-06T01:45:00.051814669Z Trimming airflow logs to 15 days. 2024-04-06T01:45:01.150273337Z Trimming airflow logs to 15 days. 2024-04-06T02:00:00.247108563Z Trimming airflow logs to 15 days. 2024-04-06T02:00:01.371722783Z Trimming airflow logs to 15 days. 2024-04-06T02:15:00.486816519Z Trimming airflow logs to 15 days. 2024-04-06T02:15:01.580822534Z Trimming airflow logs to 15 days. 2024-04-06T02:30:00.690402485Z Trimming airflow logs to 15 days. 2024-04-06T02:30:01.771547727Z Trimming airflow logs to 15 days. 2024-04-06T02:45:00.887627678Z Trimming airflow logs to 15 days. 2024-04-05T22:30:37.335632680Z . 2024-04-05T22:30:37.884848012Z /home/airflow/.local/lib/python3.10/site-packages/airflow/configuration.py:384 FutureWarning: The auth_backends setting in [api] has had airflow.api.auth.backend.session added in the running config, which is needed by the UI. Please update your config before Apache Airflow 3.0. 2024-04-05T22:30:39.048145679Z /home/airflow/.local/lib/python3.10/site-packages/airflow/models/base.py:49 MovedIn20Warning: Deprecated API features detected! These feature(s) are not compatible with SQLAlchemy 2.0. To prevent incompatible upgrades prior to updating applications, ensure requirements files are pinned to "sqlalchemy<2.0". Set environment variable SQLALCHEMY_WARN_20=1 to show all deprecation warnings. Set environment variable SQLALCHEMY_SILENCE_UBER_WARNING=1 to silence this message. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9) 2024-04-05T22:30:43.873184481Z [2024-04-05T22:30:43.867+0000] {db.py:755} INFO - Waiting for migrations... 0 second(s)